2024-09-12T01:52:46.497 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T01:52:46.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:52:46.632 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/postgres}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901590' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=legacy - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBERjnfcxcDF8U43Dct2R6xmNfSRNeEP7zs2US/CPP4QuOygiuDcJ5vCOeYqCjX1q8oY6H9VcK6MPM+DX1T6OT9I= smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBElUjQ4v3oFsBRwb/IM+GRncEwV1Xm2f2UbjjrbBD7J038wN4SK6lAWkyFbMN9KN2bss97YeTHXjOqe9MtjTpeU= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPmD8useQK6RDlqxOiVgDDG9+gXqAUxrS8HNh1rEWCME/mTdWb07jHSDX1kUiVloQ1oghviRWC9auunZRxwtySU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T01:52:46.632 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T01:52:46.633 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T01:52:46.633 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T01:52:46.634 INFO:teuthology.task.internal:Checking packages... 2024-09-12T01:52:46.655 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T01:52:46.655 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:52:46.656 INFO:teuthology.packaging:ref: None 2024-09-12T01:52:46.656 INFO:teuthology.packaging:tag: None 2024-09-12T01:52:46.656 INFO:teuthology.packaging:branch: squid 2024-09-12T01:52:46.656 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:52:46.656 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T01:52:46.909 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T01:52:46.910 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T01:52:46.917 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T01:52:46.918 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T01:52:46.923 INFO:teuthology.task.internal:Saving configuration 2024-09-12T01:52:46.945 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T01:52:46.954 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T01:52:46.988 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:45:41.023506', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBERjnfcxcDF8U43Dct2R6xmNfSRNeEP7zs2US/CPP4QuOygiuDcJ5vCOeYqCjX1q8oY6H9VcK6MPM+DX1T6OT9I='} 2024-09-12T01:52:47.019 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:45:41.027232', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBElUjQ4v3oFsBRwb/IM+GRncEwV1Xm2f2UbjjrbBD7J038wN4SK6lAWkyFbMN9KN2bss97YeTHXjOqe9MtjTpeU='} 2024-09-12T01:52:47.052 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:45:41.025500', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPmD8useQK6RDlqxOiVgDDG9+gXqAUxrS8HNh1rEWCME/mTdWb07jHSDX1kUiVloQ1oghviRWC9auunZRxwtySU='} 2024-09-12T01:52:47.053 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T01:52:47.059 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-12T01:52:47.059 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-12T01:52:47.059 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-12T01:52:47.059 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T01:52:47.179 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff02905fbe0>, signals=[15]) 2024-09-12T01:52:47.179 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T01:52:47.186 INFO:teuthology.task.internal:Opening connections... 2024-09-12T01:52:47.186 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T01:52:47.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:52:47.286 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-09-12T01:52:47.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:52:47.383 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-09-12T01:52:47.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:52:47.465 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T01:52:47.472 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-09-12T01:52:47.491 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-09-12T01:52:47.491 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-09-12T01:52:47.549 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-09-12T01:52:47.550 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-09-12T01:52:47.550 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-09-12T01:52:47.550 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:52:47.550 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-09-12T01:52:47.550 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:52:47.550 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:52:47.550 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-09-12T01:52:47.550 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:52:47.550 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:52:47.550 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:52:47.550 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:52:47.550 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:52:47.551 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:52:47.551 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-09-12T01:52:47.580 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-09-12T01:52:47.598 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-09-12T01:52:47.599 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-09-12T01:52:47.657 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-09-12T01:52:47.657 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-09-12T01:52:47.657 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-09-12T01:52:47.657 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:52:47.657 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-09-12T01:52:47.657 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:52:47.657 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:52:47.657 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-09-12T01:52:47.657 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:52:47.658 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:52:47.658 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:52:47.658 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:52:47.658 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:52:47.658 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:52:47.658 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-09-12T01:52:47.688 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-09-12T01:52:47.707 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-09-12T01:52:47.707 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-09-12T01:52:47.765 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-09-12T01:52:47.766 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-09-12T01:52:47.766 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-09-12T01:52:47.766 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:52:47.766 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-09-12T01:52:47.766 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:52:47.766 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:52:47.766 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-09-12T01:52:47.766 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:52:47.766 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:52:47.766 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:52:47.766 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:52:47.767 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:52:47.767 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:52:47.767 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-09-12T01:52:47.796 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T01:52:47.807 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T01:52:47.812 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T01:52:47.812 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:52:47.815 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:52:47.818 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:52:47.834 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T01:52:47.839 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T01:52:47.840 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:52:47.873 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:52:47.876 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:52:47.971 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T01:52:48.072 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T01:52:48.092 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T01:52:48.093 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-12T01:52:48.093 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-12T01:52:48.093 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:52:48.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:52:48.111 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-12T01:52:48.297 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T01:52:48.297 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-12T01:52:48.297 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-12T01:52:48.316 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-503.el9.x86_64 2024-09-12T01:52:48.316 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T01:52:48.316 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-12T01:52:48.317 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum upgrade -y linux-firmware 2024-09-12T01:52:52.088 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-12T01:52:57.681 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-12T01:53:02.056 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T01:53:03.590 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 96 kB/s | 19 kB 00:00 2024-09-12T01:53:04.727 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-12T01:53:10.067 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-12T01:53:12.138 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-12T01:53:12.139 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-09-12T01:53:12.139 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-12T01:53:12.256 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T01:53:12.256 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-12T01:53:12.413 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-12T01:53:12.414 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-12T01:53:12.417 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi110.front.sepia.ceph.com to complete... 2024-09-12T01:53:20.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12 01:53:20 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-12T01:53:20.125 INFO:teuthology.orchestra.run.smithi110.stderr:FINISHED --2024-09-12 01:53:20-- 2024-09-12T01:53:20.125 INFO:teuthology.orchestra.run.smithi110.stderr:Total wall clock time: 7.7s 2024-09-12T01:53:20.125 INFO:teuthology.orchestra.run.smithi110.stderr:Downloaded: 1 files, 343M in 7.4s (46.3 MB/s) 2024-09-12T01:53:20.127 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-12T01:53:20.127 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-12T01:53:22.250 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying... ######################################## 2024-09-12T01:53:22.452 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing... ######################################## 2024-09-12T01:53:22.563 INFO:teuthology.orchestra.run.smithi110.stdout:Updating / installing... 2024-09-12T01:53:30.616 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-12T01:54:10.498 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-12T01:54:10.499 DEBUG:teuthology.orchestra.run.smithi110:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-12T01:54:10.581 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:54:10.581 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:54:10.581 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:54:10.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:54:10.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-12T01:54:10.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-12T01:54:10.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-12T01:54:10.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-12T01:54:10.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-12T01:54:10.581 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-12T01:54:10.582 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-12T01:54:10.583 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-12T01:54:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-12T01:54:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-12T01:54:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-12T01:54:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-12T01:54:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-12T01:54:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-12T01:54:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-12T01:54:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-12T01:54:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-12T01:54:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-12T01:54:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-12T01:54:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-12T01:54:10.585 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-12T01:54:10.586 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-12T01:54:10.587 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-12T01:54:10.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-12T01:54:10.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-12T01:54:10.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-12T01:54:10.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-12T01:54:10.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-12T01:54:10.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-12T01:54:10.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-12T01:54:10.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-12T01:54:10.588 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-12T01:54:10.589 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-12T01:54:10.590 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-12T01:54:10.591 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-12T01:54:10.592 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-12T01:54:10.593 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-12T01:54:10.594 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-12T01:54:10.595 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-12T01:54:10.596 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-12T01:54:10.597 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-12T01:54:10.598 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-12T01:54:10.599 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-12T01:54:10.600 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-12T01:54:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-12T01:54:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-12T01:54:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-12T01:54:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-12T01:54:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-12T01:54:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-12T01:54:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-12T01:54:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-12T01:54:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-12T01:54:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-12T01:54:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-12T01:54:10.601 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-12T01:54:10.602 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-12T01:54:10.603 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-12T01:54:10.604 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-12T01:54:10.605 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-12T01:54:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-12T01:54:10.607 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-12T01:54:10.608 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-12T01:54:10.609 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-12T01:54:10.610 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-12T01:54:10.611 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-12T01:54:10.612 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-12T01:54:10.613 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-12T01:54:10.614 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-12T01:54:10.615 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-12T01:54:10.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-12T01:54:10.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-12T01:54:10.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-12T01:54:10.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-12T01:54:10.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-12T01:54:10.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-12T01:54:10.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-12T01:54:10.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-12T01:54:10.616 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-12T01:54:10.617 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-12T01:54:10.618 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-12T01:54:10.619 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-12T01:54:10.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-12T01:54:10.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-12T01:54:10.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-12T01:54:10.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-12T01:54:10.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-12T01:54:10.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-12T01:54:10.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-12T01:54:10.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-12T01:54:10.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-12T01:54:10.620 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-12T01:54:10.621 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-12T01:54:10.622 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-12T01:54:10.623 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-12T01:54:10.624 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-12T01:54:10.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-12T01:54:10.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-12T01:54:10.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-12T01:54:10.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-12T01:54:10.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-12T01:54:10.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-12T01:54:10.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-12T01:54:10.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-12T01:54:10.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-12T01:54:10.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-12T01:54:10.625 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-12T01:54:10.626 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-12T01:54:10.627 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-12T01:54:10.628 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-12T01:54:10.629 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-12T01:54:10.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-12T01:54:10.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-12T01:54:10.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-12T01:54:10.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-12T01:54:10.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-12T01:54:10.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-12T01:54:10.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-12T01:54:10.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-12T01:54:10.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-12T01:54:10.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-12T01:54:10.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-12T01:54:10.630 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-12T01:54:10.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-12T01:54:10.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-12T01:54:10.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-12T01:54:10.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-12T01:54:10.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-12T01:54:10.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-12T01:54:10.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-12T01:54:10.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-12T01:54:10.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-12T01:54:10.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-12T01:54:10.631 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-12T01:54:10.632 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-12T01:54:10.633 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-12T01:54:10.634 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-12T01:54:10.635 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-12T01:54:10.636 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-12T01:54:10.637 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-12T01:54:10.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-12T01:54:10.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-12T01:54:10.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-12T01:54:10.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-12T01:54:10.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-12T01:54:10.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-12T01:54:10.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-12T01:54:10.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-12T01:54:10.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-12T01:54:10.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-12T01:54:10.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-12T01:54:10.638 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-12T01:54:10.639 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-12T01:54:10.640 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-12T01:54:10.641 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-12T01:54:10.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-12T01:54:10.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-12T01:54:10.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-12T01:54:10.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-12T01:54:10.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-12T01:54:10.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-12T01:54:10.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-12T01:54:10.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-12T01:54:10.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-12T01:54:10.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-12T01:54:10.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-12T01:54:10.642 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-12T01:54:10.643 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-12T01:54:10.644 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-12T01:54:10.645 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-12T01:54:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-12T01:54:10.647 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-12T01:54:10.648 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-12T01:54:10.649 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-12T01:54:10.650 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-12T01:54:10.651 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-12T01:54:10.652 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-12T01:54:10.653 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-12T01:54:10.654 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-12T01:54:10.655 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-12T01:54:10.656 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-12T01:54:10.657 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-12T01:54:10.658 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-12T01:54:10.659 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-12T01:54:10.660 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-12T01:54:10.661 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-12T01:54:10.662 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-12T01:54:10.663 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-12T01:54:10.664 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-12T01:54:10.665 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-12T01:54:10.666 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-12T01:54:10.667 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-12T01:54:10.668 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-12T01:54:10.669 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-12T01:54:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-12T01:54:10.671 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-12T01:54:10.672 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-12T01:54:10.673 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-12T01:54:10.674 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-12T01:54:10.675 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-12T01:54:10.676 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-12T01:54:10.677 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-12T01:54:10.678 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-12T01:54:10.679 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-12T01:54:10.680 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-12T01:54:10.681 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-12T01:54:10.682 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-12T01:54:10.683 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-12T01:54:10.684 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-12T01:54:10.685 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-12T01:54:10.686 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-12T01:54:10.687 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-12T01:54:10.688 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-12T01:54:10.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-12T01:54:10.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-12T01:54:10.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-12T01:54:10.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-12T01:54:10.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-12T01:54:10.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-12T01:54:10.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-12T01:54:10.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-12T01:54:10.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-12T01:54:10.689 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-12T01:54:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-12T01:54:10.691 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-12T01:54:10.692 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-12T01:54:10.693 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-12T01:54:10.694 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-12T01:54:10.695 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-12T01:54:10.696 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-12T01:54:10.697 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-12T01:54:10.698 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-12T01:54:10.699 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-12T01:54:10.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-12T01:54:10.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-12T01:54:10.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-12T01:54:10.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-12T01:54:10.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-12T01:54:10.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-12T01:54:10.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-12T01:54:10.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-12T01:54:10.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-12T01:54:10.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-12T01:54:10.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-12T01:54:10.700 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-12T01:54:10.701 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-12T01:54:10.702 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-12T01:54:10.703 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-12T01:54:10.704 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-12T01:54:10.705 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-12T01:54:10.706 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-12T01:54:10.707 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-12T01:54:10.708 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-12T01:54:10.709 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-12T01:54:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-12T01:54:10.711 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-12T01:54:10.712 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-12T01:54:10.713 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-12T01:54:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-12T01:54:10.715 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-12T01:54:10.716 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-12T01:54:10.717 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-12T01:54:10.718 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-12T01:54:10.719 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-12T01:54:10.720 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-12T01:54:10.721 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-12T01:54:10.722 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-12T01:54:10.723 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-12T01:54:10.724 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-12T01:54:10.725 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-12T01:54:10.726 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-12T01:54:10.726 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-12T01:54:10.726 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T01:54:10.730 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:54:10.730 DEBUG:teuthology.orchestra.run.smithi110:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-12T01:54:10.752 INFO:teuthology.orchestra.run.smithi110.stdout:postinstall scriptlet (using /bin/sh): 2024-09-12T01:54:10.753 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T01:54:10.753 INFO:teuthology.orchestra.run.smithi110.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-12T01:54:10.753 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-09-12T01:54:10.753 INFO:teuthology.orchestra.run.smithi110.stdout:for file in vmlinuz System.map config; do 2024-09-12T01:54:10.753 INFO:teuthology.orchestra.run.smithi110.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-12T01:54:10.753 INFO:teuthology.orchestra.run.smithi110.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T01:54:10.753 INFO:teuthology.orchestra.run.smithi110.stdout: fi 2024-09-12T01:54:10.753 INFO:teuthology.orchestra.run.smithi110.stdout:done 2024-09-12T01:54:10.753 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-12T01:54:10.753 INFO:teuthology.orchestra.run.smithi110.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-12T01:54:10.753 INFO:teuthology.orchestra.run.smithi110.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T01:54:10.754 INFO:teuthology.orchestra.run.smithi110.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-12T01:54:10.754 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-09-12T01:54:10.754 INFO:teuthology.orchestra.run.smithi110.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-12T01:54:10.754 INFO:teuthology.orchestra.run.smithi110.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:54:10.754 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-09-12T01:54:10.754 INFO:teuthology.orchestra.run.smithi110.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-12T01:54:10.754 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-12T01:54:10.754 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:54:10.754 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-09-12T01:54:10.755 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -qi grub2-tools 2024-09-12T01:54:10.833 INFO:teuthology.orchestra.run.smithi110.stdout:Name : grub2-tools 2024-09-12T01:54:10.833 INFO:teuthology.orchestra.run.smithi110.stdout:Epoch : 1 2024-09-12T01:54:10.833 INFO:teuthology.orchestra.run.smithi110.stdout:Version : 2.06 2024-09-12T01:54:10.833 INFO:teuthology.orchestra.run.smithi110.stdout:Release : 82.el9 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: x86_64 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:Group : Unspecified 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:Size : 8274670 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:License : GPLv3+ 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:Packager : builder@centos.org 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:Vendor : CentOS 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:Summary : Support tools for GRUB. 2024-09-12T01:54:10.834 INFO:teuthology.orchestra.run.smithi110.stdout:Description : 2024-09-12T01:54:10.835 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T01:54:10.835 INFO:teuthology.orchestra.run.smithi110.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T01:54:10.835 INFO:teuthology.orchestra.run.smithi110.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T01:54:10.835 INFO:teuthology.orchestra.run.smithi110.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T01:54:10.835 INFO:teuthology.orchestra.run.smithi110.stdout:hardware devices. 2024-09-12T01:54:10.835 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T01:54:10.835 INFO:teuthology.orchestra.run.smithi110.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T01:54:10.836 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T01:54:10.836 INFO:teuthology.task.kernel:Updating grub on smithi110 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:54:10.836 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T01:54:11.464 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-09-12T01:54:12.883 INFO:teuthology.orchestra.run.smithi110.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T01:54:12.913 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-09-12T01:54:12.923 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-09-12T01:54:12.939 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.V4tUONZn9G 2024-09-12T01:54:12.939 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.V4tUONZn9G 2024-09-12T01:54:13.005 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.V4tUONZn9G 2024-09-12T01:54:13.149 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.V4tUONZn9G is 6KB 2024-09-12T01:54:13.169 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.V4tUONZn9G 2024-09-12T01:54:13.184 DEBUG:teuthology.orchestra.run.smithi110:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T01:54:13.256 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T01:54:13.257 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T01:54:13.257 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T01:54:13.257 INFO:teuthology.orchestra.run.smithi110.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-12T01:54:13.258 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:54:13.406 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-09-12T01:54:43.409 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T01:54:43.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-12T01:54:43.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:55:43.422 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T01:55:52.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-12T01:55:52.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:56:00.121 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-12T01:56:00.674 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-12T01:56:00.674 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-12T01:56:00.674 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-12T01:56:00.708 INFO:teuthology.orchestra.run.smithi110.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:56:00.708 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-12T01:56:00.708 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T01:56:00.708 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T01:56:01.711 DEBUG:teuthology.parallel:result is None 2024-09-12T01:56:01.712 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T01:56:01.719 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T01:56:01.719 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:56:01.723 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:56:01.726 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:56:01.754 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T01:56:01.761 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T01:56:01.770 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T01:56:01.771 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:56:01.800 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:56:01.802 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:56:01.846 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T01:56:01.854 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T01:56:01.854 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:56:01.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:56:01.887 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:56:01.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:56:01.905 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:56:01.909 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:56:01.930 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:56:01.966 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:56:01.983 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:56:01.985 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:56:02.001 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:56:02.016 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:56:02.064 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:56:02.068 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T01:56:02.075 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T01:56:02.075 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:56:02.079 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:56:02.081 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:56:02.132 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T01:56:02.144 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T01:56:02.144 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:56:02.148 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:56:02.150 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:56:02.179 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:56:02.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:56:02.363 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:56:02.437 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:56:02.496 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T01:56:02.497 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:56:02.577 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:56:02.631 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:56:02.680 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:56:02.773 DEBUG:teuthology.orchestra.run.smithi115:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:56:02.809 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-12T01:56:02.809 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:56:02.880 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:56:02.934 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:56:03.013 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:56:03.066 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:56:03.099 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-12T01:56:03.099 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:56:03.166 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-09-12T01:56:03.170 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-09-12T01:56:03.173 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-09-12T01:56:03.209 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:56:03.244 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:56:03.246 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:56:03.696 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T01:56:03.703 INFO:teuthology.task.internal:Starting timer... 2024-09-12T01:56:03.703 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T01:56:03.715 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T01:56:03.723 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T01:56:03.723 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-09-12T01:56:03.847 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-09-12T01:56:03.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo service auditd rotate 2024-09-12T01:56:03.913 INFO:teuthology.orchestra.run.smithi115.stdout:Rotating logs: 2024-09-12T01:56:03.915 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-09-12T01:56:04.031 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-09-12T01:56:04.033 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T01:56:04.033 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-09-12T01:56:04.070 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-09-12T01:56:04.070 DEBUG:teuthology.orchestra.run.smithi115:> /usr/sbin/getenforce 2024-09-12T01:56:04.093 INFO:teuthology.orchestra.run.smithi115.stdout:Permissive 2024-09-12T01:56:04.093 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-09-12T01:56:04.120 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-09-12T01:56:04.120 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi110.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi115.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive'} 2024-09-12T01:56:04.120 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:56:04.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:56:04.178 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:56:04.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:56:04.206 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:56:04.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:56:04.233 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T01:56:04.233 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:56:04.318 DEBUG:teuthology.orchestra.run.smithi115:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:56:04.352 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:56:04.385 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T01:56:04.400 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T01:56:04.412 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T01:56:04.413 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi110.front.sepia.ceph.com,smithi115.front.sepia.ceph.com,smithi136.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T02:00:39.491 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi110.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com')] 2024-09-12T02:00:39.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-12T02:00:39.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:00:39.605 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-12T02:00:39.719 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-12T02:00:39.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-12T02:00:39.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:00:39.802 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-09-12T02:00:39.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-09-12T02:00:39.885 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-12T02:00:39.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T02:00:39.984 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-09-12T02:00:40.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-09-12T02:00:40.063 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T02:00:40.074 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T02:00:40.075 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:00:40.075 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:00:40.079 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:00:40.079 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:00:40.082 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T02:00:40.082 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:00:40.112 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:00:40.127 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:00:40.134 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:00:40.136 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T02:00:40.149 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:00:40.152 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: ntpd: command not found 2024-09-12T02:00:40.164 INFO:teuthology.orchestra.run.smithi115.stdout:506 Cannot talk to daemon 2024-09-12T02:00:40.166 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T02:00:40.174 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-09-12T02:00:40.178 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:00:40.185 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-09-12T02:00:40.192 INFO:teuthology.orchestra.run.smithi115.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:00:40.200 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:00:40.214 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:00:40.216 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-09-12T02:00:40.240 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-09-12T02:00:40.252 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:00:40.255 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:00:40.255 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-09-12T02:00:40.256 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:00:40.256 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:00:40.256 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:00:40.256 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:00:40.269 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T02:00:40.276 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:00:40.280 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:00:40.280 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-09-12T02:00:40.280 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:00:40.280 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:00:40.280 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:00:40.280 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:00:40.298 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T02:00:40.398 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:00:40.405 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:00:40.405 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-09-12T02:00:40.405 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:00:40.405 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:00:40.405 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:00:40.405 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:00:40.406 INFO:teuthology.run_tasks:Running task install... 2024-09-12T02:00:40.414 DEBUG:teuthology.task.install:project ceph 2024-09-12T02:00:40.414 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T02:00:40.414 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T02:00:40.414 INFO:teuthology.task.install:Using flavor: default 2024-09-12T02:00:40.421 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T02:00:40.421 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T02:00:40.421 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:00:40.422 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:00:40.424 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:00:40.424 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:00:40.425 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T02:00:40.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:00:40.576 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:00:40.577 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:00:40.588 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:00:40.588 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:00:40.599 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T02:00:40.599 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T02:00:40.696 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:00:40.696 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:00:40.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:00:40.704 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:00:40.704 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-12T02:00:40.704 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:00:40.714 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T02:00:40.714 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-12T02:00:40.714 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T02:00:40.732 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:00:40.732 DEBUG:teuthology.orchestra.run.smithi115:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:00:40.740 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:00:40.740 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:00:40.753 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T02:00:40.753 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T02:00:40.800 DEBUG:teuthology.orchestra.run.smithi115:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:00:40.806 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:00:40.850 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T02:00:40.877 DEBUG:teuthology.orchestra.run.smithi115:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:00:40.881 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:00:40.928 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T02:00:40.941 INFO:teuthology.orchestra.run.smithi115.stdout:check_obsoletes = 1 2024-09-12T02:00:40.943 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum clean all 2024-09-12T02:00:40.944 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2024-09-12T02:00:40.946 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2024-09-12T02:00:40.983 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-09-12T02:00:40.986 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-09-12T02:00:41.168 INFO:teuthology.orchestra.run.smithi115.stdout:45 files removed 2024-09-12T02:00:41.171 INFO:teuthology.orchestra.run.smithi136.stdout:45 files removed 2024-09-12T02:00:41.194 DEBUG:teuthology.orchestra.run.smithi115:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:00:41.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:00:41.256 INFO:teuthology.orchestra.run.smithi110.stdout:45 files removed 2024-09-12T02:00:41.288 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T02:00:41.741 INFO:teuthology.orchestra.run.smithi115.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-09-12T02:00:41.742 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-12T02:00:41.956 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 300 kB/s | 84 kB 00:00 2024-09-12T02:00:42.017 INFO:teuthology.orchestra.run.smithi115.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-12T02:00:42.027 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-12T02:00:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-12T02:00:42.286 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-12T02:00:42.292 INFO:teuthology.orchestra.run.smithi115.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T02:00:42.532 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-12T02:00:42.909 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-12T02:00:43.069 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T02:00:44.125 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-09-12T02:00:44.777 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-12T02:00:45.170 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-12T02:00:48.977 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-12T02:00:49.609 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 20 MB 00:04 2024-09-12T02:00:50.469 INFO:teuthology.orchestra.run.smithi115.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-12T02:00:51.087 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-12T02:00:51.290 INFO:teuthology.orchestra.run.smithi115.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-12T02:00:52.555 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-12T02:00:53.317 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T02:00:55.110 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-12T02:00:56.737 INFO:teuthology.orchestra.run.smithi115.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T02:00:56.878 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-12T02:00:58.107 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-12T02:00:58.714 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-12T02:00:59.006 INFO:teuthology.orchestra.run.smithi115.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:00:59.006 INFO:teuthology.orchestra.run.smithi115.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:00:59.018 INFO:teuthology.orchestra.run.smithi115.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:00:59.018 INFO:teuthology.orchestra.run.smithi115.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:00:59.019 INFO:teuthology.orchestra.run.smithi115.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:00:59.020 INFO:teuthology.orchestra.run.smithi115.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:00:59.022 INFO:teuthology.orchestra.run.smithi115.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:00:59.024 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:00:59.025 INFO:teuthology.orchestra.run.smithi115.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:00:59.086 INFO:teuthology.orchestra.run.smithi115.stdout:Dependencies resolved. 2024-09-12T02:00:59.106 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================== 2024-09-12T02:00:59.106 INFO:teuthology.orchestra.run.smithi115.stdout: Package Arch Version Repository Size 2024-09-12T02:00:59.106 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================== 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout:Installing: 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:00:59.107 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:00:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:00:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:00:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:00:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:00:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:00:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:00:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:00:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:00:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:00:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:00:59.108 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:00:59.109 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrading: 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout:Installing dependencies: 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:00:59.110 INFO:teuthology.orchestra.run.smithi115.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:00:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:00:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:00:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:00:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:00:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:00:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:00:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:00:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:00:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:00:59.111 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:00:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:00:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:00:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:00:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:00:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:00:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:00:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:00:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:00:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:00:59.112 INFO:teuthology.orchestra.run.smithi115.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:00:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:00:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:00:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:00:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:00:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:00:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:00:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:00:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:00:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:00:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:00:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:00:59.113 INFO:teuthology.orchestra.run.smithi115.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:00:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:00:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:00:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:00:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:00:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:00:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:00:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:00:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:00:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:00:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:00:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:00:59.114 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:00:59.115 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:00:59.116 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:00:59.117 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:00:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:00:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:00:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:00:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:00:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:00:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:00:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:00:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:00:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:00:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:00:59.118 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:00:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:00:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:00:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:00:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:00:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:00:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:00:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:00:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:00:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:00:59.119 INFO:teuthology.orchestra.run.smithi115.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:00:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:00:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:00:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:00:59.120 INFO:teuthology.orchestra.run.smithi115.stdout:Installing weak dependencies: 2024-09-12T02:00:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:00:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:00:59.120 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction Summary 2024-09-12T02:00:59.120 INFO:teuthology.orchestra.run.smithi115.stdout:====================================================================================== 2024-09-12T02:00:59.120 INFO:teuthology.orchestra.run.smithi115.stdout:Install 148 Packages 2024-09-12T02:00:59.120 INFO:teuthology.orchestra.run.smithi115.stdout:Upgrade 8 Packages 2024-09-12T02:00:59.120 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:00:59.121 INFO:teuthology.orchestra.run.smithi115.stdout:Total download size: 226 M 2024-09-12T02:00:59.121 INFO:teuthology.orchestra.run.smithi115.stdout:Downloading Packages: 2024-09-12T02:00:59.772 INFO:teuthology.orchestra.run.smithi115.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 48 kB/s | 6.5 kB 00:00 2024-09-12T02:01:00.014 INFO:teuthology.orchestra.run.smithi115.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.6 MB/s | 897 kB 00:00 2024-09-12T02:01:00.089 INFO:teuthology.orchestra.run.smithi115.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-12T02:01:00.114 INFO:teuthology.orchestra.run.smithi115.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.4 MB/s | 145 kB 00:00 2024-09-12T02:01:00.206 INFO:teuthology.orchestra.run.smithi115.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 20 MB/s | 2.4 MB 00:00 2024-09-12T02:01:00.265 INFO:teuthology.orchestra.run.smithi115.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-12T02:01:00.490 INFO:teuthology.orchestra.run.smithi115.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-12T02:01:00.865 INFO:teuthology.orchestra.run.smithi115.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 17 MB/s | 21 MB 00:01 2024-09-12T02:01:00.907 INFO:teuthology.orchestra.run.smithi115.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 608 kB/s | 25 kB 00:00 2024-09-12T02:01:01.018 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:01:01.019 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:01:01.033 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:01:01.034 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:01:01.035 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:01:01.035 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:01:01.037 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:01:01.040 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:01:01.041 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:01:01.103 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-09-12T02:01:01.113 INFO:teuthology.orchestra.run.smithi136.stdout:====================================================================================== 2024-09-12T02:01:01.113 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-09-12T02:01:01.113 INFO:teuthology.orchestra.run.smithi136.stdout:====================================================================================== 2024-09-12T02:01:01.113 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-09-12T02:01:01.113 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:01:01.114 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:01:01.114 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:01:01.114 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:01:01.114 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:01:01.114 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:01:01.114 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:01:01.114 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:01:01.114 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:01:01.114 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:01:01.114 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:01:01.114 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:01:01.114 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:01:01.115 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:01:01.115 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:01:01.115 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:01:01.115 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:01:01.115 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:01:01.115 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:01:01.115 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:01:01.115 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:01:01.115 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:01:01.116 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:01:01.117 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:01:01.117 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:01:01.117 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-09-12T02:01:01.117 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:01:01.117 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:01:01.117 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:01:01.117 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:01:01.117 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:01:01.117 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:01:01.117 INFO:teuthology.orchestra.run.smithi136.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:01:01.117 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:01:01.117 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-09-12T02:01:01.118 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:01:01.118 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:01:01.118 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:01:01.118 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:01:01.118 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:01:01.118 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:01:01.118 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:01:01.118 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:01:01.118 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:01:01.119 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:01:01.120 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:01:01.120 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:01:01.120 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:01:01.120 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:01:01.120 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:01:01.120 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:01:01.120 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:01:01.120 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:01:01.120 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:01:01.121 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:01:01.121 INFO:teuthology.orchestra.run.smithi136.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:01:01.121 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:01:01.121 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:01:01.121 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:01:01.121 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:01:01.121 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:01:01.121 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:01:01.121 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:01:01.121 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:01:01.121 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:01:01.122 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:01:01.122 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:01:01.122 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:01:01.122 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:01:01.122 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:01:01.122 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:01:01.122 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:01:01.122 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:01:01.122 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:01:01.122 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:01:01.122 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:01:01.122 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:01:01.123 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:01:01.124 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:01:01.124 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:01:01.124 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:01:01.124 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:01:01.124 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:01:01.124 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:01:01.124 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:01:01.124 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:01:01.124 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:01:01.124 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:01:01.125 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:01:01.125 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:01:01.125 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:01:01.125 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:01:01.125 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:01:01.125 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:01:01.125 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:01:01.125 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:01:01.125 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:01:01.125 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:01:01.125 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:01:01.125 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:01:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-09-12T02:01:01.127 INFO:teuthology.orchestra.run.smithi136.stdout:====================================================================================== 2024-09-12T02:01:01.128 INFO:teuthology.orchestra.run.smithi136.stdout:Install 148 Packages 2024-09-12T02:01:01.128 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 8 Packages 2024-09-12T02:01:01.128 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:01.128 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 226 M 2024-09-12T02:01:01.128 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-09-12T02:01:01.282 INFO:teuthology.orchestra.run.smithi115.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 17 MB/s | 17 MB 00:01 2024-09-12T02:01:01.425 INFO:teuthology.orchestra.run.smithi115.stdout:(11/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 11 MB/s | 11 MB 00:00 2024-09-12T02:01:01.450 INFO:teuthology.orchestra.run.smithi115.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.3 MB/s | 228 kB 00:00 2024-09-12T02:01:01.483 INFO:teuthology.orchestra.run.smithi115.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 817 kB/s | 27 kB 00:00 2024-09-12T02:01:01.500 INFO:teuthology.orchestra.run.smithi115.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 635 kB/s | 32 kB 00:00 2024-09-12T02:01:01.550 INFO:teuthology.orchestra.run.smithi115.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 752 kB 00:00 2024-09-12T02:01:01.575 INFO:teuthology.orchestra.run.smithi115.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 163 kB 00:00 2024-09-12T02:01:01.609 INFO:teuthology.orchestra.run.smithi115.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.1 MB/s | 127 kB 00:00 2024-09-12T02:01:01.634 INFO:teuthology.orchestra.run.smithi115.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 8.4 MB/s | 506 kB 00:00 2024-09-12T02:01:01.710 INFO:teuthology.orchestra.run.smithi115.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 602 kB/s | 45 kB 00:00 2024-09-12T02:01:01.794 INFO:teuthology.orchestra.run.smithi115.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.6 MB/s | 136 kB 00:00 2024-09-12T02:01:01.824 INFO:teuthology.orchestra.run.smithi136.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 29 kB/s | 6.5 kB 00:00 2024-09-12T02:01:01.877 INFO:teuthology.orchestra.run.smithi115.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 20 MB/s | 5.3 MB 00:00 2024-09-12T02:01:01.902 INFO:teuthology.orchestra.run.smithi115.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 162 kB 00:00 2024-09-12T02:01:01.936 INFO:teuthology.orchestra.run.smithi115.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-12T02:01:01.961 INFO:teuthology.orchestra.run.smithi115.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-12T02:01:01.998 INFO:teuthology.orchestra.run.smithi115.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.6 MB/s | 100 kB 00:00 2024-09-12T02:01:02.020 INFO:teuthology.orchestra.run.smithi115.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-12T02:01:02.121 INFO:teuthology.orchestra.run.smithi115.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-12T02:01:02.188 INFO:teuthology.orchestra.run.smithi115.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 16 MB/s | 3.1 MB 00:00 2024-09-12T02:01:02.213 INFO:teuthology.orchestra.run.smithi115.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 347 kB/s | 32 kB 00:00 2024-09-12T02:01:02.246 INFO:teuthology.orchestra.run.smithi115.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.4 MB/s | 146 kB 00:00 2024-09-12T02:01:02.449 INFO:teuthology.orchestra.run.smithi136.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 897 kB 00:00 2024-09-12T02:01:02.591 INFO:teuthology.orchestra.run.smithi136.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.0 MB/s | 145 kB 00:00 2024-09-12T02:01:02.736 INFO:teuthology.orchestra.run.smithi115.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 6.8 MB/s | 3.6 MB 00:00 2024-09-12T02:01:02.741 INFO:teuthology.orchestra.run.smithi136.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 4.7 MB/s | 5.4 MB 00:01 2024-09-12T02:01:02.847 INFO:teuthology.orchestra.run.smithi115.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-12T02:01:02.889 INFO:teuthology.orchestra.run.smithi115.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 1.6 MB/s | 249 kB 00:00 2024-09-12T02:01:02.914 INFO:teuthology.orchestra.run.smithi115.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 739 kB/s | 49 kB 00:00 2024-09-12T02:01:02.917 INFO:teuthology.orchestra.run.smithi136.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 8.7 MB/s | 1.5 MB 00:00 2024-09-12T02:01:02.940 INFO:teuthology.orchestra.run.smithi115.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 327 kB/s | 16 kB 00:00 2024-09-12T02:01:02.973 INFO:teuthology.orchestra.run.smithi115.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.8 MB/s | 285 kB 00:00 2024-09-12T02:01:03.023 INFO:teuthology.orchestra.run.smithi115.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-12T02:01:03.049 INFO:teuthology.orchestra.run.smithi115.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 241 kB/s | 18 kB 00:00 2024-09-12T02:01:03.059 INFO:teuthology.orchestra.run.smithi136.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 5.1 MB/s | 2.4 MB 00:00 2024-09-12T02:01:03.409 INFO:teuthology.orchestra.run.smithi136.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 9.6 MB/s | 4.7 MB 00:00 2024-09-12T02:01:03.458 INFO:teuthology.orchestra.run.smithi115.stdout:(39/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 19 MB/s | 49 MB 00:02 2024-09-12T02:01:03.525 INFO:teuthology.orchestra.run.smithi115.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 159 kB/s | 80 kB 00:00 2024-09-12T02:01:03.592 INFO:teuthology.orchestra.run.smithi115.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-12T02:01:03.617 INFO:teuthology.orchestra.run.smithi115.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-12T02:01:03.642 INFO:teuthology.orchestra.run.smithi115.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-12T02:01:03.668 INFO:teuthology.orchestra.run.smithi115.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T02:01:03.693 INFO:teuthology.orchestra.run.smithi136.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 10 MB/s | 21 MB 00:02 2024-09-12T02:01:03.709 INFO:teuthology.orchestra.run.smithi115.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-12T02:01:03.735 INFO:teuthology.orchestra.run.smithi115.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-12T02:01:03.743 INFO:teuthology.orchestra.run.smithi136.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 506 kB/s | 25 kB 00:00 2024-09-12T02:01:03.760 INFO:teuthology.orchestra.run.smithi115.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T02:01:03.835 INFO:teuthology.orchestra.run.smithi115.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.0 MB/s | 1.2 MB 00:00 2024-09-12T02:01:04.011 INFO:teuthology.orchestra.run.smithi115.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-12T02:01:04.036 INFO:teuthology.orchestra.run.smithi115.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 534 kB/s | 107 kB 00:00 2024-09-12T02:01:04.070 INFO:teuthology.orchestra.run.smithi115.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-12T02:01:04.095 INFO:teuthology.orchestra.run.smithi115.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-12T02:01:04.120 INFO:teuthology.orchestra.run.smithi115.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-09-12T02:01:04.170 INFO:teuthology.orchestra.run.smithi115.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-12T02:01:04.195 INFO:teuthology.orchestra.run.smithi115.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-09-12T02:01:04.229 INFO:teuthology.orchestra.run.smithi115.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-12T02:01:04.254 INFO:teuthology.orchestra.run.smithi115.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T02:01:04.268 INFO:teuthology.orchestra.run.smithi136.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 14 MB/s | 17 MB 00:01 2024-09-12T02:01:04.296 INFO:teuthology.orchestra.run.smithi115.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-12T02:01:04.319 INFO:teuthology.orchestra.run.smithi136.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T02:01:04.321 INFO:teuthology.orchestra.run.smithi115.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 491 kB/s | 45 kB 00:00 2024-09-12T02:01:04.347 INFO:teuthology.orchestra.run.smithi115.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-12T02:01:04.372 INFO:teuthology.orchestra.run.smithi115.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-12T02:01:04.386 INFO:teuthology.orchestra.run.smithi136.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 405 kB/s | 27 kB 00:00 2024-09-12T02:01:04.397 INFO:teuthology.orchestra.run.smithi115.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 324 kB/s | 24 kB 00:00 2024-09-12T02:01:04.424 INFO:teuthology.orchestra.run.smithi115.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 614 kB/s | 47 kB 00:00 2024-09-12T02:01:04.436 INFO:teuthology.orchestra.run.smithi136.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 635 kB/s | 32 kB 00:00 2024-09-12T02:01:04.449 INFO:teuthology.orchestra.run.smithi115.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 292 kB 00:00 2024-09-12T02:01:04.475 INFO:teuthology.orchestra.run.smithi115.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-12T02:01:04.509 INFO:teuthology.orchestra.run.smithi115.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 458 kB/s | 38 kB 00:00 2024-09-12T02:01:04.511 INFO:teuthology.orchestra.run.smithi136.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 9.8 MB/s | 752 kB 00:00 2024-09-12T02:01:04.522 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-09-12T02:01:04.578 INFO:teuthology.orchestra.run.smithi136.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T02:01:04.645 INFO:teuthology.orchestra.run.smithi136.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.9 MB/s | 127 kB 00:00 2024-09-12T02:01:04.676 INFO:teuthology.orchestra.run.smithi115.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-12T02:01:04.718 INFO:teuthology.orchestra.run.smithi115.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-09-12T02:01:04.750 INFO:teuthology.orchestra.run.smithi136.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 4.8 MB/s | 506 kB 00:00 2024-09-12T02:01:04.776 INFO:teuthology.orchestra.run.smithi115.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-12T02:01:04.802 INFO:teuthology.orchestra.run.smithi115.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-12T02:01:04.844 INFO:teuthology.orchestra.run.smithi115.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-12T02:01:04.877 INFO:teuthology.orchestra.run.smithi115.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-12T02:01:04.885 INFO:teuthology.orchestra.run.smithi136.stdout:(18/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 7.2 MB/s | 11 MB 00:01 2024-09-12T02:01:04.902 INFO:teuthology.orchestra.run.smithi115.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T02:01:04.942 INFO:teuthology.orchestra.run.smithi136.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 774 kB/s | 45 kB 00:00 2024-09-12T02:01:04.952 INFO:teuthology.orchestra.run.smithi115.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-12T02:01:05.026 INFO:teuthology.orchestra.run.smithi136.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.6 MB/s | 136 kB 00:00 2024-09-12T02:01:05.053 INFO:teuthology.orchestra.run.smithi115.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-12T02:01:05.078 INFO:teuthology.orchestra.run.smithi115.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-12T02:01:05.101 INFO:teuthology.orchestra.run.smithi136.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-12T02:01:05.111 INFO:teuthology.orchestra.run.smithi115.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-12T02:01:05.126 INFO:teuthology.orchestra.run.smithi136.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.6 MB/s | 162 kB 00:00 2024-09-12T02:01:05.128 INFO:teuthology.orchestra.run.smithi115.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-09-12T02:01:05.151 INFO:teuthology.orchestra.run.smithi136.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.3 MB/s | 321 kB 00:00 2024-09-12T02:01:05.194 INFO:teuthology.orchestra.run.smithi136.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 4.4 MB/s | 301 kB 00:00 2024-09-12T02:01:05.212 INFO:teuthology.orchestra.run.smithi115.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-12T02:01:05.219 INFO:teuthology.orchestra.run.smithi136.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.4 MB/s | 100 kB 00:00 2024-09-12T02:01:05.229 INFO:teuthology.orchestra.run.smithi115.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 163 kB/s | 19 kB 00:00 2024-09-12T02:01:05.244 INFO:teuthology.orchestra.run.smithi136.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:01:05.254 INFO:teuthology.orchestra.run.smithi115.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-12T02:01:05.280 INFO:teuthology.orchestra.run.smithi115.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 518 kB/s | 35 kB 00:00 2024-09-12T02:01:05.303 INFO:teuthology.orchestra.run.smithi136.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-12T02:01:05.313 INFO:teuthology.orchestra.run.smithi115.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-12T02:01:05.339 INFO:teuthology.orchestra.run.smithi115.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-12T02:01:05.372 INFO:teuthology.orchestra.run.smithi115.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T02:01:05.431 INFO:teuthology.orchestra.run.smithi115.stdout:(86/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-09-12T02:01:05.456 INFO:teuthology.orchestra.run.smithi115.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 360 kB/s | 42 kB 00:00 2024-09-12T02:01:05.481 INFO:teuthology.orchestra.run.smithi115.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-12T02:01:05.506 INFO:teuthology.orchestra.run.smithi115.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-12T02:01:05.532 INFO:teuthology.orchestra.run.smithi115.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-12T02:01:05.557 INFO:teuthology.orchestra.run.smithi115.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 674 kB/s | 51 kB 00:00 2024-09-12T02:01:05.582 INFO:teuthology.orchestra.run.smithi115.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-09-12T02:01:05.608 INFO:teuthology.orchestra.run.smithi115.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 827 kB/s | 42 kB 00:00 2024-09-12T02:01:05.641 INFO:teuthology.orchestra.run.smithi115.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-09-12T02:01:05.675 INFO:teuthology.orchestra.run.smithi115.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-12T02:01:05.717 INFO:teuthology.orchestra.run.smithi115.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 476 kB/s | 36 kB 00:00 2024-09-12T02:01:05.737 INFO:teuthology.orchestra.run.smithi136.stdout:(28/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 24 MB/s | 49 MB 00:01 2024-09-12T02:01:05.742 INFO:teuthology.orchestra.run.smithi115.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 704 kB/s | 47 kB 00:00 2024-09-12T02:01:05.754 INFO:teuthology.orchestra.run.smithi136.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 71 kB/s | 32 kB 00:00 2024-09-12T02:01:05.801 INFO:teuthology.orchestra.run.smithi115.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 992 kB/s | 58 kB 00:00 2024-09-12T02:01:05.813 INFO:teuthology.orchestra.run.smithi136.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 5.2 MB/s | 3.1 MB 00:00 2024-09-12T02:01:05.826 INFO:teuthology.orchestra.run.smithi115.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-12T02:01:05.838 INFO:teuthology.orchestra.run.smithi136.stdout:(31/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.4 MB/s | 146 kB 00:00 2024-09-12T02:01:05.868 INFO:teuthology.orchestra.run.smithi115.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-12T02:01:05.893 INFO:teuthology.orchestra.run.smithi115.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-09-12T02:01:05.905 INFO:teuthology.orchestra.run.smithi136.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 3.7 MB/s | 249 kB 00:00 2024-09-12T02:01:05.927 INFO:teuthology.orchestra.run.smithi115.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-09-12T02:01:05.963 INFO:teuthology.orchestra.run.smithi136.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 847 kB/s | 49 kB 00:00 2024-09-12T02:01:06.022 INFO:teuthology.orchestra.run.smithi136.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 283 kB/s | 16 kB 00:00 2024-09-12T02:01:06.119 INFO:teuthology.orchestra.run.smithi115.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-12T02:01:06.131 INFO:teuthology.orchestra.run.smithi136.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 23 MB/s | 7.4 MB 00:00 2024-09-12T02:01:06.144 INFO:teuthology.orchestra.run.smithi115.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 89 kB/s | 22 kB 00:00 2024-09-12T02:01:06.165 INFO:teuthology.orchestra.run.smithi136.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.0 MB/s | 285 kB 00:00 2024-09-12T02:01:06.194 INFO:teuthology.orchestra.run.smithi115.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-12T02:01:06.215 INFO:teuthology.orchestra.run.smithi136.stdout:(37/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 7.7 MB/s | 3.6 MB 00:00 2024-09-12T02:01:06.220 INFO:teuthology.orchestra.run.smithi115.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-12T02:01:06.240 INFO:teuthology.orchestra.run.smithi136.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 243 kB/s | 18 kB 00:00 2024-09-12T02:01:06.245 INFO:teuthology.orchestra.run.smithi115.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-09-12T02:01:06.265 INFO:teuthology.orchestra.run.smithi136.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 5.6 MB/s | 765 kB 00:00 2024-09-12T02:01:06.270 INFO:teuthology.orchestra.run.smithi115.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T02:01:06.295 INFO:teuthology.orchestra.run.smithi115.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T02:01:06.321 INFO:teuthology.orchestra.run.smithi115.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T02:01:06.355 INFO:teuthology.orchestra.run.smithi115.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-12T02:01:06.391 INFO:teuthology.orchestra.run.smithi136.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-12T02:01:06.405 INFO:teuthology.orchestra.run.smithi115.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-12T02:01:06.416 INFO:teuthology.orchestra.run.smithi136.stdout:(41/156): fuse-2.9.9-16.el9.x86_64.rpm 398 kB/s | 80 kB 00:00 2024-09-12T02:01:06.438 INFO:teuthology.orchestra.run.smithi115.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T02:01:06.450 INFO:teuthology.orchestra.run.smithi136.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-12T02:01:06.463 INFO:teuthology.orchestra.run.smithi115.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T02:01:06.483 INFO:teuthology.orchestra.run.smithi136.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-12T02:01:06.517 INFO:teuthology.orchestra.run.smithi136.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-12T02:01:06.530 INFO:teuthology.orchestra.run.smithi115.stdout:(115/156): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-12T02:01:06.547 INFO:teuthology.orchestra.run.smithi115.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 384 kB/s | 32 kB 00:00 2024-09-12T02:01:06.560 INFO:teuthology.orchestra.run.smithi136.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-12T02:01:06.564 INFO:teuthology.orchestra.run.smithi115.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 422 kB/s | 14 kB 00:00 2024-09-12T02:01:06.584 INFO:teuthology.orchestra.run.smithi136.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-12T02:01:06.598 INFO:teuthology.orchestra.run.smithi115.stdout:(118/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.3 MB/s | 863 kB 00:00 2024-09-12T02:01:06.618 INFO:teuthology.orchestra.run.smithi136.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-12T02:01:06.632 INFO:teuthology.orchestra.run.smithi115.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-12T02:01:06.651 INFO:teuthology.orchestra.run.smithi136.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-12T02:01:06.665 INFO:teuthology.orchestra.run.smithi115.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-12T02:01:06.691 INFO:teuthology.orchestra.run.smithi115.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.8 MB/s | 220 kB 00:00 2024-09-12T02:01:06.732 INFO:teuthology.orchestra.run.smithi115.stdout:(122/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-09-12T02:01:06.758 INFO:teuthology.orchestra.run.smithi115.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-09-12T02:01:06.783 INFO:teuthology.orchestra.run.smithi115.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T02:01:06.808 INFO:teuthology.orchestra.run.smithi115.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-12T02:01:06.834 INFO:teuthology.orchestra.run.smithi115.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-12T02:01:06.859 INFO:teuthology.orchestra.run.smithi115.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T02:01:06.884 INFO:teuthology.orchestra.run.smithi115.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T02:01:06.918 INFO:teuthology.orchestra.run.smithi115.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-12T02:01:06.935 INFO:teuthology.orchestra.run.smithi115.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 4.6 MB/s | 79 kB 00:00 2024-09-12T02:01:06.960 INFO:teuthology.orchestra.run.smithi115.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:01:06.994 INFO:teuthology.orchestra.run.smithi115.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T02:01:07.019 INFO:teuthology.orchestra.run.smithi115.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-12T02:01:07.052 INFO:teuthology.orchestra.run.smithi115.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-12T02:01:07.069 INFO:teuthology.orchestra.run.smithi115.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-12T02:01:07.095 INFO:teuthology.orchestra.run.smithi115.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 674 kB/s | 28 kB 00:00 2024-09-12T02:01:07.110 INFO:teuthology.orchestra.run.smithi136.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-12T02:01:07.120 INFO:teuthology.orchestra.run.smithi115.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-12T02:01:07.126 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:01:07.127 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T02:01:07.138 INFO:teuthology.orchestra.run.smithi110.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T02:01:07.139 INFO:teuthology.orchestra.run.smithi110.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T02:01:07.140 INFO:teuthology.orchestra.run.smithi110.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T02:01:07.141 INFO:teuthology.orchestra.run.smithi110.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T02:01:07.143 INFO:teuthology.orchestra.run.smithi110.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T02:01:07.145 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T02:01:07.145 INFO:teuthology.orchestra.run.smithi115.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T02:01:07.146 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T02:01:07.171 INFO:teuthology.orchestra.run.smithi115.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T02:01:07.196 INFO:teuthology.orchestra.run.smithi115.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-12T02:01:07.212 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-09-12T02:01:07.227 INFO:teuthology.orchestra.run.smithi136.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 186 kB/s | 22 kB 00:00 2024-09-12T02:01:07.231 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================== 2024-09-12T02:01:07.231 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-09-12T02:01:07.231 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================== 2024-09-12T02:01:07.231 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-09-12T02:01:07.231 INFO:teuthology.orchestra.run.smithi110.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T02:01:07.232 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T02:01:07.232 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T02:01:07.232 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T02:01:07.232 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T02:01:07.232 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T02:01:07.232 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T02:01:07.232 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T02:01:07.232 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T02:01:07.232 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T02:01:07.232 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T02:01:07.232 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T02:01:07.232 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T02:01:07.233 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T02:01:07.233 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T02:01:07.233 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T02:01:07.233 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T02:01:07.233 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T02:01:07.233 INFO:teuthology.orchestra.run.smithi110.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T02:01:07.233 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T02:01:07.233 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T02:01:07.233 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T02:01:07.234 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T02:01:07.234 INFO:teuthology.orchestra.run.smithi110.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T02:01:07.234 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T02:01:07.234 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T02:01:07.234 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T02:01:07.234 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T02:01:07.234 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T02:01:07.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T02:01:07.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T02:01:07.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T02:01:07.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T02:01:07.234 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T02:01:07.235 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T02:01:07.235 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T02:01:07.235 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T02:01:07.235 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-09-12T02:01:07.235 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T02:01:07.235 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T02:01:07.235 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T02:01:07.235 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T02:01:07.235 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T02:01:07.235 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T02:01:07.235 INFO:teuthology.orchestra.run.smithi110.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T02:01:07.236 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T02:01:07.236 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-09-12T02:01:07.236 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T02:01:07.236 INFO:teuthology.orchestra.run.smithi110.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T02:01:07.236 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T02:01:07.236 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T02:01:07.236 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T02:01:07.236 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T02:01:07.236 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T02:01:07.236 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T02:01:07.237 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T02:01:07.237 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T02:01:07.237 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T02:01:07.237 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T02:01:07.237 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T02:01:07.237 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T02:01:07.237 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T02:01:07.237 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T02:01:07.238 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T02:01:07.238 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T02:01:07.238 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T02:01:07.238 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T02:01:07.238 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T02:01:07.238 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T02:01:07.238 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T02:01:07.238 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T02:01:07.238 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T02:01:07.238 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T02:01:07.239 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T02:01:07.239 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T02:01:07.239 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T02:01:07.239 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T02:01:07.239 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T02:01:07.239 INFO:teuthology.orchestra.run.smithi110.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T02:01:07.239 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T02:01:07.239 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T02:01:07.239 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T02:01:07.240 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T02:01:07.240 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T02:01:07.240 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T02:01:07.240 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T02:01:07.240 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T02:01:07.240 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T02:01:07.240 INFO:teuthology.orchestra.run.smithi110.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T02:01:07.240 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T02:01:07.240 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T02:01:07.241 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T02:01:07.241 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T02:01:07.241 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T02:01:07.241 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T02:01:07.241 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T02:01:07.241 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T02:01:07.241 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T02:01:07.241 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T02:01:07.241 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T02:01:07.242 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T02:01:07.243 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T02:01:07.244 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T02:01:07.245 INFO:teuthology.orchestra.run.smithi110.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout:====================================================================================== 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout:Install 148 Packages 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 8 Packages 2024-09-12T02:01:07.246 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:01:07.247 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 226 M 2024-09-12T02:01:07.247 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-09-12T02:01:07.254 INFO:teuthology.orchestra.run.smithi115.stdout:(141/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-12T02:01:07.280 INFO:teuthology.orchestra.run.smithi115.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 684 kB/s | 74 kB 00:00 2024-09-12T02:01:07.305 INFO:teuthology.orchestra.run.smithi115.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T02:01:07.319 INFO:teuthology.orchestra.run.smithi136.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 938 kB/s | 689 kB 00:00 2024-09-12T02:01:07.330 INFO:teuthology.orchestra.run.smithi115.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-12T02:01:07.356 INFO:teuthology.orchestra.run.smithi115.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T02:01:07.389 INFO:teuthology.orchestra.run.smithi115.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-12T02:01:07.414 INFO:teuthology.orchestra.run.smithi115.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-12T02:01:07.427 INFO:teuthology.orchestra.run.smithi136.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-12T02:01:07.465 INFO:teuthology.orchestra.run.smithi115.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T02:01:07.511 INFO:teuthology.orchestra.run.smithi136.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-09-12T02:01:07.536 INFO:teuthology.orchestra.run.smithi136.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-12T02:01:07.620 INFO:teuthology.orchestra.run.smithi136.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 167 kB/s | 18 kB 00:00 2024-09-12T02:01:07.637 INFO:teuthology.orchestra.run.smithi136.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-12T02:01:07.640 INFO:teuthology.orchestra.run.smithi115.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 14 MB/s | 3.4 MB 00:00 2024-09-12T02:01:07.707 INFO:teuthology.orchestra.run.smithi115.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 9.9 MB/s | 2.3 MB 00:00 2024-09-12T02:01:07.738 INFO:teuthology.orchestra.run.smithi136.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-12T02:01:07.749 INFO:teuthology.orchestra.run.smithi115.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 986 kB/s | 41 kB 00:00 2024-09-12T02:01:07.754 INFO:teuthology.orchestra.run.smithi136.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 387 kB/s | 45 kB 00:00 2024-09-12T02:01:07.799 INFO:teuthology.orchestra.run.smithi115.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-12T02:01:07.841 INFO:teuthology.orchestra.run.smithi115.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 9.0 MB/s | 1.8 MB 00:00 2024-09-12T02:01:07.846 INFO:teuthology.orchestra.run.smithi136.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.1 MB/s | 3.0 MB 00:00 2024-09-12T02:01:07.880 INFO:teuthology.orchestra.run.smithi136.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-12T02:01:07.891 INFO:teuthology.orchestra.run.smithi115.stdout:(154/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 6.6 MB/s | 3.2 MB 00:00 2024-09-12T02:01:07.925 INFO:teuthology.orchestra.run.smithi115.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-12T02:01:07.955 INFO:teuthology.orchestra.run.smithi136.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-12T02:01:07.979 INFO:teuthology.orchestra.run.smithi115.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-09-12T02:01:07.985 INFO:teuthology.orchestra.run.smithi115.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:01:07.985 INFO:teuthology.orchestra.run.smithi115.stdout:Total 26 MB/s | 226 MB 00:08 2024-09-12T02:01:07.989 INFO:teuthology.orchestra.run.smithi136.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-12T02:01:08.031 INFO:teuthology.orchestra.run.smithi136.stdout:(63/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-12T02:01:08.073 INFO:teuthology.orchestra.run.smithi136.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-12T02:01:08.107 INFO:teuthology.orchestra.run.smithi136.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T02:01:08.140 INFO:teuthology.orchestra.run.smithi136.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-12T02:01:08.274 INFO:teuthology.orchestra.run.smithi110.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 48 kB/s | 6.5 kB 00:00 2024-09-12T02:01:08.458 INFO:teuthology.orchestra.run.smithi110.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.8 MB/s | 897 kB 00:00 2024-09-12T02:01:08.458 INFO:teuthology.orchestra.run.smithi136.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-12T02:01:08.499 INFO:teuthology.orchestra.run.smithi136.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 4.4 MB/s | 1.6 MB 00:00 2024-09-12T02:01:08.583 INFO:teuthology.orchestra.run.smithi136.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-12T02:01:08.590 INFO:teuthology.orchestra.run.smithi110.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.1 MB/s | 145 kB 00:00 2024-09-12T02:01:08.616 INFO:teuthology.orchestra.run.smithi136.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-12T02:01:08.683 INFO:teuthology.orchestra.run.smithi110.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 9.9 MB/s | 5.4 MB 00:00 2024-09-12T02:01:08.750 INFO:teuthology.orchestra.run.smithi136.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-09-12T02:01:08.775 INFO:teuthology.orchestra.run.smithi110.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 1.5 MB 00:00 2024-09-12T02:01:08.833 INFO:teuthology.orchestra.run.smithi110.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 9.8 MB/s | 2.4 MB 00:00 2024-09-12T02:01:08.875 INFO:teuthology.orchestra.run.smithi136.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-12T02:01:08.901 INFO:teuthology.orchestra.run.smithi136.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 582 kB/s | 87 kB 00:00 2024-09-12T02:01:09.017 INFO:teuthology.orchestra.run.smithi110.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 19 MB/s | 4.7 MB 00:00 2024-09-12T02:01:09.059 INFO:teuthology.orchestra.run.smithi136.stdout:(74/156): openblas-openmp-0.3.26-2.el9.x86_64.r 5.0 MB/s | 4.9 MB 00:00 2024-09-12T02:01:09.084 INFO:teuthology.orchestra.run.smithi136.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 333 kB/s | 61 kB 00:00 2024-09-12T02:01:09.185 INFO:teuthology.orchestra.run.smithi136.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-12T02:01:09.187 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction check 2024-09-12T02:01:09.210 INFO:teuthology.orchestra.run.smithi136.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-12T02:01:09.294 INFO:teuthology.orchestra.run.smithi136.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-12T02:01:09.333 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction check succeeded. 2024-09-12T02:01:09.333 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction test 2024-09-12T02:01:09.386 INFO:teuthology.orchestra.run.smithi136.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-12T02:01:09.411 INFO:teuthology.orchestra.run.smithi136.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 95 kB/s | 19 kB 00:00 2024-09-12T02:01:09.436 INFO:teuthology.orchestra.run.smithi136.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-12T02:01:09.492 INFO:teuthology.orchestra.run.smithi110.stdout:(8/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 22 MB/s | 11 MB 00:00 2024-09-12T02:01:09.495 INFO:teuthology.orchestra.run.smithi136.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 318 kB/s | 35 kB 00:00 2024-09-12T02:01:09.553 INFO:teuthology.orchestra.run.smithi136.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-12T02:01:09.612 INFO:teuthology.orchestra.run.smithi136.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-12T02:01:09.688 INFO:teuthology.orchestra.run.smithi136.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-12T02:01:09.713 INFO:teuthology.orchestra.run.smithi136.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 485 kB/s | 77 kB 00:00 2024-09-12T02:01:09.730 INFO:teuthology.orchestra.run.smithi136.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 360 kB/s | 42 kB 00:00 2024-09-12T02:01:09.759 INFO:teuthology.orchestra.run.smithi110.stdout:(9/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 21 MB 00:01 2024-09-12T02:01:09.785 INFO:teuthology.orchestra.run.smithi110.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 86 kB/s | 25 kB 00:00 2024-09-12T02:01:09.805 INFO:teuthology.orchestra.run.smithi136.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.2 MB/s | 269 kB 00:00 2024-09-12T02:01:09.835 INFO:teuthology.orchestra.run.smithi110.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-12T02:01:09.838 INFO:teuthology.orchestra.run.smithi136.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-12T02:01:09.864 INFO:teuthology.orchestra.run.smithi136.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-12T02:01:09.893 INFO:teuthology.orchestra.run.smithi110.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 464 kB/s | 27 kB 00:00 2024-09-12T02:01:09.906 INFO:teuthology.orchestra.run.smithi136.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 508 kB/s | 51 kB 00:00 2024-09-12T02:01:09.940 INFO:teuthology.orchestra.run.smithi136.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 532 kB/s | 54 kB 00:00 2024-09-12T02:01:10.007 INFO:teuthology.orchestra.run.smithi136.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-12T02:01:10.040 INFO:teuthology.orchestra.run.smithi136.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 441 kB/s | 44 kB 00:00 2024-09-12T02:01:10.094 INFO:teuthology.orchestra.run.smithi110.stdout:(13/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 13 MB/s | 17 MB 00:01 2024-09-12T02:01:10.119 INFO:teuthology.orchestra.run.smithi110.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 141 kB/s | 32 kB 00:00 2024-09-12T02:01:10.124 INFO:teuthology.orchestra.run.smithi136.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-12T02:01:10.149 INFO:teuthology.orchestra.run.smithi136.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-12T02:01:10.169 INFO:teuthology.orchestra.run.smithi110.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 9.8 MB/s | 752 kB 00:00 2024-09-12T02:01:10.195 INFO:teuthology.orchestra.run.smithi110.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.1 MB/s | 163 kB 00:00 2024-09-12T02:01:10.220 INFO:teuthology.orchestra.run.smithi110.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T02:01:10.233 INFO:teuthology.orchestra.run.smithi136.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-12T02:01:10.254 INFO:teuthology.orchestra.run.smithi110.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 8.4 MB/s | 506 kB 00:00 2024-09-12T02:01:10.266 INFO:teuthology.orchestra.run.smithi136.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-12T02:01:10.312 INFO:teuthology.orchestra.run.smithi110.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 779 kB/s | 45 kB 00:00 2024-09-12T02:01:10.342 INFO:teuthology.orchestra.run.smithi136.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 532 kB/s | 58 kB 00:00 2024-09-12T02:01:10.371 INFO:teuthology.orchestra.run.smithi110.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 2.3 MB/s | 136 kB 00:00 2024-09-12T02:01:10.383 INFO:teuthology.orchestra.run.smithi136.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 820 kB/s | 96 kB 00:00 2024-09-12T02:01:10.451 INFO:teuthology.orchestra.run.smithi136.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 586 kB/s | 64 kB 00:00 2024-09-12T02:01:10.492 INFO:teuthology.orchestra.run.smithi136.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-09-12T02:01:10.496 INFO:teuthology.orchestra.run.smithi110.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-12T02:01:10.522 INFO:teuthology.orchestra.run.smithi110.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.1 MB/s | 162 kB 00:00 2024-09-12T02:01:10.555 INFO:teuthology.orchestra.run.smithi110.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-12T02:01:10.581 INFO:teuthology.orchestra.run.smithi110.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-12T02:01:10.606 INFO:teuthology.orchestra.run.smithi110.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T02:01:10.631 INFO:teuthology.orchestra.run.smithi110.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T02:01:10.660 INFO:teuthology.orchestra.run.smithi136.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-12T02:01:10.685 INFO:teuthology.orchestra.run.smithi136.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 95 kB/s | 22 kB 00:00 2024-09-12T02:01:10.690 INFO:teuthology.orchestra.run.smithi110.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-12T02:01:10.735 INFO:teuthology.orchestra.run.smithi136.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-12T02:01:10.760 INFO:teuthology.orchestra.run.smithi136.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-12T02:01:10.773 INFO:teuthology.orchestra.run.smithi110.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-12T02:01:10.799 INFO:teuthology.orchestra.run.smithi110.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 293 kB/s | 32 kB 00:00 2024-09-12T02:01:10.802 INFO:teuthology.orchestra.run.smithi136.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-09-12T02:01:10.827 INFO:teuthology.orchestra.run.smithi136.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T02:01:10.849 INFO:teuthology.orchestra.run.smithi110.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.9 MB/s | 146 kB 00:00 2024-09-12T02:01:10.853 INFO:teuthology.orchestra.run.smithi136.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T02:01:10.887 INFO:teuthology.orchestra.run.smithi136.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-12T02:01:10.929 INFO:teuthology.orchestra.run.smithi136.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 894 kB/s | 67 kB 00:00 2024-09-12T02:01:10.962 INFO:teuthology.orchestra.run.smithi136.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-12T02:01:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 19 MB/s | 3.6 MB 00:00 2024-09-12T02:01:11.004 INFO:teuthology.orchestra.run.smithi136.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-12T02:01:11.029 INFO:teuthology.orchestra.run.smithi136.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T02:01:11.050 INFO:teuthology.orchestra.run.smithi110.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.2 MB/s | 249 kB 00:00 2024-09-12T02:01:11.055 INFO:teuthology.orchestra.run.smithi136.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T02:01:11.080 INFO:teuthology.orchestra.run.smithi136.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-12T02:01:11.105 INFO:teuthology.orchestra.run.smithi136.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-12T02:01:11.108 INFO:teuthology.orchestra.run.smithi110.stdout:(33/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 852 kB/s | 49 kB 00:00 2024-09-12T02:01:11.131 INFO:teuthology.orchestra.run.smithi136.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T02:01:11.135 INFO:teuthology.orchestra.run.smithi115.stdout:Transaction test succeeded. 2024-09-12T02:01:11.135 INFO:teuthology.orchestra.run.smithi115.stdout:Running transaction 2024-09-12T02:01:11.159 INFO:teuthology.orchestra.run.smithi110.stdout:(34/156): ceph-prometheus-alerts-19.1.1-298.gb5 328 kB/s | 16 kB 00:00 2024-09-12T02:01:11.164 INFO:teuthology.orchestra.run.smithi136.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T02:01:11.198 INFO:teuthology.orchestra.run.smithi136.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-12T02:01:11.223 INFO:teuthology.orchestra.run.smithi136.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T02:01:11.249 INFO:teuthology.orchestra.run.smithi136.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T02:01:11.251 INFO:teuthology.orchestra.run.smithi110.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-12T02:01:11.274 INFO:teuthology.orchestra.run.smithi136.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-12T02:01:11.276 INFO:teuthology.orchestra.run.smithi110.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 2.4 MB/s | 285 kB 00:00 2024-09-12T02:01:11.291 INFO:teuthology.orchestra.run.smithi136.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-12T02:01:11.316 INFO:teuthology.orchestra.run.smithi136.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 931 kB/s | 23 kB 00:00 2024-09-12T02:01:11.318 INFO:teuthology.orchestra.run.smithi110.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 11 MB/s | 765 kB 00:00 2024-09-12T02:01:11.342 INFO:teuthology.orchestra.run.smithi136.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-12T02:01:11.344 INFO:teuthology.orchestra.run.smithi110.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 273 kB/s | 18 kB 00:00 2024-09-12T02:01:11.400 INFO:teuthology.orchestra.run.smithi136.stdout:(127/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-09-12T02:01:11.425 INFO:teuthology.orchestra.run.smithi136.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2024-09-12T02:01:11.451 INFO:teuthology.orchestra.run.smithi136.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T02:01:11.476 INFO:teuthology.orchestra.run.smithi136.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T02:01:11.502 INFO:teuthology.orchestra.run.smithi136.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:01:11.519 INFO:teuthology.orchestra.run.smithi110.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 399 kB/s | 80 kB 00:00 2024-09-12T02:01:11.560 INFO:teuthology.orchestra.run.smithi136.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-12T02:01:11.585 INFO:teuthology.orchestra.run.smithi136.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-12T02:01:11.611 INFO:teuthology.orchestra.run.smithi136.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-12T02:01:11.644 INFO:teuthology.orchestra.run.smithi110.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-12T02:01:11.644 INFO:teuthology.orchestra.run.smithi136.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-12T02:01:11.669 INFO:teuthology.orchestra.run.smithi110.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-12T02:01:11.670 INFO:teuthology.orchestra.run.smithi136.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 479 kB/s | 28 kB 00:00 2024-09-12T02:01:11.704 INFO:teuthology.orchestra.run.smithi136.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 764 kB/s | 90 kB 00:00 2024-09-12T02:01:11.728 INFO:teuthology.orchestra.run.smithi110.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-12T02:01:11.729 INFO:teuthology.orchestra.run.smithi136.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 365 kB/s | 31 kB 00:00 2024-09-12T02:01:11.754 INFO:teuthology.orchestra.run.smithi136.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T02:01:11.779 INFO:teuthology.orchestra.run.smithi110.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-12T02:01:11.779 INFO:teuthology.orchestra.run.smithi136.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T02:01:11.837 INFO:teuthology.orchestra.run.smithi110.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-12T02:01:11.846 INFO:teuthology.orchestra.run.smithi136.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-12T02:01:11.872 INFO:teuthology.orchestra.run.smithi136.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 636 kB/s | 74 kB 00:00 2024-09-12T02:01:11.896 INFO:teuthology.orchestra.run.smithi110.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-12T02:01:11.897 INFO:teuthology.orchestra.run.smithi136.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T02:01:11.922 INFO:teuthology.orchestra.run.smithi136.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-12T02:01:11.947 INFO:teuthology.orchestra.run.smithi136.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T02:01:11.954 INFO:teuthology.orchestra.run.smithi110.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-12T02:01:11.973 INFO:teuthology.orchestra.run.smithi136.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T02:01:11.988 INFO:teuthology.orchestra.run.smithi110.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-09-12T02:01:11.998 INFO:teuthology.orchestra.run.smithi136.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T02:01:12.048 INFO:teuthology.orchestra.run.smithi136.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T02:01:12.182 INFO:teuthology.orchestra.run.smithi136.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 18 MB/s | 2.3 MB 00:00 2024-09-12T02:01:12.189 INFO:teuthology.orchestra.run.smithi110.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-12T02:01:12.222 INFO:teuthology.orchestra.run.smithi110.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 4.0 MB/s | 943 kB 00:00 2024-09-12T02:01:12.247 INFO:teuthology.orchestra.run.smithi110.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-12T02:01:12.257 INFO:teuthology.orchestra.run.smithi136.stdout:(150/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T02:01:12.297 INFO:teuthology.orchestra.run.smithi110.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 290 kB/s | 22 kB 00:00 2024-09-12T02:01:12.299 INFO:teuthology.orchestra.run.smithi136.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 15 MB/s | 1.8 MB 00:00 2024-09-12T02:01:12.331 INFO:teuthology.orchestra.run.smithi110.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-12T02:01:12.333 INFO:teuthology.orchestra.run.smithi136.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 542 kB/s | 41 kB 00:00 2024-09-12T02:01:12.357 INFO:teuthology.orchestra.run.smithi110.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 553 kB/s | 33 kB 00:00 2024-09-12T02:01:12.391 INFO:teuthology.orchestra.run.smithi136.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.6 MB/s | 249 kB 00:00 2024-09-12T02:01:12.399 INFO:teuthology.orchestra.run.smithi110.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 435 kB/s | 18 kB 00:00 2024-09-12T02:01:12.441 INFO:teuthology.orchestra.run.smithi110.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 270 kB/s | 11 kB 00:00 2024-09-12T02:01:12.458 INFO:teuthology.orchestra.run.smithi136.stdout:(154/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 6.9 MB/s | 3.2 MB 00:00 2024-09-12T02:01:12.491 INFO:teuthology.orchestra.run.smithi110.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-09-12T02:01:12.500 INFO:teuthology.orchestra.run.smithi136.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-12T02:01:12.516 INFO:teuthology.orchestra.run.smithi110.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T02:01:12.542 INFO:teuthology.orchestra.run.smithi110.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 897 kB/s | 45 kB 00:00 2024-09-12T02:01:12.550 INFO:teuthology.orchestra.run.smithi136.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 15 MB/s | 2.4 MB 00:00 2024-09-12T02:01:12.556 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:01:12.557 INFO:teuthology.orchestra.run.smithi136.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-12T02:01:12.575 INFO:teuthology.orchestra.run.smithi110.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-12T02:01:12.617 INFO:teuthology.orchestra.run.smithi110.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-12T02:01:12.666 INFO:teuthology.orchestra.run.smithi110.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 270 kB/s | 24 kB 00:00 2024-09-12T02:01:12.693 INFO:teuthology.orchestra.run.smithi110.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 632 kB/s | 47 kB 00:00 2024-09-12T02:01:12.727 INFO:teuthology.orchestra.run.smithi110.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 292 kB 00:00 2024-09-12T02:01:12.752 INFO:teuthology.orchestra.run.smithi110.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-12T02:01:12.777 INFO:teuthology.orchestra.run.smithi110.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-12T02:01:12.880 INFO:teuthology.orchestra.run.smithi110.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 39 MB/s | 4.9 MB 00:00 2024-09-12T02:01:12.986 INFO:teuthology.orchestra.run.smithi110.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-12T02:01:13.070 INFO:teuthology.orchestra.run.smithi110.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-09-12T02:01:13.112 INFO:teuthology.orchestra.run.smithi110.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-12T02:01:13.137 INFO:teuthology.orchestra.run.smithi110.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T02:01:13.196 INFO:teuthology.orchestra.run.smithi110.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-12T02:01:13.663 INFO:teuthology.orchestra.run.smithi110.stdout:(72/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 12 MB/s | 49 MB 00:03 2024-09-12T02:01:13.688 INFO:teuthology.orchestra.run.smithi110.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 178 kB/s | 87 kB 00:00 2024-09-12T02:01:13.772 INFO:teuthology.orchestra.run.smithi110.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 8.8 MB/s | 5.8 MB 00:00 2024-09-12T02:01:13.797 INFO:teuthology.orchestra.run.smithi110.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 564 kB/s | 61 kB 00:00 2024-09-12T02:01:13.811 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-09-12T02:01:13.831 INFO:teuthology.orchestra.run.smithi110.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-12T02:01:13.856 INFO:teuthology.orchestra.run.smithi110.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-12T02:01:13.882 INFO:teuthology.orchestra.run.smithi110.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-12T02:01:13.907 INFO:teuthology.orchestra.run.smithi110.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-12T02:01:13.936 INFO:teuthology.orchestra.run.smithi110.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.1 MB/s | 172 kB 00:00 2024-09-12T02:01:13.961 INFO:teuthology.orchestra.run.smithi110.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 646 kB/s | 35 kB 00:00 2024-09-12T02:01:13.963 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-09-12T02:01:13.963 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-09-12T02:01:14.037 INFO:teuthology.orchestra.run.smithi110.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-12T02:01:14.112 INFO:teuthology.orchestra.run.smithi110.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-09-12T02:01:14.137 INFO:teuthology.orchestra.run.smithi110.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-12T02:01:14.163 INFO:teuthology.orchestra.run.smithi110.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T02:01:14.179 INFO:teuthology.orchestra.run.smithi110.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-12T02:01:14.222 INFO:teuthology.orchestra.run.smithi110.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-12T02:01:14.247 INFO:teuthology.orchestra.run.smithi110.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-12T02:01:14.281 INFO:teuthology.orchestra.run.smithi110.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-12T02:01:14.306 INFO:teuthology.orchestra.run.smithi110.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 870 kB/s | 51 kB 00:00 2024-09-12T02:01:14.331 INFO:teuthology.orchestra.run.smithi110.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T02:01:14.449 INFO:teuthology.orchestra.run.smithi110.stdout:(92/156): python3-babel-2.9.1-2.el9.noarch.rpm 7.6 MB/s | 6.0 MB 00:00 2024-09-12T02:01:14.474 INFO:teuthology.orchestra.run.smithi110.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 294 kB/s | 42 kB 00:00 2024-09-12T02:01:14.499 INFO:teuthology.orchestra.run.smithi110.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 887 kB/s | 44 kB 00:00 2024-09-12T02:01:14.524 INFO:teuthology.orchestra.run.smithi110.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T02:01:14.549 INFO:teuthology.orchestra.run.smithi110.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-12T02:01:14.575 INFO:teuthology.orchestra.run.smithi110.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-12T02:01:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T02:01:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-09-12T02:01:14.659 INFO:teuthology.orchestra.run.smithi110.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T02:01:14.684 INFO:teuthology.orchestra.run.smithi110.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T02:01:14.709 INFO:teuthology.orchestra.run.smithi110.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-12T02:01:14.768 INFO:teuthology.orchestra.run.smithi110.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 266 kB/s | 22 kB 00:00 2024-09-12T02:01:14.835 INFO:teuthology.orchestra.run.smithi110.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-12T02:01:14.877 INFO:teuthology.orchestra.run.smithi110.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-09-12T02:01:14.902 INFO:teuthology.orchestra.run.smithi110.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-12T02:01:15.119 INFO:teuthology.orchestra.run.smithi110.stdout:(107/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-12T02:01:15.170 INFO:teuthology.orchestra.run.smithi110.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-12T02:01:15.204 INFO:teuthology.orchestra.run.smithi110.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 308 kB/s | 26 kB 00:00 2024-09-12T02:01:15.237 INFO:teuthology.orchestra.run.smithi110.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-09-12T02:01:15.263 INFO:teuthology.orchestra.run.smithi110.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 537 kB/s | 49 kB 00:00 2024-09-12T02:01:15.288 INFO:teuthology.orchestra.run.smithi110.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-12T02:01:15.330 INFO:teuthology.orchestra.run.smithi110.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-12T02:01:15.364 INFO:teuthology.orchestra.run.smithi110.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-12T02:01:15.389 INFO:teuthology.orchestra.run.smithi110.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-12T02:01:15.414 INFO:teuthology.orchestra.run.smithi110.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-12T02:01:15.439 INFO:teuthology.orchestra.run.smithi110.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-12T02:01:15.490 INFO:teuthology.orchestra.run.smithi110.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-12T02:01:15.524 INFO:teuthology.orchestra.run.smithi110.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-12T02:01:15.549 INFO:teuthology.orchestra.run.smithi110.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T02:01:15.582 INFO:teuthology.orchestra.run.smithi110.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T02:01:15.649 INFO:teuthology.orchestra.run.smithi110.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-09-12T02:01:15.675 INFO:teuthology.orchestra.run.smithi110.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-12T02:01:15.700 INFO:teuthology.orchestra.run.smithi110.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-12T02:01:15.734 INFO:teuthology.orchestra.run.smithi110.stdout:(125/156): python3-grpcio-tools-1.46.7-10.el9.x 957 kB/s | 144 kB 00:00 2024-09-12T02:01:15.759 INFO:teuthology.orchestra.run.smithi110.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 394 kB/s | 23 kB 00:00 2024-09-12T02:01:15.771 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-09-12T02:01:15.771 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-09-12T02:01:15.784 INFO:teuthology.orchestra.run.smithi110.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-12T02:01:15.809 INFO:teuthology.orchestra.run.smithi110.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 394 kB/s | 20 kB 00:00 2024-09-12T02:01:15.866 INFO:teuthology.orchestra.run.smithi110.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 824 kB/s | 46 kB 00:00 2024-09-12T02:01:15.902 INFO:teuthology.orchestra.run.smithi110.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.2 MB/s | 79 kB 00:00 2024-09-12T02:01:15.927 INFO:teuthology.orchestra.run.smithi110.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T02:01:15.961 INFO:teuthology.orchestra.run.smithi110.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T02:01:15.986 INFO:teuthology.orchestra.run.smithi110.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-12T02:01:16.020 INFO:teuthology.orchestra.run.smithi110.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.7 MB/s | 90 kB 00:00 2024-09-12T02:01:16.054 INFO:teuthology.orchestra.run.smithi110.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2024-09-12T02:01:16.079 INFO:teuthology.orchestra.run.smithi110.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-12T02:01:16.104 INFO:teuthology.orchestra.run.smithi110.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 616 kB/s | 31 kB 00:00 2024-09-12T02:01:16.129 INFO:teuthology.orchestra.run.smithi110.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T02:01:16.155 INFO:teuthology.orchestra.run.smithi110.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T02:01:16.180 INFO:teuthology.orchestra.run.smithi110.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-12T02:01:16.205 INFO:teuthology.orchestra.run.smithi110.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T02:01:16.256 INFO:teuthology.orchestra.run.smithi110.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T02:01:16.282 INFO:teuthology.orchestra.run.smithi110.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T02:01:16.323 INFO:teuthology.orchestra.run.smithi110.stdout:(144/156): python3-grpcio-1.46.7-10.el9.x86_64. 2.6 MB/s | 2.0 MB 00:00 2024-09-12T02:01:16.349 INFO:teuthology.orchestra.run.smithi110.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-09-12T02:01:16.374 INFO:teuthology.orchestra.run.smithi110.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T02:01:16.399 INFO:teuthology.orchestra.run.smithi110.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-12T02:01:16.458 INFO:teuthology.orchestra.run.smithi110.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T02:01:16.650 INFO:teuthology.orchestra.run.smithi110.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-12T02:01:16.717 INFO:teuthology.orchestra.run.smithi110.stdout:(150/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.9 MB/s | 3.2 MB 00:00 2024-09-12T02:01:16.834 INFO:teuthology.orchestra.run.smithi110.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 349 kB/s | 41 kB 00:00 2024-09-12T02:01:17.017 INFO:teuthology.orchestra.run.smithi110.stdout:(152/156): NetworkManager-libnm-1.49.90-1.el9.x 4.9 MB/s | 1.8 MB 00:00 2024-09-12T02:01:17.043 INFO:teuthology.orchestra.run.smithi110.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 1.2 MB/s | 249 kB 00:00 2024-09-12T02:01:17.210 INFO:teuthology.orchestra.run.smithi110.stdout:(154/156): NetworkManager-1.49.90-1.el9.x86_64. 3.1 MB/s | 2.3 MB 00:00 2024-09-12T02:01:17.465 INFO:teuthology.orchestra.run.smithi115.stdout: Preparing : 1/1 2024-09-12T02:01:17.518 INFO:teuthology.orchestra.run.smithi110.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 5.0 MB/s | 2.4 MB 00:00 2024-09-12T02:01:17.553 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:01:17.592 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:01:17.645 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:01:17.679 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:01:17.705 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:01:17.747 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:01:17.777 INFO:teuthology.orchestra.run.smithi110.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 1.4 MB 00:00 2024-09-12T02:01:17.784 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:01:17.785 INFO:teuthology.orchestra.run.smithi110.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-12T02:01:18.072 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:01:18.172 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:01:18.293 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:01:18.332 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:01:18.407 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:01:18.436 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:01:18.588 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:01:18.641 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:01:18.669 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:01:18.773 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:01:18.795 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:01:18.857 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:01:18.879 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:01:18.903 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:01:19.072 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:01:19.199 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:01:19.327 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:01:19.435 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:01:19.495 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:01:19.716 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:01:19.825 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:01:19.848 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-09-12T02:01:19.921 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:01:19.967 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:01:20.002 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:01:20.027 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-09-12T02:01:20.027 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-09-12T02:01:20.067 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:01:20.111 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:01:20.151 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:01:20.194 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:01:20.227 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:01:20.255 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:01:20.324 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:01:20.377 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:01:20.408 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:01:20.443 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:01:20.520 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:01:20.554 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:01:20.597 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:01:20.626 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:01:20.698 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:01:20.741 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:01:20.816 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:01:20.952 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:01:21.005 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:01:21.535 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:01:21.626 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:01:21.655 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:01:21.700 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:01:21.735 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:01:21.777 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:01:21.949 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:01:22.013 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:01:22.068 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:01:22.141 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:01:22.173 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:01:22.208 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:01:22.255 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:01:22.282 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-09-12T02:01:22.291 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:01:22.334 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:01:22.377 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:01:22.404 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:01:22.442 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:01:22.449 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-09-12T02:01:22.451 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-09-12T02:01:22.496 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:01:22.511 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:01:22.530 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:01:22.555 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:01:22.570 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:01:22.598 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:01:22.871 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:01:22.979 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:01:23.018 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:01:23.031 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:01:23.053 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:01:23.093 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:01:23.121 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:01:23.145 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:01:23.153 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:01:23.182 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:01:23.221 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:01:23.274 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:01:23.304 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:01:23.346 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:01:23.394 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:01:23.422 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:01:23.456 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:01:23.460 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:01:23.504 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:01:23.517 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:01:23.536 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:01:23.545 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:01:23.565 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:01:23.608 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:01:23.632 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:01:23.641 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:01:23.655 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:01:23.683 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:01:23.709 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:01:23.718 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:01:23.731 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:01:23.750 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:01:23.805 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:01:23.848 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:01:23.880 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:01:23.941 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:01:23.983 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:01:24.038 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:01:24.075 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:01:24.221 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:01:24.313 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:01:24.418 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:01:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:01:24.757 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:01:24.771 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:01:24.819 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:01:24.853 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:01:24.860 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:01:24.890 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:01:24.924 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:01:24.954 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:01:24.988 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:01:25.007 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:01:25.033 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:01:25.052 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:01:25.065 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:01:25.109 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:01:25.141 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:01:25.150 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:01:25.181 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:01:25.189 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:01:25.254 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:01:25.309 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:01:25.339 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:01:25.365 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:01:25.395 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:01:25.400 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:01:25.472 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:01:25.476 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:01:25.511 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:01:25.554 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:01:25.583 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:01:25.651 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:01:25.706 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:01:25.780 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:01:25.920 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:01:25.975 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:01:26.111 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:01:26.234 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:01:26.493 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:01:26.585 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:01:26.615 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:01:26.649 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:01:26.687 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:01:26.729 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:01:26.894 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:01:26.957 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:01:27.012 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:01:27.084 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:01:27.117 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:01:27.153 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:01:27.199 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:01:27.235 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:01:27.278 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:01:27.320 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:01:27.454 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:01:27.460 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:01:27.506 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:01:27.547 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:01:27.549 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:01:27.569 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:01:27.593 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:01:27.648 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:01:27.681 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:01:27.721 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:01:27.747 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:01:27.771 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:01:27.845 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:01:27.903 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:01:27.940 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:01:28.021 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:01:28.070 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:01:28.105 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:01:28.190 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:01:28.229 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:01:28.257 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:01:28.291 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:01:28.330 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:01:28.362 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:01:28.392 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:01:28.427 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:01:28.469 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:01:28.518 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:01:28.561 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:01:28.584 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:01:28.620 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:01:28.646 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:01:28.682 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:01:28.691 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:01:28.705 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:01:28.723 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:01:28.824 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:01:28.882 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:01:29.377 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-09-12T02:01:29.560 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T02:01:29.590 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:01:29.639 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:01:29.673 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:01:29.771 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:01:29.820 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T02:01:29.827 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:01:29.881 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:01:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T02:01:29.984 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:01:30.017 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:01:30.026 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T02:01:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T02:01:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T02:01:30.201 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:01:30.232 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:01:30.309 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:01:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T02:01:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:01:30.772 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:01:30.802 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:01:30.915 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:01:30.949 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:01:30.949 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:01:30.984 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:01:31.017 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:01:31.061 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:01:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T02:01:31.237 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T02:01:31.265 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:01:31.365 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:01:31.399 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:01:31.473 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T02:01:31.501 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:01:31.539 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T02:01:31.561 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:01:31.596 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:01:31.692 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:01:31.693 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:01:31.693 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:01:31.693 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:01:31.722 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:01:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:01:31.937 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T02:01:32.158 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T02:01:32.265 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:01:32.288 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:01:32.345 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:01:32.373 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:01:32.407 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:01:32.434 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:01:32.717 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:01:32.735 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T02:01:32.761 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:01:32.851 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:01:32.882 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T02:01:32.882 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:01:32.919 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:01:33.000 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T02:01:33.040 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T02:01:33.085 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T02:01:33.175 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T02:01:33.255 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T02:01:33.312 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T02:01:33.365 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T02:01:33.397 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:01:33.404 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T02:01:33.423 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:01:33.437 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T02:01:33.494 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:01:33.525 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T02:01:33.589 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T02:01:33.599 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:01:33.654 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T02:01:33.712 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T02:01:33.792 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T02:01:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T02:01:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T02:01:33.900 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T02:01:33.991 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T02:01:34.062 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T02:01:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T02:01:34.316 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T02:01:34.377 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T02:01:35.005 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T02:01:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T02:01:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T02:01:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T02:01:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T02:01:35.522 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T02:01:35.724 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T02:01:35.841 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T02:01:35.880 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:01:35.923 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:01:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T02:01:36.010 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T02:01:36.050 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T02:01:36.086 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T02:01:36.145 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T02:01:36.185 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T02:01:36.262 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T02:01:36.315 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T02:01:36.469 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:01:36.494 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T02:01:36.510 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:01:36.540 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T02:01:36.583 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T02:01:36.603 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:01:36.603 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:01:36.603 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:01:36.604 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:36.636 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:01:36.725 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T02:01:36.771 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T02:01:36.821 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T02:01:36.868 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T02:01:36.892 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T02:01:37.022 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T02:01:37.201 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T02:01:37.251 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T02:01:37.288 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T02:01:37.359 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T02:01:37.405 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T02:01:37.444 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T02:01:37.481 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T02:01:37.515 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T02:01:37.557 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T02:01:37.609 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T02:01:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T02:01:37.749 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T02:01:37.809 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T02:01:37.845 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T02:01:37.965 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T02:01:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T02:01:38.938 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T02:01:39.002 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T02:01:39.036 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T02:01:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T02:01:39.236 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T02:01:39.288 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T02:01:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T02:01:39.421 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T02:01:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T02:01:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T02:01:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T02:01:40.604 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T02:01:40.766 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T02:01:42.315 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T02:01:42.408 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T02:01:42.445 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T02:01:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T02:01:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T02:01:42.908 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:01:43.026 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T02:01:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T02:01:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T02:01:43.383 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:01:43.383 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /sys 2024-09-12T02:01:43.383 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /proc 2024-09-12T02:01:43.383 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /mnt 2024-09-12T02:01:43.383 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /var/tmp 2024-09-12T02:01:43.383 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /home 2024-09-12T02:01:43.383 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /root 2024-09-12T02:01:43.383 INFO:teuthology.orchestra.run.smithi115.stdout:skipping the directory /tmp 2024-09-12T02:01:43.383 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:01:43.552 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:01:43.568 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:01:43.568 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:43.568 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:01:43.568 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:01:43.624 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T02:01:43.667 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:01:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T02:01:43.786 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T02:01:45.013 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:01:45.039 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:01:45.039 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:45.039 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:01:45.039 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:01:45.039 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:01:45.040 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:01:45.263 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:01:45.286 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:01:45.286 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:45.287 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:01:45.287 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:01:45.287 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:01:45.287 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:01:45.722 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:01:45.745 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:01:45.745 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:45.745 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:01:45.746 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:01:45.746 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:01:45.746 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:01:45.852 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:01:45.900 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:01:45.955 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:01:46.147 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:01:46.189 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:01:46.258 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:01:46.346 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:01:46.485 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:01:46.531 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:01:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:01:46.562 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:01:46.591 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:01:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:01:47.061 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:01:47.090 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:01:47.113 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:01:47.175 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:01:47.204 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:01:47.243 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T02:01:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:01:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T02:01:47.457 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T02:01:47.457 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T02:01:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:01:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:01:48.253 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:01:48.289 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:01:48.447 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:01:48.447 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2024-09-12T02:01:48.447 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2024-09-12T02:01:48.447 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2024-09-12T02:01:48.447 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2024-09-12T02:01:48.447 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2024-09-12T02:01:48.447 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /root 2024-09-12T02:01:48.447 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2024-09-12T02:01:48.447 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:48.624 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:01:48.640 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:01:48.640 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:48.641 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:01:48.641 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:49.256 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:01:49.281 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:01:49.384 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:01:49.552 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:01:49.575 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:01:49.599 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:01:49.600 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:49.600 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:01:49.600 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:01:49.600 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:01:49.600 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:01:49.651 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:01:49.662 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:01:49.760 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:01:49.816 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:01:50.135 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:01:50.162 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:01:50.163 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:50.163 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:01:50.163 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:01:50.163 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:01:50.163 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:50.411 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:01:50.435 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:01:50.435 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:50.435 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:01:50.435 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:01:50.435 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:01:50.435 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:50.744 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:01:50.770 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:01:50.796 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:01:50.796 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:50.796 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:01:50.797 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:01:50.797 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:01:50.797 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:01:50.837 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:01:50.860 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:01:50.860 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:50.860 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:01:50.860 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:01:50.870 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:01:50.894 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:01:50.894 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:50.894 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:01:50.894 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:01:50.894 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:01:50.894 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:50.913 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:01:50.937 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:01:50.937 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:50.937 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:01:50.937 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:01:50.937 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:01:50.937 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:01:51.000 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:01:51.049 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:01:51.103 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:01:51.238 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:01:51.262 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:01:51.262 INFO:teuthology.orchestra.run.smithi115.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:51.262 INFO:teuthology.orchestra.run.smithi115.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:01:51.262 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:01:51.262 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:01:51.263 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:01:51.297 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:01:51.346 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:01:51.432 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:01:51.521 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:01:51.659 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:01:51.705 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:01:51.737 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:01:51.765 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:01:52.166 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:01:52.197 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:01:52.229 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:01:52.291 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:01:52.320 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:01:53.365 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:01:53.405 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:01:54.369 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:01:54.398 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:01:54.500 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:01:54.659 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:01:54.696 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:01:54.719 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:01:54.719 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:54.719 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:01:54.719 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:01:54.719 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:01:54.719 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:54.767 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:01:54.780 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:01:54.876 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:01:54.924 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:01:55.844 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:01:55.878 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:01:55.902 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:01:55.902 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:55.902 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:01:55.902 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:01:55.902 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:01:55.903 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:55.917 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:01:55.954 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:01:55.958 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:01:55.978 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:01:55.978 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:55.978 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:01:55.978 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:55.999 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:01:56.030 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:01:56.031 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:01:56.054 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:01:56.054 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:56.054 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:01:56.054 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:01:56.054 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:01:56.054 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:56.067 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:01:56.254 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:01:56.297 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:01:56.327 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:01:56.355 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:01:56.357 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:01:56.379 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:01:56.380 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:01:56.380 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:01:56.380 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:01:56.380 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:01:56.380 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:01:56.419 INFO:teuthology.orchestra.run.smithi115.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:01:57.044 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:01:57.084 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:01:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:01:57.943 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:01:58.039 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:01:58.072 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:01:58.162 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:01:58.242 INFO:teuthology.orchestra.run.smithi115.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:01:58.268 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:01:58.293 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:01:58.293 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:01:58.377 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:01:58.377 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:01:58.453 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:01:58.478 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:01:58.483 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:01:58.483 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:01:58.663 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:01:58.663 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:01:58.747 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:01:58.811 INFO:teuthology.orchestra.run.smithi115.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:02:00.454 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T02:02:00.586 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-09-12T02:02:00.586 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-09-12T02:02:00.586 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-09-12T02:02:00.586 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-09-12T02:02:00.586 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-09-12T02:02:00.586 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-09-12T02:02:00.586 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-09-12T02:02:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:00.663 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:02:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T02:02:00.700 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:02:00.700 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T02:02:00.700 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:00.934 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:02:00.976 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:02:01.016 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:02:01.049 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:02:01.076 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:02:01.257 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:02:01.306 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:02:01.336 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:02:01.375 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:02:01.429 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:02:02.056 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:02:02.094 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:02:02.116 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:02:02.265 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:02:02.323 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T02:02:02.323 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:02:02.323 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T02:02:02.323 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:02:02.323 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T02:02:02.323 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:02.574 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:02:02.626 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T02:02:02.626 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:02:02.626 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T02:02:02.626 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:02:02.626 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T02:02:02.626 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:02.954 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:02:03.042 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:02:03.082 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:02:03.108 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:02:03.159 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T02:02:03.160 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:02:03.160 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T02:02:03.160 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:02:03.160 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T02:02:03.160 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:03.163 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:02:03.211 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:02:03.245 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:02:03.283 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T02:02:03.288 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:02:03.288 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:02:03.343 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T02:02:03.364 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:02:03.364 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:02:03.408 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T02:02:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:02:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:02:03.479 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:02:03.479 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:02:03.640 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T02:02:03.666 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:02:03.667 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:02:03.704 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T02:02:03.751 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:02:03.788 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T02:02:03.813 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:02:03.897 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T02:02:04.078 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T02:02:04.176 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T02:02:04.414 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T02:02:04.425 INFO:teuthology.orchestra.run.smithi115.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:02:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:02:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:02:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:02:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:02:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:02:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:02:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:02:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:02:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:02:04.426 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:02:04.427 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:02:04.428 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:02:04.429 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:02:04.430 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:02:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:02:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:02:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:02:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:02:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:02:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:02:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:02:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:02:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:02:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:02:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:02:04.431 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:02:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:02:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:02:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:02:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:02:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:02:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:02:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:02:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:02:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:02:04.432 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:02:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:02:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:02:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:02:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:02:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:02:04.433 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:02:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:02:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:02:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:02:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:02:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:02:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:02:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:02:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:02:04.434 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:02:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:02:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:02:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:02:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:02:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:02:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:02:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:02:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:02:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:02:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:02:04.435 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:02:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:02:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:02:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:02:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:02:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:02:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:02:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:02:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:02:04.436 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:02:04.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:02:04.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:02:04.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:02:04.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:02:04.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:02:04.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:02:04.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:02:04.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:02:04.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:02:04.437 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:02:04.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:02:04.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:02:04.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:02:04.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:02:04.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:02:04.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:02:04.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:02:04.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:02:04.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:02:04.438 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:02:04.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:02:04.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:02:04.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:02:04.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:02:04.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:02:04.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:02:04.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:02:04.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:02:04.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:02:04.439 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:02:04.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:02:04.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:02:04.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:02:04.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:02:04.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:02:04.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:02:04.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:02:04.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:02:04.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:02:04.440 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:02:04.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:02:04.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:02:04.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:02:04.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:02:04.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:02:04.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:02:04.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:02:04.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:02:04.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:02:04.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:02:04.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:02:04.441 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:02:04.442 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:02:04.442 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T02:02:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:02:05.077 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T02:02:05.111 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T02:02:05.195 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T02:02:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:02:06.483 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T02:02:06.527 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:02:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:02:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:02:07.356 INFO:teuthology.orchestra.run.smithi115.stdout:Upgraded: 2024-09-12T02:02:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:02:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:02:07.356 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:02:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:02:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:02:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:02:07.357 INFO:teuthology.orchestra.run.smithi115.stdout:Installed: 2024-09-12T02:02:07.357 INFO:teuthology.orchestra.run.smithi115.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:02:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:02:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:02:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:02:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.358 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.359 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:07.360 INFO:teuthology.orchestra.run.smithi115.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:02:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:02:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:02:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:02:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:02:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:02:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:02:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:02:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:02:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:02:07.361 INFO:teuthology.orchestra.run.smithi115.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.362 INFO:teuthology.orchestra.run.smithi115.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:02:07.363 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:02:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:02:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:02:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:02:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:02:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:02:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:02:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:02:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:02:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:02:07.364 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:02:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:02:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:02:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:02:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:02:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:02:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:02:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:02:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:02:07.365 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:02:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:02:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:02:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:02:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:02:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:02:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:02:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:02:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:02:07.366 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:02:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:02:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:02:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:02:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:02:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:02:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:02:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:02:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:02:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:02:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:02:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:02:07.367 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:02:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:02:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:02:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:02:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:02:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:02:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:02:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:02:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:02:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:02:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.368 INFO:teuthology.orchestra.run.smithi115.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:02:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:02:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:02:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:02:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:02:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:02:07.369 INFO:teuthology.orchestra.run.smithi115.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:02:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:02:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:02:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:02:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:02:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:02:07.370 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:02:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:02:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:02:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:02:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:02:07.371 INFO:teuthology.orchestra.run.smithi115.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:02:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.372 INFO:teuthology.orchestra.run.smithi115.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:02:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:02:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:02:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:02:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:02:07.373 INFO:teuthology.orchestra.run.smithi115.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:02:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:02:07.374 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:02:07.375 INFO:teuthology.orchestra.run.smithi115.stdout:Complete! 2024-09-12T02:02:07.618 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T02:02:07.652 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:02:07.787 DEBUG:teuthology.parallel:result is None 2024-09-12T02:02:07.790 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T02:02:07.983 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T02:02:08.013 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:02:08.065 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T02:02:08.065 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:02:08.065 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T02:02:08.065 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:02:08.065 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T02:02:08.066 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:08.130 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:02:08.157 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T02:02:08.280 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T02:02:08.343 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T02:02:09.348 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T02:02:09.383 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:02:09.434 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T02:02:09.434 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:02:09.434 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T02:02:09.434 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:02:09.435 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T02:02:09.435 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:09.484 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:02:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T02:02:09.534 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:02:09.534 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T02:02:09.534 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:02:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T02:02:09.644 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:02:09.644 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T02:02:09.644 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:02:09.644 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T02:02:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:09.653 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:02:09.654 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:02:09.654 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:02:09.654 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:02:09.654 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:02:09.654 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:02:09.654 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:02:09.654 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:02:09.654 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:02:09.654 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:02:09.654 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:02:09.654 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:02:09.655 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:02:09.655 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:02:09.655 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:02:09.655 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:02:09.655 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:02:09.655 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:02:09.655 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:02:09.655 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:02:09.655 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:02:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:02:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:02:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:02:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:02:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:02:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:02:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:02:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:02:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:02:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:02:09.656 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:02:09.657 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:02:09.657 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:02:09.657 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:02:09.657 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:02:09.657 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:02:09.658 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:02:09.658 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:02:09.658 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:02:09.658 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:02:09.658 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:02:09.658 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:02:09.658 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:02:09.659 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:02:09.659 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:02:09.659 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:02:09.659 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:02:09.659 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:02:09.659 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:02:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:02:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:02:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:02:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:02:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:02:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:02:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:02:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:02:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:02:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:02:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:02:09.660 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:02:09.661 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:02:09.661 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:02:09.661 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:02:09.661 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:02:09.661 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:02:09.661 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:02:09.661 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:02:09.661 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:02:09.661 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:02:09.661 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:02:09.661 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:02:09.661 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:02:09.662 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:02:09.663 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:02:09.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:02:09.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:02:09.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:02:09.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:02:09.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:02:09.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:02:09.664 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:02:09.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:02:09.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:02:09.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:02:09.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:02:09.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:02:09.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:02:09.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:02:09.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:02:09.665 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:02:09.666 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:02:09.666 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:02:09.666 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:02:09.666 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:02:09.666 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:02:09.666 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:02:09.666 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:02:09.666 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:02:09.667 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:02:09.667 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:02:09.667 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:02:09.667 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:02:09.667 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:02:09.667 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:02:09.667 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:02:09.667 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:02:09.668 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:02:09.669 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:02:09.669 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:02:09.669 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:02:09.669 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:02:09.669 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:02:09.669 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:02:09.669 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:02:09.669 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:02:09.669 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:02:09.669 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:02:09.669 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:02:09.669 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:02:09.670 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:02:09.670 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:02:09.670 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:02:09.670 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:02:09.670 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:02:09.670 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:02:09.670 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:02:09.969 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:02:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T02:02:10.020 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T02:02:10.020 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T02:02:10.020 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:02:10.020 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T02:02:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:12.228 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:02:12.229 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:02:12.229 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-09-12T02:02:12.229 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:02:12.229 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:02:12.229 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:02:12.229 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:02:12.229 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.229 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.229 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:02:12.229 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:02:12.229 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-09-12T02:02:12.229 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:12.230 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.231 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:02:12.232 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:02:12.233 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:02:12.234 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:02:12.235 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:02:12.236 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:02:12.236 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:02:12.236 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:02:12.236 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:02:12.236 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:02:12.236 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:02:12.236 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:02:12.236 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:02:12.236 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:02:12.236 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:02:12.236 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:02:12.237 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:02:12.237 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:02:12.237 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:02:12.237 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:02:12.237 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:02:12.237 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:02:12.237 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:02:12.237 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:02:12.237 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:02:12.237 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:02:12.237 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:02:12.237 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:02:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:02:12.239 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:12.240 INFO:teuthology.orchestra.run.smithi136.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:02:12.241 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:02:12.241 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:02:12.241 INFO:teuthology.orchestra.run.smithi136.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:02:12.241 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:02:12.241 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:02:12.241 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:02:12.241 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:02:12.241 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-09-12T02:02:12.676 DEBUG:teuthology.parallel:result is None 2024-09-12T02:02:14.982 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T02:02:15.023 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T02:02:15.067 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T02:02:15.105 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T02:02:15.171 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T02:02:15.414 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T02:02:15.462 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T02:02:15.492 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T02:02:15.557 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T02:02:15.601 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T02:02:16.413 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:02:16.458 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:02:16.510 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T02:02:17.776 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T02:02:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T02:02:17.946 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T02:02:18.051 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T02:02:18.118 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T02:02:18.143 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T02:02:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T02:02:18.188 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:02:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T02:02:18.304 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:02:18.413 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T02:02:18.470 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T02:02:18.486 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:02:18.486 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:02:18.731 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T02:02:18.732 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:02:18.866 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T02:02:18.948 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:02:19.158 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:02:19.158 INFO:teuthology.orchestra.run.smithi110.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-12T02:02:19.159 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:24.879 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T02:02:24.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T02:02:24.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T02:02:24.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T02:02:24.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T02:02:24.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T02:02:24.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T02:02:24.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T02:02:24.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T02:02:24.880 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T02:02:24.881 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T02:02:24.882 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T02:02:24.882 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T02:02:24.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T02:02:24.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T02:02:24.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T02:02:24.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T02:02:24.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T02:02:24.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T02:02:24.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T02:02:24.894 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T02:02:24.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T02:02:24.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T02:02:24.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T02:02:24.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T02:02:24.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T02:02:24.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T02:02:24.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T02:02:24.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T02:02:24.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T02:02:24.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T02:02:24.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T02:02:24.895 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T02:02:24.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T02:02:24.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T02:02:24.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T02:02:24.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T02:02:24.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T02:02:24.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T02:02:24.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T02:02:24.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T02:02:24.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T02:02:24.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T02:02:24.896 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T02:02:24.897 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T02:02:24.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T02:02:24.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T02:02:24.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T02:02:24.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T02:02:24.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T02:02:24.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T02:02:24.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T02:02:24.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T02:02:24.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T02:02:24.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T02:02:24.898 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T02:02:24.899 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T02:02:24.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T02:02:24.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T02:02:24.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T02:02:24.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T02:02:24.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T02:02:24.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T02:02:24.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T02:02:24.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T02:02:24.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T02:02:24.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T02:02:24.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T02:02:24.900 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T02:02:24.901 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T02:02:24.902 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T02:02:24.903 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T02:02:24.904 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T02:02:24.904 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T02:02:24.904 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T02:02:24.904 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T02:02:24.904 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T02:02:24.904 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T02:02:24.904 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T02:02:24.904 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T02:02:24.904 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T02:02:24.904 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T02:02:24.904 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T02:02:24.904 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T02:02:24.905 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T02:02:24.905 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T02:02:24.905 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T02:02:24.905 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T02:02:24.905 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T02:02:24.905 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T02:02:24.905 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T02:02:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T02:02:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:27.224 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T02:02:27.225 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T02:02:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:27.226 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T02:02:27.227 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T02:02:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T02:02:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T02:02:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T02:02:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T02:02:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T02:02:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T02:02:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T02:02:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T02:02:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T02:02:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T02:02:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.228 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T02:02:27.229 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T02:02:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T02:02:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T02:02:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T02:02:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T02:02:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T02:02:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T02:02:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T02:02:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T02:02:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T02:02:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T02:02:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T02:02:27.230 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T02:02:27.231 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T02:02:27.232 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T02:02:27.233 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T02:02:27.234 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T02:02:27.235 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T02:02:27.236 INFO:teuthology.orchestra.run.smithi110.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T02:02:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T02:02:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T02:02:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T02:02:27.237 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:02:27.237 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-09-12T02:02:27.894 DEBUG:teuthology.parallel:result is None 2024-09-12T02:02:27.895 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:02:28.048 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:02:28.094 INFO:teuthology.orchestra.run.smithi110.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:02:28.095 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:02:28.095 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:02:28.097 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:02:28.244 DEBUG:teuthology.orchestra.run.smithi115:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:02:28.271 INFO:teuthology.orchestra.run.smithi115.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:02:28.271 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:02:28.271 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:02:28.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:02:28.416 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T02:02:28.443 INFO:teuthology.orchestra.run.smithi136.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T02:02:28.443 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T02:02:28.443 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T02:02:28.445 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T02:02:28.445 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:02:28.446 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:02:28.510 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-12T02:02:28.510 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:02:28.543 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-12T02:02:28.543 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T02:02:28.575 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T02:02:28.575 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:02:28.575 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:02:28.633 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:02:28.733 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-12T02:02:28.733 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:02:28.762 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:02:28.829 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-12T02:02:28.830 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T02:02:28.860 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T02:02:28.930 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T02:02:28.931 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:02:28.931 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:02:28.989 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:02:29.086 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-12T02:02:29.086 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:02:29.115 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:02:29.184 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-12T02:02:29.184 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T02:02:29.217 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T02:02:29.285 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T02:02:29.285 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:02:29.286 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:02:29.342 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:02:29.438 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-12T02:02:29.438 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:02:29.468 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:02:29.537 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-12T02:02:29.537 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T02:02:29.566 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T02:02:29.635 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T02:02:29.731 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T02:02:29.731 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:02:29.732 INFO:tasks.cephadm:Cluster fsid is 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:02:29.732 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T02:02:29.732 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.110', 'mon.b': '172.21.15.115', 'mon.c': '172.21.15.136'} 2024-09-12T02:02:29.732 INFO:tasks.cephadm:First mon is mon.a on smithi110 2024-09-12T02:02:29.732 INFO:tasks.cephadm:First mgr is x 2024-09-12T02:02:29.732 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T02:02:29.732 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname $(hostname -s) 2024-09-12T02:02:29.790 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname $(hostname -s) 2024-09-12T02:02:29.820 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname $(hostname -s) 2024-09-12T02:02:29.850 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-12T02:02:29.851 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:02:29.994 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56038/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-298-gb53b6d3e', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-298.gb53b6d3e'}, 'url': 'https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 17:24:58.599585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-12T02:02:30.138 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref squid, sha1 b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:02:30.140 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T02:02:30.140 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm 2024-09-12T02:02:30.141 DEBUG:teuthology.orchestra.run.smithi110:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:02:31.267 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:02 /home/ubuntu/cephtest/cephadm 2024-09-12T02:02:31.268 DEBUG:teuthology.orchestra.run.smithi115:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:02:32.714 INFO:teuthology.orchestra.run.smithi115.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:02 /home/ubuntu/cephtest/cephadm 2024-09-12T02:02:32.714 DEBUG:teuthology.orchestra.run.smithi136:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T02:02:33.961 INFO:teuthology.orchestra.run.smithi136.stdout:-rw-r--r--. 1 ubuntu ubuntu 784498 Sep 12 02:02 /home/ubuntu/cephtest/cephadm 2024-09-12T02:02:33.961 DEBUG:teuthology.orchestra.run.smithi110:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:02:34.002 DEBUG:teuthology.orchestra.run.smithi115:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:02:34.022 DEBUG:teuthology.orchestra.run.smithi136:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T02:02:34.058 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc on all hosts... 2024-09-12T02:02:34.058 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:02:34.062 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:02:34.065 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc pull 2024-09-12T02:02:35.539 INFO:teuthology.orchestra.run.smithi115.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:02:35.749 INFO:teuthology.orchestra.run.smithi136.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:02:36.152 INFO:teuthology.orchestra.run.smithi110.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:03:02.582 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-12T02:03:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:03:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:03:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "repo_digests": [ 2024-09-12T02:03:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:03:02.583 INFO:teuthology.orchestra.run.smithi115.stdout: ] 2024-09-12T02:03:02.584 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-12T02:03:23.837 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-09-12T02:03:23.837 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:03:23.837 INFO:teuthology.orchestra.run.smithi136.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:03:23.838 INFO:teuthology.orchestra.run.smithi136.stdout: "repo_digests": [ 2024-09-12T02:03:23.838 INFO:teuthology.orchestra.run.smithi136.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:03:23.838 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-09-12T02:03:23.838 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-09-12T02:03:31.781 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:03:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:03:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "image_id": "54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594", 2024-09-12T02:03:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "repo_digests": [ 2024-09-12T02:03:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66" 2024-09-12T02:03:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T02:03:31.781 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:03:31.812 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph 2024-09-12T02:03:31.870 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph 2024-09-12T02:03:31.904 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph 2024-09-12T02:03:31.941 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /etc/ceph 2024-09-12T02:03:31.996 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /etc/ceph 2024-09-12T02:03:32.025 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /etc/ceph 2024-09-12T02:03:32.053 INFO:tasks.cephadm:Writing seed config... 2024-09-12T02:03:32.055 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T02:03:32.055 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T02:03:32.055 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T02:03:32.055 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T02:03:32.055 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T02:03:32.055 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-12T02:03:32.055 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T02:03:32.055 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T02:03:32.056 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T02:03:32.057 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-12T02:03:32.058 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-12T02:03:32.058 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T02:03:32.058 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T02:03:32.058 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-12T02:03:32.058 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T02:03:32.058 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T02:03:32.058 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T02:03:32.058 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T02:03:32.058 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T02:03:32.058 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T02:03:32.058 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-12T02:03:32.058 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-12T02:03:32.059 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:03:32.059 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T02:03:32.094 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 10ead734-70ab-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T02:03:32.094 DEBUG:teuthology.orchestra.run.smithi110:mon.a> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.a.service 2024-09-12T02:03:32.138 DEBUG:teuthology.orchestra.run.smithi110:mgr.x> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.x.service 2024-09-12T02:03:32.184 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T02:03:32.184 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -v bootstrap --fsid 10ead734-70ab-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.110 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:03:32.439 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-09-12T02:03:32.439 INFO:teuthology.orchestra.run.smithi110.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', '-v', 'bootstrap', '--fsid', '10ead734-70ab-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.110', '--skip-admin-label'] 2024-09-12T02:03:32.439 INFO:teuthology.orchestra.run.smithi110.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T02:03:32.440 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying podman|docker is present... 2024-09-12T02:03:32.484 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stdout 5.2.2 2024-09-12T02:03:32.485 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying lvm2 is present... 2024-09-12T02:03:32.485 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying time synchronization is in place... 2024-09-12T02:03:32.498 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T02:03:32.498 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T02:03:32.510 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T02:03:32.510 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-09-12T02:03:32.524 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout enabled 2024-09-12T02:03:32.536 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout active 2024-09-12T02:03:32.536 INFO:teuthology.orchestra.run.smithi110.stdout:Unit chronyd.service is enabled and running 2024-09-12T02:03:32.536 INFO:teuthology.orchestra.run.smithi110.stdout:Repeating the final host check... 2024-09-12T02:03:32.579 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stdout 5.2.2 2024-09-12T02:03:32.579 INFO:teuthology.orchestra.run.smithi110.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T02:03:32.579 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl is present 2024-09-12T02:03:32.579 INFO:teuthology.orchestra.run.smithi110.stdout:lvcreate is present 2024-09-12T02:03:32.592 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T02:03:32.592 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T02:03:32.604 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T02:03:32.604 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-09-12T02:03:32.617 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout enabled 2024-09-12T02:03:32.629 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout active 2024-09-12T02:03:32.630 INFO:teuthology.orchestra.run.smithi110.stdout:Unit chronyd.service is enabled and running 2024-09-12T02:03:32.630 INFO:teuthology.orchestra.run.smithi110.stdout:Host looks OK 2024-09-12T02:03:32.630 INFO:teuthology.orchestra.run.smithi110.stdout:Cluster fsid: 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:03:32.630 INFO:teuthology.orchestra.run.smithi110.stdout:Acquiring lock 140498762126192 on /run/cephadm/10ead734-70ab-11ef-bcea-c7b262605968.lock 2024-09-12T02:03:32.630 INFO:teuthology.orchestra.run.smithi110.stdout:Lock 140498762126192 acquired on /run/cephadm/10ead734-70ab-11ef-bcea-c7b262605968.lock 2024-09-12T02:03:32.631 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying IP 172.21.15.110 port 3300 ... 2024-09-12T02:03:32.631 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying IP 172.21.15.110 port 6789 ... 2024-09-12T02:03:32.631 INFO:teuthology.orchestra.run.smithi110.stdout:Base mon IP(s) is [172.21.15.110:3300, 172.21.15.110:6789], mon addrv is [v2:172.21.15.110:3300,v1:172.21.15.110:6789] 2024-09-12T02:03:32.637 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.110 metric 100 2024-09-12T02:03:32.637 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.110 metric 100 2024-09-12T02:03:32.643 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T02:03:32.643 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-12T02:03:32.643 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-12T02:03:32.649 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T02:03:32.649 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T02:03:32.649 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T02:03:32.649 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-12T02:03:32.649 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link noprefixroute 2024-09-12T02:03:32.649 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T02:03:32.650 INFO:teuthology.orchestra.run.smithi110.stdout:Mon IP `172.21.15.110` is in CIDR network `172.21.0.0/20` 2024-09-12T02:03:32.650 INFO:teuthology.orchestra.run.smithi110.stdout:Mon IP `172.21.15.110` is in CIDR network `172.21.0.0/20` 2024-09-12T02:03:32.650 INFO:teuthology.orchestra.run.smithi110.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T02:03:32.651 INFO:teuthology.orchestra.run.smithi110.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T02:03:32.652 INFO:teuthology.orchestra.run.smithi110.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:03:33.402 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stdout 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T02:03:33.402 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc... 2024-09-12T02:03:33.402 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T02:03:33.402 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Copying blob sha256:60180723200353b4e13b39fd162aecaf1bc097c859c7c6537324229e97c78567 2024-09-12T02:03:33.402 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T02:03:33.403 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Copying config sha256:54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 2024-09-12T02:03:33.403 INFO:teuthology.orchestra.run.smithi110.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T02:03:34.631 INFO:teuthology.orchestra.run.smithi110.stdout:ceph: stdout ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:03:34.631 INFO:teuthology.orchestra.run.smithi110.stdout:Ceph version: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable) 2024-09-12T02:03:34.631 INFO:teuthology.orchestra.run.smithi110.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T02:03:35.860 INFO:teuthology.orchestra.run.smithi110.stdout:stat: stdout 167 167 2024-09-12T02:03:35.860 INFO:teuthology.orchestra.run.smithi110.stdout:Creating initial keys... 2024-09-12T02:03:37.031 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph-authtool: stdout AQD4S+JmxCFfEhAA0wTxdoNMmicLEHjR/oaUAw== 2024-09-12T02:03:38.187 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph-authtool: stdout AQD5S+Jm4ktQHRAAz/sCUu33gicGyZG1s8HfLQ== 2024-09-12T02:03:39.268 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph-authtool: stdout AQD6S+JmYNx3JBAAkjkn/PfY6BhcJJjQQFOPmQ== 2024-09-12T02:03:39.269 INFO:teuthology.orchestra.run.smithi110.stdout:Creating initial monmap... 2024-09-12T02:03:40.525 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T02:03:40.525 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-12T02:03:40.525 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:03:40.525 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T02:03:40.525 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool for a [v2:172.21.15.110:3300,v1:172.21.15.110:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T02:03:40.525 INFO:teuthology.orchestra.run.smithi110.stdout:setting min_mon_release = quincy 2024-09-12T02:03:40.525 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: set fsid to 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:03:40.526 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T02:03:40.526 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:03:40.526 INFO:teuthology.orchestra.run.smithi110.stdout:Creating mon... 2024-09-12T02:03:41.748 INFO:teuthology.orchestra.run.smithi110.stdout:create mon.a on 2024-09-12T02:03:42.070 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T02:03:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T02:03:42.565 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-10ead734-70ab-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-10ead734-70ab-11ef-bcea-c7b262605968.target. 2024-09-12T02:03:42.565 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-10ead734-70ab-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-10ead734-70ab-11ef-bcea-c7b262605968.target. 2024-09-12T02:03:42.903 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.a 2024-09-12T02:03:42.903 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Failed to reset failed state of unit ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-12T02:03:43.162 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-10ead734-70ab-11ef-bcea-c7b262605968.target.wants/ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-10ead734-70ab-11ef-bcea-c7b262605968@.service. 2024-09-12T02:03:43.813 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:43 smithi110 podman[30167]: 2024-09-12 02:03:43.560864091 +0000 UTC m=+0.171177136 container create d727fa97513a97bf140b00931c754a93df686b33b867dfcc3b4edbf2165e4436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T02:03:43.813 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:43 smithi110 podman[30167]: 2024-09-12 02:03:43.813580884 +0000 UTC m=+0.423893933 container init d727fa97513a97bf140b00931c754a93df686b33b867dfcc3b4edbf2165e4436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:03:43.931 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:03:43.931 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout disabled 2024-09-12T02:03:43.944 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:03:43.944 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-09-12T02:03:43.944 INFO:teuthology.orchestra.run.smithi110.stdout:firewalld.service is not enabled 2024-09-12T02:03:43.944 INFO:teuthology.orchestra.run.smithi110.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T02:03:43.945 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mon to start... 2024-09-12T02:03:43.945 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mon... 2024-09-12T02:03:44.087 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:43 smithi110 podman[30167]: 2024-09-12 02:03:43.820016961 +0000 UTC m=+0.430330010 container start d727fa97513a97bf140b00931c754a93df686b33b867dfcc3b4edbf2165e4436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-12T02:03:44.087 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:43 smithi110 ceph-mon[30186]: mkfs 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:03:44.087 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:43 smithi110 ceph-mon[30186]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:03:44.087 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:43 smithi110 bash[30167]: d727fa97513a97bf140b00931c754a93df686b33b867dfcc3b4edbf2165e4436 2024-09-12T02:03:44.087 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:43 smithi110 systemd[1]: Started Ceph mon.a for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:03:45.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:44 smithi110 ceph-mon[30186]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:03:45.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:44 smithi110 ceph-mon[30186]: monmap epoch 1 2024-09-12T02:03:45.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:44 smithi110 ceph-mon[30186]: fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:03:45.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:44 smithi110 ceph-mon[30186]: last_changed 2024-09-12T02:03:39.733285+0000 2024-09-12T02:03:45.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:44 smithi110 ceph-mon[30186]: created 2024-09-12T02:03:39.733285+0000 2024-09-12T02:03:45.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:44 smithi110 ceph-mon[30186]: min_mon_release 19 (squid) 2024-09-12T02:03:45.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:44 smithi110 ceph-mon[30186]: election_strategy: 1 2024-09-12T02:03:45.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:44 smithi110 ceph-mon[30186]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-09-12T02:03:45.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:44 smithi110 ceph-mon[30186]: fsmap 2024-09-12T02:03:45.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:44 smithi110 ceph-mon[30186]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T02:03:45.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:44 smithi110 ceph-mon[30186]: mgrmap e1: no daemons active 2024-09-12T02:03:45.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:44 smithi110 ceph-mon[30186]: from='client.? 172.21.15.110:0/3271358083' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T02:03:45.408 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T02:03:45.408 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout id: 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:03:45.408 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T02:03:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-12T02:03:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout services: 2024-09-12T02:03:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.779836s) 2024-09-12T02:03:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T02:03:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T02:03:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-12T02:03:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout data: 2024-09-12T02:03:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T02:03:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T02:03:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T02:03:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T02:03:45.409 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-12T02:03:45.410 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.582+0000 7fcdf8a00640 1 Processor -- start 2024-09-12T02:03:45.410 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.582+0000 7fcdf8a00640 1 -- start start 2024-09-12T02:03:45.410 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.582+0000 7fcdf8a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 0x7fcdf4081910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.410 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.582+0000 7fcdf8a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf4081ee0 con 0x7fcdf4081510 2024-09-12T02:03:45.410 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.583+0000 7fcdf1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 0x7fcdf4081910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.410 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.583+0000 7fcdf1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 0x7fcdf4081910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43314/0 (socket says 172.21.15.110:43314) 2024-09-12T02:03:45.410 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.583+0000 7fcdf1e00640 1 -- 172.21.15.110:0/1425418136 learned_addr learned my addr 172.21.15.110:0/1425418136 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:03:45.410 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.584+0000 7fcdf1e00640 1 -- 172.21.15.110:0/1425418136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf410ed70 con 0x7fcdf4081510 2024-09-12T02:03:45.410 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.586+0000 7fcdf1e00640 1 --2- 172.21.15.110:0/1425418136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 0x7fcdf4081910 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009820 tx=0x7fcde402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c1c33166e57a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:45.410 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.587+0000 7fcdf0a00640 1 -- 172.21.15.110:0/1425418136 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcde4037070 con 0x7fcdf4081510 2024-09-12T02:03:45.410 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.587+0000 7fcdf0a00640 1 -- 172.21.15.110:0/1425418136 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde4032440 con 0x7fcdf4081510 2024-09-12T02:03:45.411 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.587+0000 7fcdf0a00640 1 -- 172.21.15.110:0/1425418136 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcde4032740 con 0x7fcdf4081510 2024-09-12T02:03:45.411 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.587+0000 7fcdf8a00640 1 -- 172.21.15.110:0/1425418136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 msgr2=0x7fcdf4081910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.411 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.587+0000 7fcdf8a00640 1 --2- 172.21.15.110:0/1425418136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 0x7fcdf4081910 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009820 tx=0x7fcde402a270 comp rx=0 tx=0).stop 2024-09-12T02:03:45.411 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.587+0000 7fcdf8a00640 1 -- 172.21.15.110:0/1425418136 shutdown_connections 2024-09-12T02:03:45.411 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.587+0000 7fcdf8a00640 1 --2- 172.21.15.110:0/1425418136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 0x7fcdf4081910 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.411 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.587+0000 7fcdf8a00640 1 -- 172.21.15.110:0/1425418136 >> 172.21.15.110:0/1425418136 conn(0x7fcdf407ccf0 msgr2=0x7fcdf407f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:45.411 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.587+0000 7fcdf8a00640 1 -- 172.21.15.110:0/1425418136 shutdown_connections 2024-09-12T02:03:45.411 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.587+0000 7fcdf8a00640 1 -- 172.21.15.110:0/1425418136 wait complete. 2024-09-12T02:03:45.411 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.588+0000 7fcdf8a00640 1 Processor -- start 2024-09-12T02:03:45.411 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.589+0000 7fcdf8a00640 1 -- start start 2024-09-12T02:03:45.411 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.589+0000 7fcdf8a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 0x7fcdf41a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:45.411 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.589+0000 7fcdf8a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf410f2b0 con 0x7fcdf4081510 2024-09-12T02:03:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.589+0000 7fcdf1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 0x7fcdf41a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.589+0000 7fcdf1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 0x7fcdf41a1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43330/0 (socket says 172.21.15.110:43330) 2024-09-12T02:03:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.589+0000 7fcdf1e00640 1 -- 172.21.15.110:0/3271358083 learned_addr learned my addr 172.21.15.110:0/3271358083 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:03:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.590+0000 7fcdf1e00640 1 -- 172.21.15.110:0/3271358083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf41a1840 con 0x7fcdf4081510 2024-09-12T02:03:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.590+0000 7fcdf1e00640 1 --2- 172.21.15.110:0/3271358083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 0x7fcdf41a1300 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcde40090b0 tx=0x7fcde40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.590+0000 7fcdeaa00640 1 -- 172.21.15.110:0/3271358083 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcde4041070 con 0x7fcdf4081510 2024-09-12T02:03:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.590+0000 7fcdeaa00640 1 -- 172.21.15.110:0/3271358083 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde403c7a0 con 0x7fcdf4081510 2024-09-12T02:03:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.590+0000 7fcdeaa00640 1 -- 172.21.15.110:0/3271358083 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcde4037040 con 0x7fcdf4081510 2024-09-12T02:03:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.590+0000 7fcdf8a00640 1 -- 172.21.15.110:0/3271358083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf41a1ad0 con 0x7fcdf4081510 2024-09-12T02:03:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.590+0000 7fcdf8a00640 1 -- 172.21.15.110:0/3271358083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf41a47c0 con 0x7fcdf4081510 2024-09-12T02:03:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.591+0000 7fcdeaa00640 1 -- 172.21.15.110:0/3271358083 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcde4044070 con 0x7fcdf4081510 2024-09-12T02:03:45.412 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.591+0000 7fcdeaa00640 1 -- 172.21.15.110:0/3271358083 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcde403d3f0 con 0x7fcdf4081510 2024-09-12T02:03:45.413 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.591+0000 7fcdf8a00640 1 -- 172.21.15.110:0/3271358083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf410f970 con 0x7fcdf4081510 2024-09-12T02:03:45.413 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.594+0000 7fcdeaa00640 1 -- 172.21.15.110:0/3271358083 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcde4046450 con 0x7fcdf4081510 2024-09-12T02:03:45.413 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.656+0000 7fcdf8a00640 1 -- 172.21.15.110:0/3271358083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fcdf41a4d10 con 0x7fcdf4081510 2024-09-12T02:03:45.413 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.656+0000 7fcdeaa00640 1 -- 172.21.15.110:0/3271358083 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fcde4046630 con 0x7fcdf4081510 2024-09-12T02:03:45.413 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.657+0000 7fcdf8a00640 1 -- 172.21.15.110:0/3271358083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 msgr2=0x7fcdf41a1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:45.413 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.657+0000 7fcdf8a00640 1 --2- 172.21.15.110:0/3271358083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 0x7fcdf41a1300 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcde40090b0 tx=0x7fcde40046c0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.413 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.657+0000 7fcdf8a00640 1 -- 172.21.15.110:0/3271358083 shutdown_connections 2024-09-12T02:03:45.413 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.657+0000 7fcdf8a00640 1 --2- 172.21.15.110:0/3271358083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdf4081510 0x7fcdf41a1300 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:45.413 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.657+0000 7fcdf8a00640 1 -- 172.21.15.110:0/3271358083 >> 172.21.15.110:0/3271358083 conn(0x7fcdf407ccf0 msgr2=0x7fcdf41955a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:45.413 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.657+0000 7fcdf8a00640 1 -- 172.21.15.110:0/3271358083 shutdown_connections 2024-09-12T02:03:45.414 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:44.657+0000 7fcdf8a00640 1 -- 172.21.15.110:0/3271358083 wait complete. 2024-09-12T02:03:45.414 INFO:teuthology.orchestra.run.smithi110.stdout:mon is available 2024-09-12T02:03:45.414 INFO:teuthology.orchestra.run.smithi110.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T02:03:46.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:46 smithi110 ceph-mon[30186]: from='client.? 172.21.15.110:0/744683500' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T02:03:46.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:46 smithi110 ceph-mon[30186]: from='client.? 172.21.15.110:0/744683500' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T02:03:46.611 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-12T02:03:46.612 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T02:03:46.612 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout fsid = 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:03:46.612 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.110:3300,v1:172.21.15.110:6789] 2024-09-12T02:03:46.612 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T02:03:46.612 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T02:03:46.612 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T02:03:46.612 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T02:03:46.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-12T02:03:46.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T02:03:46.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T02:03:46.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-12T02:03:46.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T02:03:46.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T02:03:46.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T02:03:46.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T02:03:46.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T02:03:46.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T02:03:46.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.894+0000 7f94ab600640 1 Processor -- start 2024-09-12T02:03:46.613 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.894+0000 7f94ab600640 1 -- start start 2024-09-12T02:03:46.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.894+0000 7f94ab600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 0x7f94a407c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:46.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.894+0000 7f94ab600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f94a407c870 con 0x7f94a407de40 2024-09-12T02:03:46.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.895+0000 7f94a8c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 0x7f94a407c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:46.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.895+0000 7f94a8c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 0x7f94a407c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43342/0 (socket says 172.21.15.110:43342) 2024-09-12T02:03:46.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.895+0000 7f94a8c00640 1 -- 172.21.15.110:0/3968490944 learned_addr learned my addr 172.21.15.110:0/3968490944 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:03:46.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.895+0000 7f94a8c00640 1 -- 172.21.15.110:0/3968490944 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a407c9f0 con 0x7f94a407de40 2024-09-12T02:03:46.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.896+0000 7f94a8c00640 1 --2- 172.21.15.110:0/3968490944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 0x7f94a407c2a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9498009820 tx=0x7f949802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee42e2f1198be1b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:46.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.896+0000 7f94a3400640 1 -- 172.21.15.110:0/3968490944 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9498037070 con 0x7f94a407de40 2024-09-12T02:03:46.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.896+0000 7f94a3400640 1 -- 172.21.15.110:0/3968490944 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9498032440 con 0x7f94a407de40 2024-09-12T02:03:46.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.896+0000 7f94a3400640 1 -- 172.21.15.110:0/3968490944 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9498032740 con 0x7f94a407de40 2024-09-12T02:03:46.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.897+0000 7f94ab600640 1 -- 172.21.15.110:0/3968490944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 msgr2=0x7f94a407c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:46.614 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.897+0000 7f94ab600640 1 --2- 172.21.15.110:0/3968490944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 0x7f94a407c2a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9498009820 tx=0x7f949802a270 comp rx=0 tx=0).stop 2024-09-12T02:03:46.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.897+0000 7f94ab600640 1 -- 172.21.15.110:0/3968490944 shutdown_connections 2024-09-12T02:03:46.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.897+0000 7f94ab600640 1 --2- 172.21.15.110:0/3968490944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 0x7f94a407c2a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.897+0000 7f94ab600640 1 -- 172.21.15.110:0/3968490944 >> 172.21.15.110:0/3968490944 conn(0x7f94a4102cc0 msgr2=0x7f94a4105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:46.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.897+0000 7f94ab600640 1 -- 172.21.15.110:0/3968490944 shutdown_connections 2024-09-12T02:03:46.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.897+0000 7f94ab600640 1 -- 172.21.15.110:0/3968490944 wait complete. 2024-09-12T02:03:46.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.898+0000 7f94ab600640 1 Processor -- start 2024-09-12T02:03:46.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.898+0000 7f94ab600640 1 -- start start 2024-09-12T02:03:46.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.899+0000 7f94ab600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 0x7f94a419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:46.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.899+0000 7f94ab600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f94a407cf90 con 0x7f94a407de40 2024-09-12T02:03:46.615 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.899+0000 7f94a8c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 0x7f94a419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:46.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.899+0000 7f94a8c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 0x7f94a419cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43352/0 (socket says 172.21.15.110:43352) 2024-09-12T02:03:46.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.899+0000 7f94a8c00640 1 -- 172.21.15.110:0/744683500 learned_addr learned my addr 172.21.15.110:0/744683500 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:03:46.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.899+0000 7f94a8c00640 1 -- 172.21.15.110:0/744683500 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a419d460 con 0x7f94a407de40 2024-09-12T02:03:46.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.899+0000 7f94a8c00640 1 --2- 172.21.15.110:0/744683500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 0x7f94a419cf20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f94980090b0 tx=0x7f94980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:46.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.900+0000 7f94a1600640 1 -- 172.21.15.110:0/744683500 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9498041070 con 0x7f94a407de40 2024-09-12T02:03:46.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.900+0000 7f94a1600640 1 -- 172.21.15.110:0/744683500 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f949803c7a0 con 0x7f94a407de40 2024-09-12T02:03:46.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.900+0000 7f94a1600640 1 -- 172.21.15.110:0/744683500 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9498037040 con 0x7f94a407de40 2024-09-12T02:03:46.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.900+0000 7f94ab600640 1 -- 172.21.15.110:0/744683500 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a419d6f0 con 0x7f94a407de40 2024-09-12T02:03:46.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.900+0000 7f94ab600640 1 -- 172.21.15.110:0/744683500 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a41a03e0 con 0x7f94a407de40 2024-09-12T02:03:46.616 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.900+0000 7f94a1600640 1 -- 172.21.15.110:0/744683500 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9498044070 con 0x7f94a407de40 2024-09-12T02:03:46.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.900+0000 7f94a1600640 1 -- 172.21.15.110:0/744683500 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f949803d3f0 con 0x7f94a407de40 2024-09-12T02:03:46.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.901+0000 7f94ab600640 1 -- 172.21.15.110:0/744683500 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94a407c320 con 0x7f94a407de40 2024-09-12T02:03:46.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.904+0000 7f94a1600640 1 -- 172.21.15.110:0/744683500 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9498046450 con 0x7f94a407de40 2024-09-12T02:03:46.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.964+0000 7f94ab600640 1 -- 172.21.15.110:0/744683500 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f94a402d910 con 0x7f94a407de40 2024-09-12T02:03:46.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.968+0000 7f94a1600640 1 -- 172.21.15.110:0/744683500 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7f9498046630 con 0x7f94a407de40 2024-09-12T02:03:46.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.969+0000 7f94a1600640 1 -- 172.21.15.110:0/744683500 <== mon.0 v2:172.21.15.110:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9498032440 con 0x7f94a407de40 2024-09-12T02:03:46.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.970+0000 7f94ab600640 1 -- 172.21.15.110:0/744683500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 msgr2=0x7f94a419cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:46.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.970+0000 7f94ab600640 1 --2- 172.21.15.110:0/744683500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 0x7f94a419cf20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f94980090b0 tx=0x7f94980046c0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.970+0000 7f94ab600640 1 -- 172.21.15.110:0/744683500 shutdown_connections 2024-09-12T02:03:46.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.970+0000 7f94ab600640 1 --2- 172.21.15.110:0/744683500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94a407de40 0x7f94a419cf20 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:46.617 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.970+0000 7f94ab600640 1 -- 172.21.15.110:0/744683500 >> 172.21.15.110:0/744683500 conn(0x7f94a4102cc0 msgr2=0x7f94a4103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:46.618 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.970+0000 7f94ab600640 1 -- 172.21.15.110:0/744683500 shutdown_connections 2024-09-12T02:03:46.618 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:45.970+0000 7f94ab600640 1 -- 172.21.15.110:0/744683500 wait complete. 2024-09-12T02:03:46.618 INFO:teuthology.orchestra.run.smithi110.stdout:Generating new minimal ceph.conf... 2024-09-12T02:03:47.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:47 smithi110 ceph-mon[30186]: from='client.? 172.21.15.110:0/2752426328' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:03:47.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.107+0000 7fdb81800640 1 Processor -- start 2024-09-12T02:03:47.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.108+0000 7fdb81800640 1 -- start start 2024-09-12T02:03:47.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.108+0000 7fdb81800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 0x7fdb7c07c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:47.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.108+0000 7fdb81800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c07c850 con 0x7fdb7c07de20 2024-09-12T02:03:47.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.108+0000 7fdb7aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 0x7fdb7c07c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:47.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.108+0000 7fdb7aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 0x7fdb7c07c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43362/0 (socket says 172.21.15.110:43362) 2024-09-12T02:03:47.876 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.108+0000 7fdb7aa00640 1 -- 172.21.15.110:0/2442657144 learned_addr learned my addr 172.21.15.110:0/2442657144 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:03:47.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.108+0000 7fdb7aa00640 1 -- 172.21.15.110:0/2442657144 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c07c9d0 con 0x7fdb7c07de20 2024-09-12T02:03:47.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.109+0000 7fdb7aa00640 1 --2- 172.21.15.110:0/2442657144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 0x7fdb7c07c280 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009820 tx=0x7fdb6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20cd5af09111569 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:47.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.110+0000 7fdb7a000640 1 -- 172.21.15.110:0/2442657144 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb6c037070 con 0x7fdb7c07de20 2024-09-12T02:03:47.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.110+0000 7fdb7a000640 1 -- 172.21.15.110:0/2442657144 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb6c032900 con 0x7fdb7c07de20 2024-09-12T02:03:47.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.110+0000 7fdb7a000640 1 -- 172.21.15.110:0/2442657144 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb6c030850 con 0x7fdb7c07de20 2024-09-12T02:03:47.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.110+0000 7fdb81800640 1 -- 172.21.15.110:0/2442657144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 msgr2=0x7fdb7c07c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:47.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.110+0000 7fdb81800640 1 --2- 172.21.15.110:0/2442657144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 0x7fdb7c07c280 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009820 tx=0x7fdb6c02a270 comp rx=0 tx=0).stop 2024-09-12T02:03:47.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.111+0000 7fdb81800640 1 -- 172.21.15.110:0/2442657144 shutdown_connections 2024-09-12T02:03:47.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.111+0000 7fdb81800640 1 --2- 172.21.15.110:0/2442657144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 0x7fdb7c07c280 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:47.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.111+0000 7fdb81800640 1 -- 172.21.15.110:0/2442657144 >> 172.21.15.110:0/2442657144 conn(0x7fdb7c102cc0 msgr2=0x7fdb7c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:47.877 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.111+0000 7fdb81800640 1 -- 172.21.15.110:0/2442657144 shutdown_connections 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.111+0000 7fdb81800640 1 -- 172.21.15.110:0/2442657144 wait complete. 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.111+0000 7fdb81800640 1 Processor -- start 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.112+0000 7fdb81800640 1 -- start start 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.112+0000 7fdb81800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 0x7fdb7c19d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.112+0000 7fdb81800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c10db60 con 0x7fdb7c07de20 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.112+0000 7fdb7aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 0x7fdb7c19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.112+0000 7fdb7aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 0x7fdb7c19d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43368/0 (socket says 172.21.15.110:43368) 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.112+0000 7fdb7aa00640 1 -- 172.21.15.110:0/2752426328 learned_addr learned my addr 172.21.15.110:0/2752426328 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.112+0000 7fdb7aa00640 1 -- 172.21.15.110:0/2752426328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c19dcd0 con 0x7fdb7c07de20 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.113+0000 7fdb7aa00640 1 --2- 172.21.15.110:0/2752426328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 0x7fdb7c19d790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0097f0 tx=0x7fdb6c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.113+0000 7fdb73e00640 1 -- 172.21.15.110:0/2752426328 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb6c037040 con 0x7fdb7c07de20 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.113+0000 7fdb73e00640 1 -- 172.21.15.110:0/2752426328 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb6c040070 con 0x7fdb7c07de20 2024-09-12T02:03:47.878 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.113+0000 7fdb73e00640 1 -- 172.21.15.110:0/2752426328 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb6c03a390 con 0x7fdb7c07de20 2024-09-12T02:03:47.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.113+0000 7fdb81800640 1 -- 172.21.15.110:0/2752426328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7c19df60 con 0x7fdb7c07de20 2024-09-12T02:03:47.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.113+0000 7fdb81800640 1 -- 172.21.15.110:0/2752426328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7c1a0c50 con 0x7fdb7c07de20 2024-09-12T02:03:47.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.113+0000 7fdb73e00640 1 -- 172.21.15.110:0/2752426328 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdb6c03a5e0 con 0x7fdb7c07de20 2024-09-12T02:03:47.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.113+0000 7fdb73e00640 1 -- 172.21.15.110:0/2752426328 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdb6c045950 con 0x7fdb7c07de20 2024-09-12T02:03:47.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.114+0000 7fdb81800640 1 -- 172.21.15.110:0/2752426328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7c07c300 con 0x7fdb7c07de20 2024-09-12T02:03:47.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.117+0000 7fdb73e00640 1 -- 172.21.15.110:0/2752426328 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdb6c045460 con 0x7fdb7c07de20 2024-09-12T02:03:47.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.177+0000 7fdb81800640 1 -- 172.21.15.110:0/2752426328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fdb7c1a0e70 con 0x7fdb7c07de20 2024-09-12T02:03:47.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.177+0000 7fdb73e00640 1 -- 172.21.15.110:0/2752426328 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7fdb6c03b430 con 0x7fdb7c07de20 2024-09-12T02:03:47.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.178+0000 7fdb81800640 1 -- 172.21.15.110:0/2752426328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 msgr2=0x7fdb7c19d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:47.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.178+0000 7fdb81800640 1 --2- 172.21.15.110:0/2752426328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 0x7fdb7c19d790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0097f0 tx=0x7fdb6c030d80 comp rx=0 tx=0).stop 2024-09-12T02:03:47.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.179+0000 7fdb81800640 1 -- 172.21.15.110:0/2752426328 shutdown_connections 2024-09-12T02:03:47.879 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.179+0000 7fdb81800640 1 --2- 172.21.15.110:0/2752426328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb7c07de20 0x7fdb7c19d790 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:47.880 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.179+0000 7fdb81800640 1 -- 172.21.15.110:0/2752426328 >> 172.21.15.110:0/2752426328 conn(0x7fdb7c102cc0 msgr2=0x7fdb7c103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:47.880 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.179+0000 7fdb81800640 1 -- 172.21.15.110:0/2752426328 shutdown_connections 2024-09-12T02:03:47.880 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:47.179+0000 7fdb81800640 1 -- 172.21.15.110:0/2752426328 wait complete. 2024-09-12T02:03:47.880 INFO:teuthology.orchestra.run.smithi110.stdout:Restarting the monitor... 2024-09-12T02:03:48.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:47 smithi110 systemd[1]: Stopping Ceph mon.a for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:03:48.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:48 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a[30182]: 2024-09-12T02:03:48.212+0000 7fe0ad200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:03:48.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:48 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a[30182]: 2024-09-12T02:03:48.212+0000 7fe0ad200640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T02:03:48.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:48 smithi110 podman[30427]: 2024-09-12 02:03:48.367179612 +0000 UTC m=+0.251055705 container died d727fa97513a97bf140b00931c754a93df686b33b867dfcc3b4edbf2165e4436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T02:03:48.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:48 smithi110 podman[30427]: 2024-09-12 02:03:48.784233077 +0000 UTC m=+0.668109179 container cleanup d727fa97513a97bf140b00931c754a93df686b33b867dfcc3b4edbf2165e4436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T02:03:48.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:48 smithi110 bash[30427]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a 2024-09-12T02:03:49.406 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 podman[30438]: 2024-09-12 02:03:49.143745684 +0000 UTC m=+0.772313153 container remove d727fa97513a97bf140b00931c754a93df686b33b867dfcc3b4edbf2165e4436 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T02:03:49.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T02:03:49.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 systemd[1]: Stopped Ceph mon.a for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:03:49.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.a.service: Consumed 1.206s CPU time. 2024-09-12T02:03:49.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 systemd[1]: Starting Ceph mon.a for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:03:49.974 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 podman[30529]: 2024-09-12 02:03:49.625659428 +0000 UTC m=+0.026544883 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:03:49.974 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 podman[30529]: 2024-09-12 02:03:49.727986274 +0000 UTC m=+0.128871730 container create dbfffbd8dcfad5c15082830c00b213ff5909aecfda126855fae0b058d3d4a48c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-12T02:03:49.974 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 podman[30529]: 2024-09-12 02:03:49.930547802 +0000 UTC m=+0.331433257 container init dbfffbd8dcfad5c15082830c00b213ff5909aecfda126855fae0b058d3d4a48c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-12T02:03:49.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 podman[30529]: 2024-09-12 02:03:49.937122796 +0000 UTC m=+0.338008251 container start dbfffbd8dcfad5c15082830c00b213ff5909aecfda126855fae0b058d3d4a48c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T02:03:49.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T02:03:49.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T02:03:49.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: pidfile_write: ignore empty --pid-file 2024-09-12T02:03:49.975 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: load: jerasure load: lrc 2024-09-12T02:03:50.064 INFO:teuthology.orchestra.run.smithi110.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T02:03:50.302 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: RocksDB version: 7.9.2 2024-09-12T02:03:50.302 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Git sha 0 2024-09-12T02:03:50.302 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T02:03:50.303 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: DB SUMMARY 2024-09-12T02:03:50.303 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: DB Session ID: LYWZDC67X4LDTFOXZGVH 2024-09-12T02:03:50.303 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: CURRENT file: CURRENT 2024-09-12T02:03:50.303 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T02:03:50.303 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-12T02:03:50.303 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T02:03:50.303 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104708 ; 2024-09-12T02:03:50.303 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.error_if_exists: 0 2024-09-12T02:03:50.303 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.create_if_missing: 0 2024-09-12T02:03:50.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.paranoid_checks: 1 2024-09-12T02:03:50.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T02:03:50.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T02:03:50.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T02:03:50.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.env: 0x55f073641940 2024-09-12T02:03:50.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T02:03:50.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.info_log: 0x55f08e7df6a0 2024-09-12T02:03:50.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T02:03:50.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.statistics: (nil) 2024-09-12T02:03:50.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.use_fsync: 0 2024-09-12T02:03:50.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_log_file_size: 0 2024-09-12T02:03:50.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.allow_fallocate: 1 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.use_direct_reads: 0 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.db_log_dir: 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.wal_dir: 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T02:03:50.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T02:03:50.306 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T02:03:50.306 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T02:03:50.307 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T02:03:50.307 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T02:03:50.307 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T02:03:50.307 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T02:03:50.308 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.write_buffer_manager: 0x55f08e7eedc0 2024-09-12T02:03:50.308 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T02:03:50.308 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T02:03:50.308 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T02:03:50.308 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T02:03:50.308 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T02:03:50.308 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T02:03:50.308 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T02:03:50.308 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T02:03:50.308 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.unordered_write: 0 2024-09-12T02:03:50.308 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T02:03:50.309 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T02:03:50.309 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T02:03:50.309 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T02:03:50.309 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.row_cache: None 2024-09-12T02:03:50.309 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.wal_filter: None 2024-09-12T02:03:50.309 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T02:03:50.309 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T02:03:50.309 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.two_write_queues: 0 2024-09-12T02:03:50.309 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T02:03:50.309 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.wal_compression: 0 2024-09-12T02:03:50.309 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.atomic_flush: 0 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.log_readahead_size: 0 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_background_jobs: 2 2024-09-12T02:03:50.310 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_background_compactions: -1 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_subcompactions: 1 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_open_files: -1 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T02:03:50.311 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T02:03:50.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T02:03:50.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_background_flushes: -1 2024-09-12T02:03:50.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Compression algorithms supported: 2024-09-12T02:03:50.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: kZSTD supported: 0 2024-09-12T02:03:50.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: kXpressCompression supported: 0 2024-09-12T02:03:50.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: kBZip2Compression supported: 0 2024-09-12T02:03:50.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T02:03:50.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: kLZ4Compression supported: 1 2024-09-12T02:03:50.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: kZlibCompression supported: 1 2024-09-12T02:03:50.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T02:03:50.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: kSnappyCompression supported: 1 2024-09-12T02:03:50.312 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T02:03:50.313 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T02:03:50.313 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-12T02:03:50.313 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T02:03:50.313 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T02:03:50.313 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.merge_operator: 2024-09-12T02:03:50.313 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_filter: None 2024-09-12T02:03:50.313 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T02:03:50.313 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T02:03:50.313 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T02:03:50.313 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T02:03:50.313 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f08e7df300) 2024-09-12T02:03:50.313 INFO:journalctl@ceph.mon.a.smithi110.stdout: cache_index_and_filter_blocks: 1 2024-09-12T02:03:50.314 INFO:journalctl@ceph.mon.a.smithi110.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T02:03:50.314 INFO:journalctl@ceph.mon.a.smithi110.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T02:03:50.314 INFO:journalctl@ceph.mon.a.smithi110.stdout: pin_top_level_index_and_filter: 1 2024-09-12T02:03:50.314 INFO:journalctl@ceph.mon.a.smithi110.stdout: index_type: 0 2024-09-12T02:03:50.314 INFO:journalctl@ceph.mon.a.smithi110.stdout: data_block_index_type: 0 2024-09-12T02:03:50.314 INFO:journalctl@ceph.mon.a.smithi110.stdout: index_shortening: 1 2024-09-12T02:03:50.314 INFO:journalctl@ceph.mon.a.smithi110.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T02:03:50.314 INFO:journalctl@ceph.mon.a.smithi110.stdout: checksum: 4 2024-09-12T02:03:50.314 INFO:journalctl@ceph.mon.a.smithi110.stdout: no_block_cache: 0 2024-09-12T02:03:50.314 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_cache: 0x55f08e7d31f0 2024-09-12T02:03:50.314 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_cache_name: BinnedLRUCache 2024-09-12T02:03:50.314 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_cache_options: 2024-09-12T02:03:50.315 INFO:journalctl@ceph.mon.a.smithi110.stdout: capacity : 536870912 2024-09-12T02:03:50.315 INFO:journalctl@ceph.mon.a.smithi110.stdout: num_shard_bits : 4 2024-09-12T02:03:50.315 INFO:journalctl@ceph.mon.a.smithi110.stdout: strict_capacity_limit : 0 2024-09-12T02:03:50.315 INFO:journalctl@ceph.mon.a.smithi110.stdout: high_pri_pool_ratio: 0.000 2024-09-12T02:03:50.315 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_cache_compressed: (nil) 2024-09-12T02:03:50.315 INFO:journalctl@ceph.mon.a.smithi110.stdout: persistent_cache: (nil) 2024-09-12T02:03:50.315 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_size: 4096 2024-09-12T02:03:50.315 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_size_deviation: 10 2024-09-12T02:03:50.315 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_restart_interval: 16 2024-09-12T02:03:50.315 INFO:journalctl@ceph.mon.a.smithi110.stdout: index_block_restart_interval: 1 2024-09-12T02:03:50.315 INFO:journalctl@ceph.mon.a.smithi110.stdout: metadata_block_size: 4096 2024-09-12T02:03:50.315 INFO:journalctl@ceph.mon.a.smithi110.stdout: partition_filters: 0 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout: use_delta_encoding: 1 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout: filter_policy: bloomfilter 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout: whole_key_filtering: 1 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout: verify_compression: 0 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout: read_amp_bytes_per_bit: 0 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout: format_version: 5 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout: enable_index_compression: 1 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout: block_align: 0 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout: max_auto_readahead_size: 262144 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout: prepopulate_block_cache: 0 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout: initial_auto_readahead_size: 8192 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T02:03:50.316 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T02:03:50.317 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T02:03:50.317 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compression: NoCompression 2024-09-12T02:03:50.317 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T02:03:50.317 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T02:03:50.317 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T02:03:50.317 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.num_levels: 7 2024-09-12T02:03:50.317 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T02:03:50.317 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T02:03:50.317 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T02:03:50.317 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T02:03:50.317 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T02:03:50.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T02:03:50.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T02:03:50.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:03:50.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T02:03:50.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T02:03:50.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:03:50.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:03:50.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T02:03:50.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T02:03:50.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T02:03:50.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T02:03:50.318 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T02:03:50.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T02:03:50.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T02:03:50.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T02:03:50.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T02:03:50.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T02:03:50.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T02:03:50.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T02:03:50.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T02:03:50.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T02:03:50.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T02:03:50.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T02:03:50.319 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T02:03:50.320 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T02:03:50.321 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T02:03:50.321 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T02:03:50.321 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T02:03:50.321 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T02:03:50.321 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T02:03:50.321 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T02:03:50.321 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T02:03:50.321 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T02:03:50.321 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T02:03:50.321 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T02:03:50.321 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.inplace_update_support: 0 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.bloom_locality: 0 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.max_successive_merges: 0 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T02:03:50.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.ttl: 2592000 2024-09-12T02:03:50.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T02:03:50.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T02:03:50.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T02:03:50.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.enable_blob_files: false 2024-09-12T02:03:50.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.min_blob_size: 0 2024-09-12T02:03:50.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T02:03:50.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T02:03:50.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T02:03:50.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T02:03:50.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T02:03:50.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T02:03:50.323 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T02:03:50.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T02:03:50.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-12T02:03:50.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-12T02:03:50.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6625ddb7-55af-45f2-bdb8-4b34c4da3654 2024-09-12T02:03:50.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726106629980247, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-12T02:03:50.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-12T02:03:50.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726106629982608, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99863, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 97745, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14159, "raw_average_key_size": 49, "raw_value_size": 90054, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726106629, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6625ddb7-55af-45f2-bdb8-4b34c4da3654", "db_session_id": "LYWZDC67X4LDTFOXZGVH", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-12T02:03:50.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726106629982868, "job": 1, "event": "recovery_finished"} 2024-09-12T02:03:50.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-12T02:03:50.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T02:03:50.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f08e802e00 2024-09-12T02:03:50.324 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: DB pointer 0x55f08e8fe000 2024-09-12T02:03:50.325 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T02:03:50.325 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T02:03:50.325 INFO:journalctl@ceph.mon.a.smithi110.stdout: ** DB Stats ** 2024-09-12T02:03:50.325 INFO:journalctl@ceph.mon.a.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:03:50.325 INFO:journalctl@ceph.mon.a.smithi110.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T02:03:50.325 INFO:journalctl@ceph.mon.a.smithi110.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:03:50.325 INFO:journalctl@ceph.mon.a.smithi110.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:03:50.325 INFO:journalctl@ceph.mon.a.smithi110.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T02:03:50.325 INFO:journalctl@ceph.mon.a.smithi110.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T02:03:50.325 INFO:journalctl@ceph.mon.a.smithi110.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T02:03:50.325 INFO:journalctl@ceph.mon.a.smithi110.stdout: 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: ** Compaction Stats [default] ** 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: L0 2/0 99.38 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: Sum 2/0 99.38 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: ** Compaction Stats [default] ** 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 72.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: 2024-09-12T02:03:50.326 INFO:journalctl@ceph.mon.a.smithi110.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T02:03:50.327 INFO:journalctl@ceph.mon.a.smithi110.stdout: 2024-09-12T02:03:50.327 INFO:journalctl@ceph.mon.a.smithi110.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T02:03:50.327 INFO:journalctl@ceph.mon.a.smithi110.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T02:03:50.327 INFO:journalctl@ceph.mon.a.smithi110.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T02:03:50.327 INFO:journalctl@ceph.mon.a.smithi110.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T02:03:50.327 INFO:journalctl@ceph.mon.a.smithi110.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T02:03:50.327 INFO:journalctl@ceph.mon.a.smithi110.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T02:03:50.327 INFO:journalctl@ceph.mon.a.smithi110.stdout: Cumulative compaction: 0.00 GB write, 11.09 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:03:50.327 INFO:journalctl@ceph.mon.a.smithi110.stdout: Interval compaction: 0.00 GB write, 11.09 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T02:03:50.327 INFO:journalctl@ceph.mon.a.smithi110.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T02:03:50.327 INFO:journalctl@ceph.mon.a.smithi110.stdout: Block cache BinnedLRUCache@0x55f08e7d31f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-12T02:03:50.328 INFO:journalctl@ceph.mon.a.smithi110.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-12T02:03:50.328 INFO:journalctl@ceph.mon.a.smithi110.stdout: 2024-09-12T02:03:50.328 INFO:journalctl@ceph.mon.a.smithi110.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T02:03:50.328 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: starting mon.a rank 0 at public addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] at bind addrs [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:03:50.328 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: mon.a@-1(???) e1 preinit fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:03:50.328 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: mon.a@-1(???).mds e1 new map 2024-09-12T02:03:50.328 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: mon.a@-1(???).mds e1 print_map 2024-09-12T02:03:50.328 INFO:journalctl@ceph.mon.a.smithi110.stdout: e1 2024-09-12T02:03:50.328 INFO:journalctl@ceph.mon.a.smithi110.stdout: btime 2024-09-12T02:03:43:877639+0000 2024-09-12T02:03:50.328 INFO:journalctl@ceph.mon.a.smithi110.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:03:50.328 INFO:journalctl@ceph.mon.a.smithi110.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:03:50.328 INFO:journalctl@ceph.mon.a.smithi110.stdout: legacy client fscid: -1 2024-09-12T02:03:50.329 INFO:journalctl@ceph.mon.a.smithi110.stdout: 2024-09-12T02:03:50.329 INFO:journalctl@ceph.mon.a.smithi110.stdout: No filesystems configured 2024-09-12T02:03:50.329 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T02:03:50.329 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:03:50.329 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:03:50.329 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T02:03:50.329 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:49 smithi110 ceph-mon[30548]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T02:03:50.329 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 ceph-mon[30548]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-12T02:03:50.329 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 ceph-mon[30548]: monmap epoch 1 2024-09-12T02:03:50.329 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 ceph-mon[30548]: fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:03:50.329 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 ceph-mon[30548]: last_changed 2024-09-12T02:03:39.733285+0000 2024-09-12T02:03:50.329 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 ceph-mon[30548]: created 2024-09-12T02:03:39.733285+0000 2024-09-12T02:03:50.330 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 ceph-mon[30548]: min_mon_release 19 (squid) 2024-09-12T02:03:50.330 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 ceph-mon[30548]: election_strategy: 1 2024-09-12T02:03:50.330 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 ceph-mon[30548]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-09-12T02:03:50.330 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 ceph-mon[30548]: fsmap 2024-09-12T02:03:50.330 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 ceph-mon[30548]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T02:03:50.330 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 ceph-mon[30548]: mgrmap e1: no daemons active 2024-09-12T02:03:50.330 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 bash[30529]: dbfffbd8dcfad5c15082830c00b213ff5909aecfda126855fae0b058d3d4a48c 2024-09-12T02:03:50.330 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:50 smithi110 systemd[1]: Started Ceph mon.a for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:03:51.275 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.565+0000 7f9527800640 1 Processor -- start 2024-09-12T02:03:51.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.565+0000 7f9527800640 1 -- start start 2024-09-12T02:03:51.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.565+0000 7f9527800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 0x7f9520109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:51.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.565+0000 7f9527800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f952010a1e0 con 0x7f9520109810 2024-09-12T02:03:51.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.566+0000 7f9524e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 0x7f9520109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:51.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.566+0000 7f9524e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 0x7f9520109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34274/0 (socket says 172.21.15.110:34274) 2024-09-12T02:03:51.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.566+0000 7f9524e00640 1 -- 172.21.15.110:0/738456584 learned_addr learned my addr 172.21.15.110:0/738456584 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:03:51.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.567+0000 7f9524e00640 1 -- 172.21.15.110:0/738456584 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952010a950 con 0x7f9520109810 2024-09-12T02:03:51.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.569+0000 7f9524e00640 1 --2- 172.21.15.110:0/738456584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 0x7f9520109c10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9514009820 tx=0x7f951402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b821b432790e0e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:51.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.569+0000 7f951f400640 1 -- 172.21.15.110:0/738456584 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9514037070 con 0x7f9520109810 2024-09-12T02:03:51.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.569+0000 7f951f400640 1 -- 172.21.15.110:0/738456584 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9514032900 con 0x7f9520109810 2024-09-12T02:03:51.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.569+0000 7f951f400640 1 -- 172.21.15.110:0/738456584 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9514030850 con 0x7f9520109810 2024-09-12T02:03:51.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.570+0000 7f9527800640 1 -- 172.21.15.110:0/738456584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 msgr2=0x7f9520109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:51.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.570+0000 7f9527800640 1 --2- 172.21.15.110:0/738456584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 0x7f9520109c10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9514009820 tx=0x7f951402a270 comp rx=0 tx=0).stop 2024-09-12T02:03:51.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.570+0000 7f9527800640 1 -- 172.21.15.110:0/738456584 shutdown_connections 2024-09-12T02:03:51.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.570+0000 7f9527800640 1 --2- 172.21.15.110:0/738456584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 0x7f9520109c10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:51.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.570+0000 7f9527800640 1 -- 172.21.15.110:0/738456584 >> 172.21.15.110:0/738456584 conn(0x7f952007ccf0 msgr2=0x7f952007d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:51.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.570+0000 7f9527800640 1 -- 172.21.15.110:0/738456584 shutdown_connections 2024-09-12T02:03:51.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.570+0000 7f9527800640 1 -- 172.21.15.110:0/738456584 wait complete. 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.571+0000 7f9527800640 1 Processor -- start 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.571+0000 7f9527800640 1 -- start start 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.572+0000 7f9527800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 0x7f952019d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.572+0000 7f9527800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f952010dd00 con 0x7f9520109810 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.572+0000 7f9524e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 0x7f952019d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.572+0000 7f9524e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 0x7f952019d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34290/0 (socket says 172.21.15.110:34290) 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.572+0000 7f9524e00640 1 -- 172.21.15.110:0/2748598079 learned_addr learned my addr 172.21.15.110:0/2748598079 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.572+0000 7f9524e00640 1 -- 172.21.15.110:0/2748598079 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952019dd10 con 0x7f9520109810 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.573+0000 7f9524e00640 1 --2- 172.21.15.110:0/2748598079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 0x7f952019d7d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9514030460 tx=0x7f9514030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.573+0000 7f951d600640 1 -- 172.21.15.110:0/2748598079 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9514042070 con 0x7f9520109810 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.573+0000 7f951d600640 1 -- 172.21.15.110:0/2748598079 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9514032be0 con 0x7f9520109810 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.573+0000 7f9527800640 1 -- 172.21.15.110:0/2748598079 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952019dfa0 con 0x7f9520109810 2024-09-12T02:03:51.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.573+0000 7f951d600640 1 -- 172.21.15.110:0/2748598079 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9514037040 con 0x7f9520109810 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.573+0000 7f9527800640 1 -- 172.21.15.110:0/2748598079 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95201a0c90 con 0x7f9520109810 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.573+0000 7f951d600640 1 -- 172.21.15.110:0/2748598079 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9514045070 con 0x7f9520109810 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.574+0000 7f951d600640 1 -- 172.21.15.110:0/2748598079 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9514047a30 con 0x7f9520109810 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.574+0000 7f9527800640 1 -- 172.21.15.110:0/2748598079 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9520109c10 con 0x7f9520109810 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.577+0000 7f951d600640 1 -- 172.21.15.110:0/2748598079 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9514032d90 con 0x7f9520109810 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.637+0000 7f9527800640 1 -- 172.21.15.110:0/2748598079 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f95201a0e60 con 0x7f9520109810 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.639+0000 7f951d600640 1 -- 172.21.15.110:0/2748598079 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f951403da10 con 0x7f9520109810 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.640+0000 7f9527800640 1 -- 172.21.15.110:0/2748598079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 msgr2=0x7f952019d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.640+0000 7f9527800640 1 --2- 172.21.15.110:0/2748598079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 0x7f952019d7d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9514030460 tx=0x7f9514030d80 comp rx=0 tx=0).stop 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.640+0000 7f9527800640 1 -- 172.21.15.110:0/2748598079 shutdown_connections 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.640+0000 7f9527800640 1 --2- 172.21.15.110:0/2748598079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9520109810 0x7f952019d7d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.640+0000 7f9527800640 1 -- 172.21.15.110:0/2748598079 >> 172.21.15.110:0/2748598079 conn(0x7f952007ccf0 msgr2=0x7f95201074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:03:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.640+0000 7f9527800640 1 -- 172.21.15.110:0/2748598079 shutdown_connections 2024-09-12T02:03:51.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:03:50.640+0000 7f9527800640 1 -- 172.21.15.110:0/2748598079 wait complete. 2024-09-12T02:03:51.283 INFO:teuthology.orchestra.run.smithi110.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T02:03:51.327 INFO:teuthology.orchestra.run.smithi110.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:03:51.327 INFO:teuthology.orchestra.run.smithi110.stdout:Creating mgr... 2024-09-12T02:03:51.327 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T02:03:51.328 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T02:03:51.677 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.x 2024-09-12T02:03:51.678 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Failed to reset failed state of unit ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-12T02:03:51.906 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-10ead734-70ab-11ef-bcea-c7b262605968.target.wants/ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-10ead734-70ab-11ef-bcea-c7b262605968@.service. 2024-09-12T02:03:51.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:03:51 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2748598079' entity='client.admin' 2024-09-12T02:03:52.258 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:03:51 smithi110 systemd[1]: Starting Ceph mgr.x for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:03:52.686 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:03:52 smithi110 podman[30756]: 2024-09-12 02:03:52.162456033 +0000 UTC m=+0.027598560 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T02:03:56.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:03:56 smithi110 podman[30756]: 2024-09-12 02:03:56.129479044 +0000 UTC m=+3.994621568 container create 7a7d4d0c65ede532f358ad24ce53b81a0b8371a980ed59edd7e798f0ce5cf1c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:04:01.351 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:04:01.351 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout disabled 2024-09-12T02:04:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:04:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-09-12T02:04:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:firewalld.service is not enabled 2024-09-12T02:04:01.365 INFO:teuthology.orchestra.run.smithi110.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T02:04:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:04:01.382 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout disabled 2024-09-12T02:04:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:04:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-09-12T02:04:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:firewalld.service is not enabled 2024-09-12T02:04:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-12T02:04:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mgr to start... 2024-09-12T02:04:01.397 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mgr... 2024-09-12T02:04:01.495 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:01 smithi110 podman[30756]: 2024-09-12 02:04:01.240210268 +0000 UTC m=+9.105352796 container init 7a7d4d0c65ede532f358ad24ce53b81a0b8371a980ed59edd7e798f0ce5cf1c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:04:01.495 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:01 smithi110 podman[30756]: 2024-09-12 02:04:01.246991307 +0000 UTC m=+9.112133835 container start 7a7d4d0c65ede532f358ad24ce53b81a0b8371a980ed59edd7e798f0ce5cf1c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS) 2024-09-12T02:04:01.495 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:01 smithi110 bash[30756]: 7a7d4d0c65ede532f358ad24ce53b81a0b8371a980ed59edd7e798f0ce5cf1c4 2024-09-12T02:04:01.495 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:01 smithi110 systemd[1]: Started Ceph mgr.x for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:04:01.495 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:01.420+0000 7f9896436040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:04:01.495 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:01.494+0000 7f9896436040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:04:01.773 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:01.688+0000 7f9896436040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:04:01.773 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:01.772+0000 7f9896436040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:04:02.136 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:01 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1619751161' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:04:02.137 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:01.961+0000 7f9896436040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:04:02.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:02 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:02.135+0000 7f9896436040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:04:02.566 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-12T02:04:02.566 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:04:02.566 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsid": "10ead734-70ab-11ef-bcea-c7b262605968", 2024-09-12T02:04:02.566 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:04:02.566 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:04:02.566 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:04:02.566 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:04:02.566 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:02.566 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:04:02.566 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:04:02.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:04:02.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:04:02.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:04:02.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:04:02.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:04:02.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-12T02:04:02.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:04:02.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:04:02.567 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:04:02.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:04:02.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:02.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:04:02.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:04:02.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:04:02.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:04:02.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:04:02.578 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:04:02.578 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:04:02.578 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:04:02.578 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:02.578 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:04:02.578 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:04:02.578 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:04:02.578 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:04:02.578 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:04:02.578 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:04:02.578 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:04:02.579 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:04:02.579 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:04:02.579 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:02.579 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:04:02.579 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:04:02.579 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:03:43:877639+0000", 2024-09-12T02:04:02.580 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:04:02.580 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:04:02.580 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:02.580 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:04:02.580 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T02:04:02.581 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:04:02.581 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:04:02.581 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:04:02.581 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:04:02.581 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:04:02.582 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:04:02.582 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:04:02.582 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:02.582 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:04:02.582 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:04:02.582 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:03:43.878402+0000", 2024-09-12T02:04:02.583 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:04:02.583 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:02.583 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:04:02.583 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:04:02.583 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.844+0000 7f1ce9000640 1 Processor -- start 2024-09-12T02:04:02.583 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.844+0000 7f1ce9000640 1 -- start start 2024-09-12T02:04:02.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.845+0000 7f1ce9000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 0x7f1ce4109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:02.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.845+0000 7f1ce9000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce410a1e0 con 0x7f1ce4109810 2024-09-12T02:04:02.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.845+0000 7f1ce1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 0x7f1ce4109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:02.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.845+0000 7f1ce1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 0x7f1ce4109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45830/0 (socket says 172.21.15.110:45830) 2024-09-12T02:04:02.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.845+0000 7f1ce1e00640 1 -- 172.21.15.110:0/3946790715 learned_addr learned my addr 172.21.15.110:0/3946790715 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:02.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.846+0000 7f1ce1e00640 1 -- 172.21.15.110:0/3946790715 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce410a950 con 0x7f1ce4109810 2024-09-12T02:04:02.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.847+0000 7f1ce1e00640 1 --2- 172.21.15.110:0/3946790715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 0x7f1ce4109c10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009820 tx=0x7f1cd402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec59fc005e32425 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:02.584 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.847+0000 7f1ce0a00640 1 -- 172.21.15.110:0/3946790715 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd4037070 con 0x7f1ce4109810 2024-09-12T02:04:02.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.847+0000 7f1ce0a00640 1 -- 172.21.15.110:0/3946790715 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cd4032900 con 0x7f1ce4109810 2024-09-12T02:04:02.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.847+0000 7f1ce0a00640 1 -- 172.21.15.110:0/3946790715 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd4030850 con 0x7f1ce4109810 2024-09-12T02:04:02.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.848+0000 7f1ce9000640 1 -- 172.21.15.110:0/3946790715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 msgr2=0x7f1ce4109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:02.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.848+0000 7f1ce9000640 1 --2- 172.21.15.110:0/3946790715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 0x7f1ce4109c10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009820 tx=0x7f1cd402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:02.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.848+0000 7f1ce9000640 1 -- 172.21.15.110:0/3946790715 shutdown_connections 2024-09-12T02:04:02.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.848+0000 7f1ce9000640 1 --2- 172.21.15.110:0/3946790715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 0x7f1ce4109c10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:02.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.848+0000 7f1ce9000640 1 -- 172.21.15.110:0/3946790715 >> 172.21.15.110:0/3946790715 conn(0x7f1ce407ccf0 msgr2=0x7f1ce407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:02.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.848+0000 7f1ce9000640 1 -- 172.21.15.110:0/3946790715 shutdown_connections 2024-09-12T02:04:02.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.848+0000 7f1ce9000640 1 -- 172.21.15.110:0/3946790715 wait complete. 2024-09-12T02:04:02.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.849+0000 7f1ce9000640 1 Processor -- start 2024-09-12T02:04:02.585 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.850+0000 7f1ce9000640 1 -- start start 2024-09-12T02:04:02.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.850+0000 7f1ce9000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 0x7f1ce419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:02.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.850+0000 7f1ce9000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce410dd00 con 0x7f1ce4109810 2024-09-12T02:04:02.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.850+0000 7f1ce1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 0x7f1ce419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:02.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.850+0000 7f1ce1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 0x7f1ce419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45832/0 (socket says 172.21.15.110:45832) 2024-09-12T02:04:02.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.850+0000 7f1ce1e00640 1 -- 172.21.15.110:0/1619751161 learned_addr learned my addr 172.21.15.110:0/1619751161 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:02.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.851+0000 7f1ce1e00640 1 -- 172.21.15.110:0/1619751161 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce419dd10 con 0x7f1ce4109810 2024-09-12T02:04:02.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.851+0000 7f1ce1e00640 1 --2- 172.21.15.110:0/1619751161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 0x7f1ce419d7d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4030460 tx=0x7f1cd4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:02.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.851+0000 7f1cdaa00640 1 -- 172.21.15.110:0/1619751161 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd4042070 con 0x7f1ce4109810 2024-09-12T02:04:02.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.851+0000 7f1cdaa00640 1 -- 172.21.15.110:0/1619751161 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cd4032be0 con 0x7f1ce4109810 2024-09-12T02:04:02.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.852+0000 7f1ce9000640 1 -- 172.21.15.110:0/1619751161 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce419dfa0 con 0x7f1ce4109810 2024-09-12T02:04:02.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.852+0000 7f1cdaa00640 1 -- 172.21.15.110:0/1619751161 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd4037040 con 0x7f1ce4109810 2024-09-12T02:04:02.586 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.852+0000 7f1ce9000640 1 -- 172.21.15.110:0/1619751161 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce41a0c90 con 0x7f1ce4109810 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.852+0000 7f1cdaa00640 1 -- 172.21.15.110:0/1619751161 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1cd4045070 con 0x7f1ce4109810 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.852+0000 7f1cdaa00640 1 -- 172.21.15.110:0/1619751161 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1cd4047a30 con 0x7f1ce4109810 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.853+0000 7f1ce9000640 1 -- 172.21.15.110:0/1619751161 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce4109c10 con 0x7f1ce4109810 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.856+0000 7f1cdaa00640 1 -- 172.21.15.110:0/1619751161 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1cd4032d90 con 0x7f1ce4109810 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.920+0000 7f1ce9000640 1 -- 172.21.15.110:0/1619751161 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1ce41a0e60 con 0x7f1ce4109810 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.921+0000 7f1cdaa00640 1 -- 172.21.15.110:0/1619751161 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1292 (secure 0 0 0) 0x7f1cd403da10 con 0x7f1ce4109810 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.922+0000 7f1ce9000640 1 -- 172.21.15.110:0/1619751161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 msgr2=0x7f1ce419d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.922+0000 7f1ce9000640 1 --2- 172.21.15.110:0/1619751161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 0x7f1ce419d7d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4030460 tx=0x7f1cd4030d80 comp rx=0 tx=0).stop 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.922+0000 7f1ce9000640 1 -- 172.21.15.110:0/1619751161 shutdown_connections 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.922+0000 7f1ce9000640 1 --2- 172.21.15.110:0/1619751161 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4109810 0x7f1ce419d7d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.922+0000 7f1ce9000640 1 -- 172.21.15.110:0/1619751161 >> 172.21.15.110:0/1619751161 conn(0x7f1ce407ccf0 msgr2=0x7f1ce41074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.922+0000 7f1ce9000640 1 -- 172.21.15.110:0/1619751161 shutdown_connections 2024-09-12T02:04:02.587 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:01.922+0000 7f1ce9000640 1 -- 172.21.15.110:0/1619751161 wait complete. 2024-09-12T02:04:02.588 INFO:teuthology.orchestra.run.smithi110.stdout:mgr not available, waiting (1/15)... 2024-09-12T02:04:02.835 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:02 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:02.544+0000 7f9896436040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:04:02.836 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:02 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:02.619+0000 7f9896436040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:04:02.836 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:02 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:02.835+0000 7f9896436040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:04:04.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:03.938+0000 7f9896436040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:04:04.437 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:04 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:04.016+0000 7f9896436040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:04:04.999 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:04 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:04.950+0000 7f9896436040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:04:05.270 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:05 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3535930719' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:04:05.270 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:05.092+0000 7f9896436040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:04:05.523 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:05.269+0000 7f9896436040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:04:05.523 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:05.343+0000 7f9896436040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:04:05.524 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:05.522+0000 7f9896436040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:04:05.862 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:05.608+0000 7f9896436040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:04:05.862 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:05.682+0000 7f9896436040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:04:05.862 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:05.861+0000 7f9896436040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:04:06.115 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:05.941+0000 7f9896436040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:04:06.115 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:06 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:06.019+0000 7f9896436040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:04:06.116 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:06 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:06.114+0000 7f9896436040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:04:06.268 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-12T02:04:06.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:04:06.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsid": "10ead734-70ab-11ef-bcea-c7b262605968", 2024-09-12T02:04:06.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:04:06.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:04:06.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:04:06.279 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:04:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:04:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:04:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:04:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:04:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:04:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:04:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:04:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2024-09-12T02:04:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:04:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:04:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:04:06.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:04:06.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:06.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:04:06.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:04:06.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:04:06.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:04:06.281 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:04:06.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:04:06.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:04:06.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:04:06.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:06.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:04:06.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:04:06.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:04:06.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:04:06.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:04:06.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:04:06.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:04:06.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:03:43:877639+0000", 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:04:06.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:03:43.878402+0000", 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:04:06.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.107+0000 7f0423e00640 1 Processor -- start 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.107+0000 7f0423e00640 1 -- start start 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.107+0000 7f0423e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 0x7f04241077a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.107+0000 7f0423e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0424107d70 con 0x7f04241073a0 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.107+0000 7f0422a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 0x7f04241077a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.108+0000 7f0422a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 0x7f04241077a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45836/0 (socket says 172.21.15.110:45836) 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.108+0000 7f0422a00640 1 -- 172.21.15.110:0/469330985 learned_addr learned my addr 172.21.15.110:0/469330985 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.108+0000 7f0422a00640 1 -- 172.21.15.110:0/469330985 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04241085a0 con 0x7f04241073a0 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.109+0000 7f0422a00640 1 --2- 172.21.15.110:0/469330985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 0x7f04241077a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0414009820 tx=0x7f041402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fca00122ea1bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.109+0000 7f0421600640 1 -- 172.21.15.110:0/469330985 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0414037070 con 0x7f04241073a0 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.109+0000 7f0421600640 1 -- 172.21.15.110:0/469330985 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0414032900 con 0x7f04241073a0 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.109+0000 7f0421600640 1 -- 172.21.15.110:0/469330985 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0414030850 con 0x7f04241073a0 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.110+0000 7f0423e00640 1 -- 172.21.15.110:0/469330985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 msgr2=0x7f04241077a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.110+0000 7f0423e00640 1 --2- 172.21.15.110:0/469330985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 0x7f04241077a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0414009820 tx=0x7f041402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.110+0000 7f0423e00640 1 -- 172.21.15.110:0/469330985 shutdown_connections 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.110+0000 7f0423e00640 1 --2- 172.21.15.110:0/469330985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 0x7f04241077a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.110+0000 7f0423e00640 1 -- 172.21.15.110:0/469330985 >> 172.21.15.110:0/469330985 conn(0x7f0424102b90 msgr2=0x7f0424104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.110+0000 7f0423e00640 1 -- 172.21.15.110:0/469330985 shutdown_connections 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.110+0000 7f0423e00640 1 -- 172.21.15.110:0/469330985 wait complete. 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.111+0000 7f0423e00640 1 Processor -- start 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.111+0000 7f0423e00640 1 -- start start 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.111+0000 7f0423e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 0x7f042407ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.111+0000 7f0423e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f042410b950 con 0x7f04241073a0 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.111+0000 7f0422a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 0x7f042407ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.112+0000 7f0422a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 0x7f042407ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45850/0 (socket says 172.21.15.110:45850) 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.112+0000 7f0422a00640 1 -- 172.21.15.110:0/3535930719 learned_addr learned my addr 172.21.15.110:0/3535930719 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:06.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.112+0000 7f0422a00640 1 -- 172.21.15.110:0/3535930719 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042407cf40 con 0x7f04241073a0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.112+0000 7f0422a00640 1 --2- 172.21.15.110:0/3535930719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 0x7f042407ca00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f04140097f0 tx=0x7f0414030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.112+0000 7f041b400640 1 -- 172.21.15.110:0/3535930719 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0414037040 con 0x7f04241073a0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.112+0000 7f041b400640 1 -- 172.21.15.110:0/3535930719 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0414040070 con 0x7f04241073a0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.112+0000 7f0423e00640 1 -- 172.21.15.110:0/3535930719 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f042407b130 con 0x7f04241073a0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.112+0000 7f041b400640 1 -- 172.21.15.110:0/3535930719 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f041403a390 con 0x7f04241073a0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.112+0000 7f0423e00640 1 -- 172.21.15.110:0/3535930719 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f042407b610 con 0x7f04241073a0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.113+0000 7f041b400640 1 -- 172.21.15.110:0/3535930719 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f041403a630 con 0x7f04241073a0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.113+0000 7f041b400640 1 -- 172.21.15.110:0/3535930719 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f04140459a0 con 0x7f04241073a0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.114+0000 7f0423e00640 1 -- 172.21.15.110:0/3535930719 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0424107820 con 0x7f04241073a0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.116+0000 7f041b400640 1 -- 172.21.15.110:0/3535930719 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0414045460 con 0x7f04241073a0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.180+0000 7f0423e00640 1 -- 172.21.15.110:0/3535930719 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f042407bb40 con 0x7f04241073a0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.181+0000 7f041b400640 1 -- 172.21.15.110:0/3535930719 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1292 (secure 0 0 0) 0x7f041403b430 con 0x7f04241073a0 2024-09-12T02:04:06.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.182+0000 7f0423e00640 1 -- 172.21.15.110:0/3535930719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 msgr2=0x7f042407ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:06.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.182+0000 7f0423e00640 1 --2- 172.21.15.110:0/3535930719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 0x7f042407ca00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f04140097f0 tx=0x7f0414030d80 comp rx=0 tx=0).stop 2024-09-12T02:04:06.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.182+0000 7f0423e00640 1 -- 172.21.15.110:0/3535930719 shutdown_connections 2024-09-12T02:04:06.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.182+0000 7f0423e00640 1 --2- 172.21.15.110:0/3535930719 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04241073a0 0x7f042407ca00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:06.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.182+0000 7f0423e00640 1 -- 172.21.15.110:0/3535930719 >> 172.21.15.110:0/3535930719 conn(0x7f0424102b90 msgr2=0x7f0424103700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:06.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.182+0000 7f0423e00640 1 -- 172.21.15.110:0/3535930719 shutdown_connections 2024-09-12T02:04:06.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:05.182+0000 7f0423e00640 1 -- 172.21.15.110:0/3535930719 wait complete. 2024-09-12T02:04:06.288 INFO:teuthology.orchestra.run.smithi110.stdout:mgr not available, waiting (2/15)... 2024-09-12T02:04:06.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:06 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:06.186+0000 7f9896436040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:04:06.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:06 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:06.255+0000 7f9896436040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:04:07.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:07.159+0000 7f9896436040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:04:07.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: Activating manager daemon x 2024-09-12T02:04:07.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: mgrmap e2: x(active, starting, since 0.00443104s) 2024-09-12T02:04:07.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: from='mgr.14100 172.21.15.110:0/775779470' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:04:07.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: from='mgr.14100 172.21.15.110:0/775779470' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:04:07.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: from='mgr.14100 172.21.15.110:0/775779470' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:04:07.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: from='mgr.14100 172.21.15.110:0/775779470' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:04:07.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: from='mgr.14100 172.21.15.110:0/775779470' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:04:07.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: Manager daemon x is now available 2024-09-12T02:04:07.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: from='mgr.14100 172.21.15.110:0/775779470' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:04:07.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: from='mgr.14100 172.21.15.110:0/775779470' entity='mgr.x' 2024-09-12T02:04:07.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: from='mgr.14100 172.21.15.110:0/775779470' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:04:07.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: from='mgr.14100 172.21.15.110:0/775779470' entity='mgr.x' 2024-09-12T02:04:07.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:07 smithi110 ceph-mon[30548]: from='mgr.14100 172.21.15.110:0/775779470' entity='mgr.x' 2024-09-12T02:04:09.390 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:09 smithi110 ceph-mon[30548]: mgrmap e3: x(active, since 1.00821s) 2024-09-12T02:04:09.390 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:09 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/4202527689' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T02:04:09.694 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-12T02:04:09.694 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:04:09.694 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsid": "10ead734-70ab-11ef-bcea-c7b262605968", 2024-09-12T02:04:09.694 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T02:04:09.694 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T02:04:09.694 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T02:04:09.694 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T02:04:09.694 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:09.694 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T02:04:09.694 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T02:04:09.695 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 0 2024-09-12T02:04:09.695 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:04:09.695 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T02:04:09.695 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "a" 2024-09-12T02:04:09.695 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:04:09.695 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "quorum_age": 19, 2024-09-12T02:04:09.695 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T02:04:09.695 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:04:09.695 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-12T02:04:09.695 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T02:04:09.695 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:09.695 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T02:04:09.696 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:04:09.696 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T02:04:09.696 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T02:04:09.696 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T02:04:09.696 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T02:04:09.696 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T02:04:09.696 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T02:04:09.696 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:09.696 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T02:04:09.696 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T02:04:09.696 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T02:04:09.696 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T02:04:09.697 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T02:04:09.697 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T02:04:09.697 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T02:04:09.697 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T02:04:09.697 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T02:04:09.697 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:09.697 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T02:04:09.697 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:04:09.697 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "btime": "2024-09-12T02:03:43:877639+0000", 2024-09-12T02:04:09.697 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T02:04:09.697 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T02:04:09.697 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ], 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T02:04:09.698 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T02:03:43.878402+0000", 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout }, 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.788+0000 7f126b200640 1 Processor -- start 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.788+0000 7f126b200640 1 -- start start 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.789+0000 7f126b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 0x7f1264107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.789+0000 7f126b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1264107f00 con 0x7f1264107530 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.789+0000 7f1263e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 0x7f1264107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.789+0000 7f1263e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 0x7f1264107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60692/0 (socket says 172.21.15.110:60692) 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.789+0000 7f1263e00640 1 -- 172.21.15.110:0/352769590 learned_addr learned my addr 172.21.15.110:0/352769590 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.789+0000 7f1263e00640 1 -- 172.21.15.110:0/352769590 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1264108730 con 0x7f1264107530 2024-09-12T02:04:09.699 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.790+0000 7f1263e00640 1 --2- 172.21.15.110:0/352769590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 0x7f1264107930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1254009820 tx=0x7f125402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e136540fea714b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.790+0000 7f1263400640 1 -- 172.21.15.110:0/352769590 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1254037070 con 0x7f1264107530 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.791+0000 7f1263400640 1 -- 172.21.15.110:0/352769590 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1254032900 con 0x7f1264107530 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.791+0000 7f1263400640 1 -- 172.21.15.110:0/352769590 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1254030850 con 0x7f1264107530 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.791+0000 7f126b200640 1 -- 172.21.15.110:0/352769590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 msgr2=0x7f1264107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.791+0000 7f126b200640 1 --2- 172.21.15.110:0/352769590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 0x7f1264107930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1254009820 tx=0x7f125402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.791+0000 7f126b200640 1 -- 172.21.15.110:0/352769590 shutdown_connections 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.791+0000 7f126b200640 1 --2- 172.21.15.110:0/352769590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 0x7f1264107930 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.791+0000 7f126b200640 1 -- 172.21.15.110:0/352769590 >> 172.21.15.110:0/352769590 conn(0x7f1264102cc0 msgr2=0x7f1264105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.791+0000 7f126b200640 1 -- 172.21.15.110:0/352769590 shutdown_connections 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.791+0000 7f126b200640 1 -- 172.21.15.110:0/352769590 wait complete. 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.792+0000 7f126b200640 1 Processor -- start 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.792+0000 7f126b200640 1 -- start start 2024-09-12T02:04:09.700 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.792+0000 7f126b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 0x7f126419d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.793+0000 7f126b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f126410bae0 con 0x7f1264107530 2024-09-12T02:04:09.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.793+0000 7f1263e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 0x7f126419d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.793+0000 7f1263e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 0x7f126419d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60696/0 (socket says 172.21.15.110:60696) 2024-09-12T02:04:09.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.793+0000 7f1263e00640 1 -- 172.21.15.110:0/4202527689 learned_addr learned my addr 172.21.15.110:0/4202527689 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:09.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.793+0000 7f1263e00640 1 -- 172.21.15.110:0/4202527689 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126419dcc0 con 0x7f1264107530 2024-09-12T02:04:09.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.793+0000 7f1263e00640 1 --2- 172.21.15.110:0/4202527689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 0x7f126419d780 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1254009940 tx=0x7f1254032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.794+0000 7f1261600640 1 -- 172.21.15.110:0/4202527689 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1254042070 con 0x7f1264107530 2024-09-12T02:04:09.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.794+0000 7f1261600640 1 -- 172.21.15.110:0/4202527689 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f12540308c0 con 0x7f1264107530 2024-09-12T02:04:09.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.794+0000 7f126b200640 1 -- 172.21.15.110:0/4202527689 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126419df50 con 0x7f1264107530 2024-09-12T02:04:09.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.794+0000 7f1261600640 1 -- 172.21.15.110:0/4202527689 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1254037040 con 0x7f1264107530 2024-09-12T02:04:09.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.794+0000 7f126b200640 1 -- 172.21.15.110:0/4202527689 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12641a0c40 con 0x7f1264107530 2024-09-12T02:04:09.701 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.795+0000 7f1261600640 1 -- 172.21.15.110:0/4202527689 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f1254045070 con 0x7f1264107530 2024-09-12T02:04:09.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.795+0000 7f126b200640 1 -- 172.21.15.110:0/4202527689 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f126410bc60 con 0x7f1264107530 2024-09-12T02:04:09.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.795+0000 7f1261600640 1 --2- 172.21.15.110:0/4202527689 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f1248038e10 0x7f124803b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:09.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.795+0000 7f1261600640 1 -- 172.21.15.110:0/4202527689 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f125406bda0 con 0x7f1264107530 2024-09-12T02:04:09.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.795+0000 7f125b400640 1 --2- 172.21.15.110:0/4202527689 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f1248038e10 0x7f124803b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:09.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.796+0000 7f125b400640 1 --2- 172.21.15.110:0/4202527689 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f1248038e10 0x7f124803b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f124c0098c0 tx=0x7f124c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:09.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:08.801+0000 7f1261600640 1 -- 172.21.15.110:0/4202527689 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f125403cd90 con 0x7f1264107530 2024-09-12T02:04:09.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:09.045+0000 7f126b200640 1 -- 172.21.15.110:0/4202527689 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f12641a12b0 con 0x7f1264107530 2024-09-12T02:04:09.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:09.046+0000 7f1261600640 1 -- 172.21.15.110:0/4202527689 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f125402fd90 con 0x7f1264107530 2024-09-12T02:04:09.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:09.048+0000 7f126b200640 1 -- 172.21.15.110:0/4202527689 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f1248038e10 msgr2=0x7f124803b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:09.048+0000 7f126b200640 1 --2- 172.21.15.110:0/4202527689 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f1248038e10 0x7f124803b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f124c0098c0 tx=0x7f124c006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:09.048+0000 7f126b200640 1 -- 172.21.15.110:0/4202527689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 msgr2=0x7f126419d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:09.702 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:09.048+0000 7f126b200640 1 --2- 172.21.15.110:0/4202527689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 0x7f126419d780 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1254009940 tx=0x7f1254032ce0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.703 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:09.048+0000 7f126b200640 1 -- 172.21.15.110:0/4202527689 shutdown_connections 2024-09-12T02:04:09.703 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:09.048+0000 7f126b200640 1 --2- 172.21.15.110:0/4202527689 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f1248038e10 0x7f124803b2d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.703 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:09.048+0000 7f126b200640 1 --2- 172.21.15.110:0/4202527689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1264107530 0x7f126419d780 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:09.703 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:09.048+0000 7f126b200640 1 -- 172.21.15.110:0/4202527689 >> 172.21.15.110:0/4202527689 conn(0x7f1264102cc0 msgr2=0x7f1264103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:09.703 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:09.048+0000 7f126b200640 1 -- 172.21.15.110:0/4202527689 shutdown_connections 2024-09-12T02:04:09.703 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:09.048+0000 7f126b200640 1 -- 172.21.15.110:0/4202527689 wait complete. 2024-09-12T02:04:09.703 INFO:teuthology.orchestra.run.smithi110.stdout:mgr is available 2024-09-12T02:04:10.322 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:10 smithi110 ceph-mon[30548]: mgrmap e4: x(active, since 2s) 2024-09-12T02:04:10.986 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-12T02:04:10.986 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T02:04:10.986 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout fsid = 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:04:10.986 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.110:3300,v1:172.21.15.110:6789] 2024-09-12T02:04:10.986 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T02:04:10.986 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T02:04:10.987 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.133+0000 7f4cee800640 1 Processor -- start 2024-09-12T02:04:10.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.133+0000 7f4cee800640 1 -- start start 2024-09-12T02:04:10.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.134+0000 7f4cee800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 0x7f4ce807c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.134+0000 7f4cee800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce807c7a0 con 0x7f4ce807de00 2024-09-12T02:04:10.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.134+0000 7f4ce7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 0x7f4ce807c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.134+0000 7f4ce7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 0x7f4ce807c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60708/0 (socket says 172.21.15.110:60708) 2024-09-12T02:04:10.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.134+0000 7f4ce7400640 1 -- 172.21.15.110:0/964381431 learned_addr learned my addr 172.21.15.110:0/964381431 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:10.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.134+0000 7f4ce7400640 1 -- 172.21.15.110:0/964381431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce807c920 con 0x7f4ce807de00 2024-09-12T02:04:10.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.135+0000 7f4ce7400640 1 --2- 172.21.15.110:0/964381431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 0x7f4ce807c260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009820 tx=0x7f4cd802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a65f9829028a66c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:10.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.135+0000 7f4ce6a00640 1 -- 172.21.15.110:0/964381431 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cd8037070 con 0x7f4ce807de00 2024-09-12T02:04:10.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.136+0000 7f4ce6a00640 1 -- 172.21.15.110:0/964381431 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4cd8032900 con 0x7f4ce807de00 2024-09-12T02:04:10.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.136+0000 7f4ce6a00640 1 -- 172.21.15.110:0/964381431 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cd8030850 con 0x7f4ce807de00 2024-09-12T02:04:10.988 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.136+0000 7f4cee800640 1 -- 172.21.15.110:0/964381431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 msgr2=0x7f4ce807c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.136+0000 7f4cee800640 1 --2- 172.21.15.110:0/964381431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 0x7f4ce807c260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009820 tx=0x7f4cd802a270 comp rx=0 tx=0).stop 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.136+0000 7f4cee800640 1 -- 172.21.15.110:0/964381431 shutdown_connections 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.136+0000 7f4cee800640 1 --2- 172.21.15.110:0/964381431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 0x7f4ce807c260 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.136+0000 7f4cee800640 1 -- 172.21.15.110:0/964381431 >> 172.21.15.110:0/964381431 conn(0x7f4ce8102cc0 msgr2=0x7f4ce8105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.136+0000 7f4cee800640 1 -- 172.21.15.110:0/964381431 shutdown_connections 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.136+0000 7f4cee800640 1 -- 172.21.15.110:0/964381431 wait complete. 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.137+0000 7f4cee800640 1 Processor -- start 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.137+0000 7f4cee800640 1 -- start start 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.138+0000 7f4cee800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 0x7f4ce819d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.138+0000 7f4cee800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce810db80 con 0x7f4ce807de00 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.138+0000 7f4ce7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 0x7f4ce819d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.138+0000 7f4ce7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 0x7f4ce819d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60710/0 (socket says 172.21.15.110:60710) 2024-09-12T02:04:10.989 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.138+0000 7f4ce7400640 1 -- 172.21.15.110:0/764569201 learned_addr learned my addr 172.21.15.110:0/764569201 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:10.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.138+0000 7f4ce7400640 1 -- 172.21.15.110:0/764569201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce819dc70 con 0x7f4ce807de00 2024-09-12T02:04:10.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.138+0000 7f4ce7400640 1 --2- 172.21.15.110:0/764569201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 0x7f4ce819d730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8032ce0 tx=0x7f4cd8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:10.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.139+0000 7f4ce4c00640 1 -- 172.21.15.110:0/764569201 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cd8042070 con 0x7f4ce807de00 2024-09-12T02:04:10.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.139+0000 7f4ce4c00640 1 -- 172.21.15.110:0/764569201 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4cd80308c0 con 0x7f4ce807de00 2024-09-12T02:04:10.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.139+0000 7f4ce4c00640 1 -- 172.21.15.110:0/764569201 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cd8037040 con 0x7f4ce807de00 2024-09-12T02:04:10.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.139+0000 7f4cee800640 1 -- 172.21.15.110:0/764569201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce819df00 con 0x7f4ce807de00 2024-09-12T02:04:10.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.139+0000 7f4cee800640 1 -- 172.21.15.110:0/764569201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce81a0bf0 con 0x7f4ce807de00 2024-09-12T02:04:10.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.140+0000 7f4ce4c00640 1 -- 172.21.15.110:0/764569201 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f4cd8045070 con 0x7f4ce807de00 2024-09-12T02:04:10.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.140+0000 7f4cee800640 1 -- 172.21.15.110:0/764569201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce807c2e0 con 0x7f4ce807de00 2024-09-12T02:04:10.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.141+0000 7f4ce4c00640 1 --2- 172.21.15.110:0/764569201 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4ccc038f20 0x7f4ccc03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:10.990 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.141+0000 7f4ce4c00640 1 -- 172.21.15.110:0/764569201 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4cd806bff0 con 0x7f4ce807de00 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.141+0000 7f4cdea00640 1 --2- 172.21.15.110:0/764569201 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4ccc038f20 0x7f4ccc03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.141+0000 7f4cdea00640 1 --2- 172.21.15.110:0/764569201 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4ccc038f20 0x7f4ccc03b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00098c0 tx=0x7f4cd0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.146+0000 7f4ce4c00640 1 -- 172.21.15.110:0/764569201 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4cd804b170 con 0x7f4ce807de00 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.321+0000 7f4cee800640 1 -- 172.21.15.110:0/764569201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f4ce81a23f0 con 0x7f4ce807de00 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.322+0000 7f4ce4c00640 1 -- 172.21.15.110:0/764569201 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+431 (secure 0 0 0) 0x7f4cd806ba10 con 0x7f4ce807de00 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.325+0000 7f4cee800640 1 -- 172.21.15.110:0/764569201 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4ccc038f20 msgr2=0x7f4ccc03b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.325+0000 7f4cee800640 1 --2- 172.21.15.110:0/764569201 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4ccc038f20 0x7f4ccc03b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00098c0 tx=0x7f4cd0006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.325+0000 7f4cee800640 1 -- 172.21.15.110:0/764569201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 msgr2=0x7f4ce819d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.325+0000 7f4cee800640 1 --2- 172.21.15.110:0/764569201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 0x7f4ce819d730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8032ce0 tx=0x7f4cd8032d10 comp rx=0 tx=0).stop 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.325+0000 7f4cee800640 1 -- 172.21.15.110:0/764569201 shutdown_connections 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.325+0000 7f4cee800640 1 --2- 172.21.15.110:0/764569201 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4ccc038f20 0x7f4ccc03b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.325+0000 7f4cee800640 1 --2- 172.21.15.110:0/764569201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ce807de00 0x7f4ce819d730 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:10.991 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.325+0000 7f4cee800640 1 -- 172.21.15.110:0/764569201 >> 172.21.15.110:0/764569201 conn(0x7f4ce8102cc0 msgr2=0x7f4ce8103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:10.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.325+0000 7f4cee800640 1 -- 172.21.15.110:0/764569201 shutdown_connections 2024-09-12T02:04:10.992 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:10.325+0000 7f4cee800640 1 -- 172.21.15.110:0/764569201 wait complete. 2024-09-12T02:04:10.992 INFO:teuthology.orchestra.run.smithi110.stdout:Enabling cephadm module... 2024-09-12T02:04:11.231 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:11 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/764569201' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T02:04:12.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:12 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/4025747192' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T02:04:12.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: ignoring --setuser ceph since I am not root 2024-09-12T02:04:12.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: ignoring --setgroup ceph since I am not root 2024-09-12T02:04:12.437 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:12.396+0000 7fac70636040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:04:12.735 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:12.467+0000 7fac70636040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:04:12.735 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:12.653+0000 7fac70636040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:04:12.735 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:12.734+0000 7fac70636040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:04:12.915 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.484+0000 7f941e400640 1 Processor -- start 2024-09-12T02:04:12.915 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.484+0000 7f941e400640 1 -- start start 2024-09-12T02:04:12.915 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.485+0000 7f941e400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 0x7f9418109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.915 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.485+0000 7f941e400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f941810a1e0 con 0x7f9418109810 2024-09-12T02:04:12.915 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.485+0000 7f9417400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 0x7f9418109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.915 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.485+0000 7f9417400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 0x7f9418109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60718/0 (socket says 172.21.15.110:60718) 2024-09-12T02:04:12.915 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.485+0000 7f9417400640 1 -- 172.21.15.110:0/1654173288 learned_addr learned my addr 172.21.15.110:0/1654173288 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:12.915 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.485+0000 7f9417400640 1 -- 172.21.15.110:0/1654173288 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941810a950 con 0x7f9418109810 2024-09-12T02:04:12.915 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.486+0000 7f9417400640 1 --2- 172.21.15.110:0/1654173288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 0x7f9418109c10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9408009820 tx=0x7f940802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923d0ac102284056 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:12.915 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.487+0000 7f9416a00640 1 -- 172.21.15.110:0/1654173288 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9408037070 con 0x7f9418109810 2024-09-12T02:04:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.487+0000 7f9416a00640 1 -- 172.21.15.110:0/1654173288 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9408032900 con 0x7f9418109810 2024-09-12T02:04:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.487+0000 7f9416a00640 1 -- 172.21.15.110:0/1654173288 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9408030850 con 0x7f9418109810 2024-09-12T02:04:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.487+0000 7f941e400640 1 -- 172.21.15.110:0/1654173288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 msgr2=0x7f9418109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.487+0000 7f941e400640 1 --2- 172.21.15.110:0/1654173288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 0x7f9418109c10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9408009820 tx=0x7f940802a270 comp rx=0 tx=0).stop 2024-09-12T02:04:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.487+0000 7f941e400640 1 -- 172.21.15.110:0/1654173288 shutdown_connections 2024-09-12T02:04:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.487+0000 7f941e400640 1 --2- 172.21.15.110:0/1654173288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 0x7f9418109c10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.487+0000 7f941e400640 1 -- 172.21.15.110:0/1654173288 >> 172.21.15.110:0/1654173288 conn(0x7f941807ccf0 msgr2=0x7f941807d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.488+0000 7f941e400640 1 -- 172.21.15.110:0/1654173288 shutdown_connections 2024-09-12T02:04:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.488+0000 7f941e400640 1 -- 172.21.15.110:0/1654173288 wait complete. 2024-09-12T02:04:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.489+0000 7f941e400640 1 Processor -- start 2024-09-12T02:04:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.489+0000 7f941e400640 1 -- start start 2024-09-12T02:04:12.916 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.489+0000 7f941e400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 0x7f941819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.489+0000 7f941e400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f941810dd00 con 0x7f9418109810 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.489+0000 7f9417400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 0x7f941819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.489+0000 7f9417400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 0x7f941819d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60724/0 (socket says 172.21.15.110:60724) 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.489+0000 7f9417400640 1 -- 172.21.15.110:0/4025747192 learned_addr learned my addr 172.21.15.110:0/4025747192 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.490+0000 7f9417400640 1 -- 172.21.15.110:0/4025747192 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941819dd10 con 0x7f9418109810 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.490+0000 7f9417400640 1 --2- 172.21.15.110:0/4025747192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 0x7f941819d7d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9408030460 tx=0x7f9408030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.490+0000 7f9414c00640 1 -- 172.21.15.110:0/4025747192 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9408042070 con 0x7f9418109810 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.490+0000 7f9414c00640 1 -- 172.21.15.110:0/4025747192 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9408032be0 con 0x7f9418109810 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.490+0000 7f941e400640 1 -- 172.21.15.110:0/4025747192 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941819dfa0 con 0x7f9418109810 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.490+0000 7f9414c00640 1 -- 172.21.15.110:0/4025747192 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9408037040 con 0x7f9418109810 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.490+0000 7f941e400640 1 -- 172.21.15.110:0/4025747192 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94181a0c90 con 0x7f9418109810 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.491+0000 7f9414c00640 1 -- 172.21.15.110:0/4025747192 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f9408045070 con 0x7f9418109810 2024-09-12T02:04:12.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.491+0000 7f941e400640 1 -- 172.21.15.110:0/4025747192 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9418109c10 con 0x7f9418109810 2024-09-12T02:04:12.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.492+0000 7f9414c00640 1 --2- 172.21.15.110:0/4025747192 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f93fc038f70 0x7f93fc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:12.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.492+0000 7f9414c00640 1 -- 172.21.15.110:0/4025747192 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f940806bdd0 con 0x7f9418109810 2024-09-12T02:04:12.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.492+0000 7f940fe00640 1 --2- 172.21.15.110:0/4025747192 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f93fc038f70 0x7f93fc03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:12.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.493+0000 7f940fe00640 1 --2- 172.21.15.110:0/4025747192 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f93fc038f70 0x7f93fc03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94000098c0 tx=0x7f9400006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:12.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.497+0000 7f9414c00640 1 -- 172.21.15.110:0/4025747192 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9408045360 con 0x7f9418109810 2024-09-12T02:04:12.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:11.715+0000 7f941e400640 1 -- 172.21.15.110:0/4025747192 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f94181a1310 con 0x7f9418109810 2024-09-12T02:04:12.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:12.174+0000 7f9414c00640 1 -- 172.21.15.110:0/4025747192 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f940806b7f0 con 0x7f9418109810 2024-09-12T02:04:12.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:12.175+0000 7f9414c00640 1 -- 172.21.15.110:0/4025747192 <== mon.0 v2:172.21.15.110:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f940802ed70 con 0x7f9418109810 2024-09-12T02:04:12.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:12.177+0000 7f941e400640 1 -- 172.21.15.110:0/4025747192 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f93fc038f70 msgr2=0x7f93fc03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:12.177+0000 7f941e400640 1 --2- 172.21.15.110:0/4025747192 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f93fc038f70 0x7f93fc03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94000098c0 tx=0x7f9400006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:12.177+0000 7f941e400640 1 -- 172.21.15.110:0/4025747192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 msgr2=0x7f941819d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:12.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:12.177+0000 7f941e400640 1 --2- 172.21.15.110:0/4025747192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 0x7f941819d7d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9408030460 tx=0x7f9408030d80 comp rx=0 tx=0).stop 2024-09-12T02:04:12.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:12.177+0000 7f941e400640 1 -- 172.21.15.110:0/4025747192 shutdown_connections 2024-09-12T02:04:12.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:12.177+0000 7f941e400640 1 --2- 172.21.15.110:0/4025747192 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f93fc038f70 0x7f93fc03b430 secure :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94000098c0 tx=0x7f9400006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:12.177+0000 7f941e400640 1 --2- 172.21.15.110:0/4025747192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9418109810 0x7f941819d7d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:12.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:12.177+0000 7f941e400640 1 -- 172.21.15.110:0/4025747192 >> 172.21.15.110:0/4025747192 conn(0x7f941807ccf0 msgr2=0x7f94181074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:12.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:12.177+0000 7f941e400640 1 -- 172.21.15.110:0/4025747192 shutdown_connections 2024-09-12T02:04:12.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:12.178+0000 7f941e400640 1 -- 172.21.15.110:0/4025747192 wait complete. 2024-09-12T02:04:13.049 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:12.907+0000 7fac70636040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:04:13.367 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:13 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/4025747192' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T02:04:13.367 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:13 smithi110 ceph-mon[30548]: mgrmap e5: x(active, since 5s) 2024-09-12T02:04:13.368 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:13 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:13.076+0000 7fac70636040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:04:13.630 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:13 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:13.457+0000 7fac70636040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:04:13.630 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:13 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:13.530+0000 7fac70636040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:04:13.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:13 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:13.750+0000 7fac70636040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:04:14.255 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:14 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/992144115' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T02:04:14.268 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:04:14.268 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T02:04:14.268 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:04:14.268 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T02:04:14.268 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T02:04:14.269 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:04:14.269 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.390+0000 7f4172c00640 1 Processor -- start 2024-09-12T02:04:14.269 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.390+0000 7f4172c00640 1 -- start start 2024-09-12T02:04:14.269 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.390+0000 7f4172c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 0x7f416c109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.269 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.390+0000 7f4172c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f416c10a1e0 con 0x7f416c109810 2024-09-12T02:04:14.269 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.391+0000 7f416be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 0x7f416c109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.269 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.391+0000 7f416be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 0x7f416c109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60756/0 (socket says 172.21.15.110:60756) 2024-09-12T02:04:14.269 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.391+0000 7f416be00640 1 -- 172.21.15.110:0/2334660718 learned_addr learned my addr 172.21.15.110:0/2334660718 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:14.270 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.391+0000 7f416be00640 1 -- 172.21.15.110:0/2334660718 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c10a950 con 0x7f416c109810 2024-09-12T02:04:14.270 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.392+0000 7f416be00640 1 --2- 172.21.15.110:0/2334660718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 0x7f416c109c10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f415c009820 tx=0x7f415c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cbcbdf543d5cba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.270 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.393+0000 7f416aa00640 1 -- 172.21.15.110:0/2334660718 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c037070 con 0x7f416c109810 2024-09-12T02:04:14.270 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.393+0000 7f416aa00640 1 -- 172.21.15.110:0/2334660718 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f415c032900 con 0x7f416c109810 2024-09-12T02:04:14.270 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.393+0000 7f416aa00640 1 -- 172.21.15.110:0/2334660718 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c030850 con 0x7f416c109810 2024-09-12T02:04:14.270 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.393+0000 7f4172c00640 1 -- 172.21.15.110:0/2334660718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 msgr2=0x7f416c109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.270 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.393+0000 7f4172c00640 1 --2- 172.21.15.110:0/2334660718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 0x7f416c109c10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f415c009820 tx=0x7f415c02a270 comp rx=0 tx=0).stop 2024-09-12T02:04:14.270 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.393+0000 7f4172c00640 1 -- 172.21.15.110:0/2334660718 shutdown_connections 2024-09-12T02:04:14.270 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.393+0000 7f4172c00640 1 --2- 172.21.15.110:0/2334660718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 0x7f416c109c10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.270 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.393+0000 7f4172c00640 1 -- 172.21.15.110:0/2334660718 >> 172.21.15.110:0/2334660718 conn(0x7f416c07ccf0 msgr2=0x7f416c07d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:14.270 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.394+0000 7f4172c00640 1 -- 172.21.15.110:0/2334660718 shutdown_connections 2024-09-12T02:04:14.271 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.394+0000 7f4172c00640 1 -- 172.21.15.110:0/2334660718 wait complete. 2024-09-12T02:04:14.271 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.394+0000 7f4172c00640 1 Processor -- start 2024-09-12T02:04:14.271 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.395+0000 7f4172c00640 1 -- start start 2024-09-12T02:04:14.271 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.395+0000 7f4172c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 0x7f416c19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.271 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.395+0000 7f4172c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f416c10dd00 con 0x7f416c109810 2024-09-12T02:04:14.271 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.395+0000 7f416be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 0x7f416c19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:14.271 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.395+0000 7f416be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 0x7f416c19d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60770/0 (socket says 172.21.15.110:60770) 2024-09-12T02:04:14.271 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.395+0000 7f416be00640 1 -- 172.21.15.110:0/992144115 learned_addr learned my addr 172.21.15.110:0/992144115 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:14.271 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.396+0000 7f416be00640 1 -- 172.21.15.110:0/992144115 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c19dd10 con 0x7f416c109810 2024-09-12T02:04:14.271 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.396+0000 7f416be00640 1 --2- 172.21.15.110:0/992144115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 0x7f416c19d7d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f415c030460 tx=0x7f415c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.396+0000 7f4168c00640 1 -- 172.21.15.110:0/992144115 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c042070 con 0x7f416c109810 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.396+0000 7f4168c00640 1 -- 172.21.15.110:0/992144115 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f415c032be0 con 0x7f416c109810 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.396+0000 7f4172c00640 1 -- 172.21.15.110:0/992144115 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c19dfa0 con 0x7f416c109810 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.396+0000 7f4168c00640 1 -- 172.21.15.110:0/992144115 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f415c037040 con 0x7f416c109810 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.396+0000 7f4172c00640 1 -- 172.21.15.110:0/992144115 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c1a0c90 con 0x7f416c109810 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.397+0000 7f4168c00640 1 -- 172.21.15.110:0/992144115 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f415c045070 con 0x7f416c109810 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.397+0000 7f4172c00640 1 -- 172.21.15.110:0/992144115 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416c109c10 con 0x7f416c109810 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.398+0000 7f4168c00640 1 --2- 172.21.15.110:0/992144115 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4150038fc0 0x7f415003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:14.272 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.398+0000 7f4168c00640 1 -- 172.21.15.110:0/992144115 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f415c06be20 con 0x7f416c109810 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.398+0000 7f416b400640 1 -- 172.21.15.110:0/992144115 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4150038fc0 msgr2=0x7f415003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3368055532 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.398+0000 7f416b400640 1 --2- 172.21.15.110:0/992144115 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4150038fc0 0x7f415003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.403+0000 7f4168c00640 1 -- 172.21.15.110:0/992144115 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f415c045360 con 0x7f416c109810 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.599+0000 7f416b400640 1 -- 172.21.15.110:0/992144115 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4150038fc0 msgr2=0x7f415003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3368055532 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.599+0000 7f416b400640 1 --2- 172.21.15.110:0/992144115 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4150038fc0 0x7f415003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.629+0000 7f4172c00640 1 -- 172.21.15.110:0/992144115 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f416c1a1310 con 0x7f416c109810 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.630+0000 7f4168c00640 1 -- 172.21.15.110:0/992144115 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f415c06b840 con 0x7f416c109810 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.632+0000 7f4172c00640 1 -- 172.21.15.110:0/992144115 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4150038fc0 msgr2=0x7f415003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:04:14.273 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.632+0000 7f4172c00640 1 --2- 172.21.15.110:0/992144115 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4150038fc0 0x7f415003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.632+0000 7f4172c00640 1 -- 172.21.15.110:0/992144115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 msgr2=0x7f416c19d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.632+0000 7f4172c00640 1 --2- 172.21.15.110:0/992144115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 0x7f416c19d7d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f415c030460 tx=0x7f415c030d80 comp rx=0 tx=0).stop 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.632+0000 7f4172c00640 1 -- 172.21.15.110:0/992144115 shutdown_connections 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.632+0000 7f4172c00640 1 --2- 172.21.15.110:0/992144115 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4150038fc0 0x7f415003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.632+0000 7f4172c00640 1 --2- 172.21.15.110:0/992144115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f416c109810 0x7f416c19d7d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.632+0000 7f4172c00640 1 -- 172.21.15.110:0/992144115 >> 172.21.15.110:0/992144115 conn(0x7f416c07ccf0 msgr2=0x7f416c1074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.632+0000 7f4172c00640 1 -- 172.21.15.110:0/992144115 shutdown_connections 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:13.632+0000 7f4172c00640 1 -- 172.21.15.110:0/992144115 wait complete. 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for the mgr to restart... 2024-09-12T02:04:14.274 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mgr epoch 5... 2024-09-12T02:04:15.186 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:14 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:14.870+0000 7fac70636040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:04:15.186 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:14 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:14.949+0000 7fac70636040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:04:16.136 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:15 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:15.841+0000 7fac70636040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:04:16.137 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:15 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:15.975+0000 7fac70636040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:04:16.137 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:16 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:16.136+0000 7fac70636040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:04:16.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:16 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:16.207+0000 7fac70636040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:04:16.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:16 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:16.376+0000 7fac70636040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:04:16.778 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:16 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:16.456+0000 7fac70636040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:04:16.778 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:16 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:16.525+0000 7fac70636040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:04:16.778 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:16 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:16.702+0000 7fac70636040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:04:16.778 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:16 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:16.777+0000 7fac70636040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:04:17.087 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:16 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:16.855+0000 7fac70636040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:04:17.087 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:16 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:16.950+0000 7fac70636040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:04:17.088 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:17 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:17.018+0000 7fac70636040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:04:17.088 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:17 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:17.087+0000 7fac70636040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:04:18.038 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:17 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:17.984+0000 7fac70636040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:04:18.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: Active manager daemon x restarted 2024-09-12T02:04:18.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: Activating manager daemon x 2024-09-12T02:04:18.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T02:04:18.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: mgrmap e6: x(active, starting, since 0.00416842s) 2024-09-12T02:04:18.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:04:18.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:04:18.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:04:18.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:04:18.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:04:18.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: Manager daemon x is now available 2024-09-12T02:04:18.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:18.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:18.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:18.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:18 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:19.386 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-mon[30548]: Found migration_current of "None". Setting to last migration. 2024-09-12T02:04:19.386 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:04:19.386 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:04:19.386 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:19.386 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:19.386 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-mon[30548]: mgrmap e7: x(active, since 1.0069s) 2024-09-12T02:04:19.715 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:04:19.715 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T02:04:19.715 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T02:04:19.715 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:04:19.715 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.774+0000 7f4559e00640 1 Processor -- start 2024-09-12T02:04:19.715 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.774+0000 7f4559e00640 1 -- start start 2024-09-12T02:04:19.715 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.775+0000 7f4559e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 0x7f4554109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.715 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.775+0000 7f4559e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f455410a1a0 con 0x7f45541097d0 2024-09-12T02:04:19.715 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.775+0000 7f4552a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 0x7f4554109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.716 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.775+0000 7f4552a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 0x7f4554109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60786/0 (socket says 172.21.15.110:60786) 2024-09-12T02:04:19.716 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.775+0000 7f4552a00640 1 -- 172.21.15.110:0/2224807029 learned_addr learned my addr 172.21.15.110:0/2224807029 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:19.716 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.776+0000 7f4552a00640 1 -- 172.21.15.110:0/2224807029 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455410a970 con 0x7f45541097d0 2024-09-12T02:04:19.716 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.777+0000 7f4552a00640 1 --2- 172.21.15.110:0/2224807029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 0x7f4554109bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4544009820 tx=0x7f454402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a650bae562fbecfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:19.716 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.777+0000 7f4551600640 1 -- 172.21.15.110:0/2224807029 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4544037070 con 0x7f45541097d0 2024-09-12T02:04:19.716 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.777+0000 7f4551600640 1 -- 172.21.15.110:0/2224807029 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4544032900 con 0x7f45541097d0 2024-09-12T02:04:19.716 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.777+0000 7f4551600640 1 -- 172.21.15.110:0/2224807029 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4544030850 con 0x7f45541097d0 2024-09-12T02:04:19.716 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.778+0000 7f4559e00640 1 -- 172.21.15.110:0/2224807029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 msgr2=0x7f4554109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.716 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.778+0000 7f4559e00640 1 --2- 172.21.15.110:0/2224807029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 0x7f4554109bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4544009820 tx=0x7f454402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:19.716 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.778+0000 7f4559e00640 1 -- 172.21.15.110:0/2224807029 shutdown_connections 2024-09-12T02:04:19.716 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.778+0000 7f4559e00640 1 --2- 172.21.15.110:0/2224807029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 0x7f4554109bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.716 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.778+0000 7f4559e00640 1 -- 172.21.15.110:0/2224807029 >> 172.21.15.110:0/2224807029 conn(0x7f455407cd20 msgr2=0x7f455407d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.778+0000 7f4559e00640 1 -- 172.21.15.110:0/2224807029 shutdown_connections 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.778+0000 7f4559e00640 1 -- 172.21.15.110:0/2224807029 wait complete. 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.779+0000 7f4559e00640 1 Processor -- start 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.779+0000 7f4559e00640 1 -- start start 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.779+0000 7f4559e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 0x7f455419d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.779+0000 7f4559e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f455410dd20 con 0x7f45541097d0 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.779+0000 7f4552a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 0x7f455419d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.779+0000 7f4552a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 0x7f455419d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60788/0 (socket says 172.21.15.110:60788) 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.779+0000 7f4552a00640 1 -- 172.21.15.110:0/1460465798 learned_addr learned my addr 172.21.15.110:0/1460465798 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.780+0000 7f4552a00640 1 -- 172.21.15.110:0/1460465798 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455419dd30 con 0x7f45541097d0 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.780+0000 7f4552a00640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 0x7f455419d7f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4544009940 tx=0x7f4544032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.780+0000 7f4558a00640 1 -- 172.21.15.110:0/1460465798 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4544042070 con 0x7f45541097d0 2024-09-12T02:04:19.717 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.780+0000 7f4558a00640 1 -- 172.21.15.110:0/1460465798 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45440308c0 con 0x7f45541097d0 2024-09-12T02:04:19.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.780+0000 7f4559e00640 1 -- 172.21.15.110:0/1460465798 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455419dfc0 con 0x7f45541097d0 2024-09-12T02:04:19.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.780+0000 7f4558a00640 1 -- 172.21.15.110:0/1460465798 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4544037040 con 0x7f45541097d0 2024-09-12T02:04:19.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.780+0000 7f4559e00640 1 -- 172.21.15.110:0/1460465798 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45541a0cb0 con 0x7f45541097d0 2024-09-12T02:04:19.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.781+0000 7f4558a00640 1 -- 172.21.15.110:0/1460465798 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f4544045070 con 0x7f45541097d0 2024-09-12T02:04:19.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.782+0000 7f4558a00640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 0x7f453803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.782+0000 7f4558a00640 1 -- 172.21.15.110:0/1460465798 --> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f453803bb90 con 0x7f4538038fc0 2024-09-12T02:04:19.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.782+0000 7f4558a00640 1 -- 172.21.15.110:0/1460465798 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f454406c010 con 0x7f45541097d0 2024-09-12T02:04:19.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.782+0000 7f4552000640 1 -- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 msgr2=0x7f453803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3368055532 2024-09-12T02:04:19.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.782+0000 7f4552000640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 0x7f453803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:04:19.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.983+0000 7f4552000640 1 -- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 msgr2=0x7f453803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3368055532 2024-09-12T02:04:19.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:14.983+0000 7f4552000640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 0x7f453803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:04:19.718 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:15.384+0000 7f4552000640 1 -- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 msgr2=0x7f453803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3368055532 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:15.384+0000 7f4552000640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 0x7f453803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:16.185+0000 7f4552000640 1 -- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 msgr2=0x7f453803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3368055532 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:16.185+0000 7f4552000640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 0x7f453803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:17.786+0000 7f4552000640 1 -- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 msgr2=0x7f453803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3368055532 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:17.786+0000 7f4552000640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 0x7f453803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:17.989+0000 7f4558a00640 1 -- 172.21.15.110:0/1460465798 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f454403c720 con 0x7f45541097d0 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:17.989+0000 7f4558a00640 1 -- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 msgr2=0x7f453803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:17.989+0000 7f4558a00640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 0x7f453803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:18.990+0000 7f4558a00640 1 -- 172.21.15.110:0/1460465798 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f454403d430 con 0x7f45541097d0 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:18.990+0000 7f4558a00640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f453803c8f0 0x7f453803ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:18.990+0000 7f4558a00640 1 -- 172.21.15.110:0/1460465798 --> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4544040e70 con 0x7f453803c8f0 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:18.991+0000 7f4552000640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f453803c8f0 0x7f453803ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:19.719 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:18.993+0000 7f4552000640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f453803c8f0 0x7f453803ece0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4540003980 tx=0x7f45400092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:18.994+0000 7f4558a00640 1 -- 172.21.15.110:0/1460465798 <== mgr.14118 v2:172.21.15.110:6800/3137576010 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f4544040e70 con 0x7f453803c8f0 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.001+0000 7f4559e00640 1 -- 172.21.15.110:0/1460465798 --> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4554109bd0 con 0x7f453803c8f0 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.001+0000 7f4558a00640 1 -- 172.21.15.110:0/1460465798 <== mgr.14118 v2:172.21.15.110:6800/3137576010 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f4554109bd0 con 0x7f453803c8f0 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.001+0000 7f4559e00640 1 -- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f453803c8f0 msgr2=0x7f453803ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.001+0000 7f4559e00640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f453803c8f0 0x7f453803ece0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4540003980 tx=0x7f45400092b0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.001+0000 7f4559e00640 1 -- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 msgr2=0x7f455419d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.001+0000 7f4559e00640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 0x7f455419d7f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4544009940 tx=0x7f4544032ce0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.002+0000 7f4559e00640 1 -- 172.21.15.110:0/1460465798 shutdown_connections 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.002+0000 7f4559e00640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f453803c8f0 0x7f453803ece0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.002+0000 7f4559e00640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:6800/3368055532,v1:172.21.15.110:6801/3368055532] conn(0x7f4538038fc0 0x7f453803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.002+0000 7f4559e00640 1 --2- 172.21.15.110:0/1460465798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45541097d0 0x7f455419d7f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.002+0000 7f4559e00640 1 -- 172.21.15.110:0/1460465798 >> 172.21.15.110:0/1460465798 conn(0x7f455407cd20 msgr2=0x7f45541074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:19.720 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.002+0000 7f4559e00640 1 -- 172.21.15.110:0/1460465798 shutdown_connections 2024-09-12T02:04:19.721 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:19.002+0000 7f4559e00640 1 -- 172.21.15.110:0/1460465798 wait complete. 2024-09-12T02:04:19.721 INFO:teuthology.orchestra.run.smithi110.stdout:mgr epoch 5 is available 2024-09-12T02:04:19.721 INFO:teuthology.orchestra.run.smithi110.stdout:Setting orchestrator backend to cephadm... 2024-09-12T02:04:20.017 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:19.939+0000 7fabcf800640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:04:19] ENGINE Error in HTTPServer.serve 2024-09-12T02:04:20.017 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: Traceback (most recent call last): 2024-09-12T02:04:20.017 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:04:20.017 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: self._connections.run(self.expiration_interval) 2024-09-12T02:04:20.017 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: self._run(expiration_interval) 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: s = self.context.wrap_socket( 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: return self.sslsocket_class._create( 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: self.do_handshake() 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:04:20.018 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: self._sslobj.do_handshake() 2024-09-12T02:04:20.019 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:04:20.019 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:20.435 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:20 smithi110 ceph-mon[30548]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T02:04:20.435 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:20 smithi110 ceph-mon[30548]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T02:04:20.435 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:20 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:21.126 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:21 smithi110 ceph-mon[30548]: [12/Sep/2024:02:04:19] ENGINE Bus STARTING 2024-09-12T02:04:21.126 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:21 smithi110 ceph-mon[30548]: [12/Sep/2024:02:04:19] ENGINE Serving on https://172.21.15.110:7150 2024-09-12T02:04:21.126 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:21 smithi110 ceph-mon[30548]: [12/Sep/2024:02:04:19] ENGINE Error in HTTPServer.serve 2024-09-12T02:04:21.126 INFO:journalctl@ceph.mon.a.smithi110.stdout: Traceback (most recent call last): 2024-09-12T02:04:21.127 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:04:21.127 INFO:journalctl@ceph.mon.a.smithi110.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:04:21.127 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:04:21.127 INFO:journalctl@ceph.mon.a.smithi110.stdout: self._run(expiration_interval) 2024-09-12T02:04:21.127 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:04:21.127 INFO:journalctl@ceph.mon.a.smithi110.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:04:21.127 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:04:21.127 INFO:journalctl@ceph.mon.a.smithi110.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:04:21.127 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:04:21.127 INFO:journalctl@ceph.mon.a.smithi110.stdout: s = self.context.wrap_socket( 2024-09-12T02:04:21.127 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:04:21.127 INFO:journalctl@ceph.mon.a.smithi110.stdout: return self.sslsocket_class._create( 2024-09-12T02:04:21.128 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:04:21.128 INFO:journalctl@ceph.mon.a.smithi110.stdout: self.do_handshake() 2024-09-12T02:04:21.128 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:04:21.128 INFO:journalctl@ceph.mon.a.smithi110.stdout: self._sslobj.do_handshake() 2024-09-12T02:04:21.128 INFO:journalctl@ceph.mon.a.smithi110.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:04:21.128 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:21 smithi110 ceph-mon[30548]: [12/Sep/2024:02:04:20] ENGINE Serving on http://172.21.15.110:8765 2024-09-12T02:04:21.128 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:21 smithi110 ceph-mon[30548]: [12/Sep/2024:02:04:20] ENGINE Bus STARTED 2024-09-12T02:04:21.128 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:21 smithi110 ceph-mon[30548]: mgrmap e8: x(active, since 2s) 2024-09-12T02:04:21.128 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:21 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:21.128 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:21 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:21.136 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.228+0000 7fd328800640 1 Processor -- start 2024-09-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.228+0000 7fd328800640 1 -- start start 2024-09-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.229+0000 7fd328800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 0x7fd320107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.229+0000 7fd328800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd320107f00 con 0x7fd320107530 2024-09-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.229+0000 7fd325e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 0x7fd320107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.229+0000 7fd325e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 0x7fd320107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39396/0 (socket says 172.21.15.110:39396) 2024-09-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.229+0000 7fd325e00640 1 -- 172.21.15.110:0/3970439882 learned_addr learned my addr 172.21.15.110:0/3970439882 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.229+0000 7fd325e00640 1 -- 172.21.15.110:0/3970439882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd320108730 con 0x7fd320107530 2024-09-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.230+0000 7fd325e00640 1 --2- 172.21.15.110:0/3970439882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 0x7fd320107930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd314009820 tx=0x7fd31402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba513427e92c57de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.231+0000 7fd324a00640 1 -- 172.21.15.110:0/3970439882 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd314037070 con 0x7fd320107530 2024-09-12T02:04:21.137 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.231+0000 7fd324a00640 1 -- 172.21.15.110:0/3970439882 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd314032900 con 0x7fd320107530 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.231+0000 7fd324a00640 1 -- 172.21.15.110:0/3970439882 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd314030850 con 0x7fd320107530 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.231+0000 7fd328800640 1 -- 172.21.15.110:0/3970439882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 msgr2=0x7fd320107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.231+0000 7fd328800640 1 --2- 172.21.15.110:0/3970439882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 0x7fd320107930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd314009820 tx=0x7fd31402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.231+0000 7fd328800640 1 -- 172.21.15.110:0/3970439882 shutdown_connections 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.231+0000 7fd328800640 1 --2- 172.21.15.110:0/3970439882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 0x7fd320107930 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.231+0000 7fd328800640 1 -- 172.21.15.110:0/3970439882 >> 172.21.15.110:0/3970439882 conn(0x7fd320102cc0 msgr2=0x7fd320105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.231+0000 7fd328800640 1 -- 172.21.15.110:0/3970439882 shutdown_connections 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.232+0000 7fd328800640 1 -- 172.21.15.110:0/3970439882 wait complete. 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.232+0000 7fd328800640 1 Processor -- start 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.232+0000 7fd328800640 1 -- start start 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.233+0000 7fd328800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 0x7fd32019b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.138 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.233+0000 7fd328800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd32010bae0 con 0x7fd320107530 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.233+0000 7fd325e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 0x7fd32019b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.233+0000 7fd325e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 0x7fd32019b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39406/0 (socket says 172.21.15.110:39406) 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.233+0000 7fd325e00640 1 -- 172.21.15.110:0/2159042377 learned_addr learned my addr 172.21.15.110:0/2159042377 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.233+0000 7fd325e00640 1 -- 172.21.15.110:0/2159042377 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32019bac0 con 0x7fd320107530 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.234+0000 7fd325e00640 1 --2- 172.21.15.110:0/2159042377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 0x7fd32019b580 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3140097f0 tx=0x7fd314030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.234+0000 7fd31aa00640 1 -- 172.21.15.110:0/2159042377 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd314037040 con 0x7fd320107530 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.234+0000 7fd31aa00640 1 -- 172.21.15.110:0/2159042377 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd314040070 con 0x7fd320107530 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.234+0000 7fd328800640 1 -- 172.21.15.110:0/2159042377 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32019bd50 con 0x7fd320107530 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.234+0000 7fd31aa00640 1 -- 172.21.15.110:0/2159042377 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd31403a390 con 0x7fd320107530 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.234+0000 7fd328800640 1 -- 172.21.15.110:0/2159042377 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32019ea40 con 0x7fd320107530 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.235+0000 7fd31aa00640 1 -- 172.21.15.110:0/2159042377 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd314032900 con 0x7fd320107530 2024-09-12T02:04:21.139 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.235+0000 7fd328800640 1 -- 172.21.15.110:0/2159042377 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3201079b0 con 0x7fd320107530 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.235+0000 7fd31aa00640 1 --2- 172.21.15.110:0/2159042377 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fd308038f70 0x7fd30803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.235+0000 7fd31aa00640 1 -- 172.21.15.110:0/2159042377 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd31406c540 con 0x7fd320107530 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.236+0000 7fd325400640 1 --2- 172.21.15.110:0/2159042377 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fd308038f70 0x7fd30803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.236+0000 7fd325400640 1 --2- 172.21.15.110:0/2159042377 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fd308038f70 0x7fd30803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd3100098c0 tx=0x7fd310006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.241+0000 7fd31aa00640 1 -- 172.21.15.110:0/2159042377 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd31406be90 con 0x7fd320107530 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.434+0000 7fd328800640 1 -- 172.21.15.110:0/2159042377 --> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fd320104000 con 0x7fd308038f70 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.440+0000 7fd31aa00640 1 -- 172.21.15.110:0/2159042377 <== mgr.14118 v2:172.21.15.110:6800/3137576010 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd320104000 con 0x7fd308038f70 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.443+0000 7fd328800640 1 -- 172.21.15.110:0/2159042377 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fd308038f70 msgr2=0x7fd30803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.443+0000 7fd328800640 1 --2- 172.21.15.110:0/2159042377 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fd308038f70 0x7fd30803b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd3100098c0 tx=0x7fd310006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.443+0000 7fd328800640 1 -- 172.21.15.110:0/2159042377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 msgr2=0x7fd32019b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.443+0000 7fd328800640 1 --2- 172.21.15.110:0/2159042377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 0x7fd32019b580 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3140097f0 tx=0x7fd314030d80 comp rx=0 tx=0).stop 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.443+0000 7fd328800640 1 -- 172.21.15.110:0/2159042377 shutdown_connections 2024-09-12T02:04:21.140 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.443+0000 7fd328800640 1 --2- 172.21.15.110:0/2159042377 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fd308038f70 0x7fd30803b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.141 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.443+0000 7fd328800640 1 --2- 172.21.15.110:0/2159042377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd320107530 0x7fd32019b580 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:21.141 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.443+0000 7fd328800640 1 -- 172.21.15.110:0/2159042377 >> 172.21.15.110:0/2159042377 conn(0x7fd320102cc0 msgr2=0x7fd3201038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:21.141 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.443+0000 7fd328800640 1 -- 172.21.15.110:0/2159042377 shutdown_connections 2024-09-12T02:04:21.141 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:20.443+0000 7fd328800640 1 -- 172.21.15.110:0/2159042377 wait complete. 2024-09-12T02:04:22.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:22 smithi110 ceph-mon[30548]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:22.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T02:04:22.568 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.635+0000 7fa63ca00640 1 Processor -- start 2024-09-12T02:04:22.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.635+0000 7fa63ca00640 1 -- start start 2024-09-12T02:04:22.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.635+0000 7fa63ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 0x7fa63807b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.635+0000 7fa63ca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa63807b7a0 con 0x7fa63807cd70 2024-09-12T02:04:22.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.635+0000 7fa636800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 0x7fa63807b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.636+0000 7fa636800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 0x7fa63807b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39410/0 (socket says 172.21.15.110:39410) 2024-09-12T02:04:22.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.636+0000 7fa636800640 1 -- 172.21.15.110:0/4232192595 learned_addr learned my addr 172.21.15.110:0/4232192595 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:22.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.636+0000 7fa636800640 1 -- 172.21.15.110:0/4232192595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63807b920 con 0x7fa63807cd70 2024-09-12T02:04:22.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.637+0000 7fa636800640 1 --2- 172.21.15.110:0/4232192595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 0x7fa63807b1d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa628009820 tx=0x7fa62802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb21d2d386ac8c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:22.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.637+0000 7fa635e00640 1 -- 172.21.15.110:0/4232192595 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa628037070 con 0x7fa63807cd70 2024-09-12T02:04:22.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.637+0000 7fa635e00640 1 -- 172.21.15.110:0/4232192595 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa628032900 con 0x7fa63807cd70 2024-09-12T02:04:22.569 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.637+0000 7fa635e00640 1 -- 172.21.15.110:0/4232192595 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa628030850 con 0x7fa63807cd70 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.638+0000 7fa63ca00640 1 -- 172.21.15.110:0/4232192595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 msgr2=0x7fa63807b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.638+0000 7fa63ca00640 1 --2- 172.21.15.110:0/4232192595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 0x7fa63807b1d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa628009820 tx=0x7fa62802a270 comp rx=0 tx=0).stop 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.638+0000 7fa63ca00640 1 -- 172.21.15.110:0/4232192595 shutdown_connections 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.638+0000 7fa63ca00640 1 --2- 172.21.15.110:0/4232192595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 0x7fa63807b1d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.638+0000 7fa63ca00640 1 -- 172.21.15.110:0/4232192595 >> 172.21.15.110:0/4232192595 conn(0x7fa638102b90 msgr2=0x7fa638104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.638+0000 7fa63ca00640 1 -- 172.21.15.110:0/4232192595 shutdown_connections 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.638+0000 7fa63ca00640 1 -- 172.21.15.110:0/4232192595 wait complete. 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.639+0000 7fa63ca00640 1 Processor -- start 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.639+0000 7fa63ca00640 1 -- start start 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.639+0000 7fa63ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 0x7fa63819d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.639+0000 7fa63ca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa63810d9d0 con 0x7fa63807cd70 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.639+0000 7fa636800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 0x7fa63819d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.570 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.639+0000 7fa636800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 0x7fa63819d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39426/0 (socket says 172.21.15.110:39426) 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.639+0000 7fa636800640 1 -- 172.21.15.110:0/2152485008 learned_addr learned my addr 172.21.15.110:0/2152485008 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.640+0000 7fa636800640 1 -- 172.21.15.110:0/2152485008 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63819dad0 con 0x7fa63807cd70 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.640+0000 7fa636800640 1 --2- 172.21.15.110:0/2152485008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 0x7fa63819d590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa6280097f0 tx=0x7fa628030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.640+0000 7fa62f400640 1 -- 172.21.15.110:0/2152485008 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa628037040 con 0x7fa63807cd70 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.640+0000 7fa62f400640 1 -- 172.21.15.110:0/2152485008 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa628040070 con 0x7fa63807cd70 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.640+0000 7fa62f400640 1 -- 172.21.15.110:0/2152485008 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa62803a390 con 0x7fa63807cd70 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.640+0000 7fa63ca00640 1 -- 172.21.15.110:0/2152485008 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa63819dd60 con 0x7fa63807cd70 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.641+0000 7fa63ca00640 1 -- 172.21.15.110:0/2152485008 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6381a0a50 con 0x7fa63807cd70 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.642+0000 7fa62f400640 1 -- 172.21.15.110:0/2152485008 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa62803b430 con 0x7fa63807cd70 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.642+0000 7fa63ca00640 1 -- 172.21.15.110:0/2152485008 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa63807b250 con 0x7fa63807cd70 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.642+0000 7fa62f400640 1 --2- 172.21.15.110:0/2152485008 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fa61c038f70 0x7fa61c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.642+0000 7fa62f400640 1 -- 172.21.15.110:0/2152485008 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa62806c570 con 0x7fa63807cd70 2024-09-12T02:04:22.571 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.642+0000 7fa62fe00640 1 --2- 172.21.15.110:0/2152485008 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fa61c038f70 0x7fa61c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.643+0000 7fa62fe00640 1 --2- 172.21.15.110:0/2152485008 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fa61c038f70 0x7fa61c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa6200098c0 tx=0x7fa620006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.647+0000 7fa62f400640 1 -- 172.21.15.110:0/2152485008 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa62806bec0 con 0x7fa63807cd70 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.825+0000 7fa63ca00640 1 -- 172.21.15.110:0/2152485008 --> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fa638103e50 con 0x7fa61c038f70 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.826+0000 7fa62f400640 1 -- 172.21.15.110:0/2152485008 <== mgr.14118 v2:172.21.15.110:6800/3137576010 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fa638103e50 con 0x7fa61c038f70 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.828+0000 7fa63ca00640 1 -- 172.21.15.110:0/2152485008 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fa61c038f70 msgr2=0x7fa61c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.828+0000 7fa63ca00640 1 --2- 172.21.15.110:0/2152485008 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fa61c038f70 0x7fa61c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa6200098c0 tx=0x7fa620006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.828+0000 7fa63ca00640 1 -- 172.21.15.110:0/2152485008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 msgr2=0x7fa63819d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.828+0000 7fa63ca00640 1 --2- 172.21.15.110:0/2152485008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 0x7fa63819d590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa6280097f0 tx=0x7fa628030d80 comp rx=0 tx=0).stop 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.828+0000 7fa63ca00640 1 -- 172.21.15.110:0/2152485008 shutdown_connections 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.828+0000 7fa63ca00640 1 --2- 172.21.15.110:0/2152485008 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fa61c038f70 0x7fa61c03b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.828+0000 7fa63ca00640 1 --2- 172.21.15.110:0/2152485008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa63807cd70 0x7fa63819d590 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.828+0000 7fa63ca00640 1 -- 172.21.15.110:0/2152485008 >> 172.21.15.110:0/2152485008 conn(0x7fa638102b90 msgr2=0x7fa638103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.828+0000 7fa63ca00640 1 -- 172.21.15.110:0/2152485008 shutdown_connections 2024-09-12T02:04:22.572 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:21.829+0000 7fa63ca00640 1 -- 172.21.15.110:0/2152485008 wait complete. 2024-09-12T02:04:22.573 INFO:teuthology.orchestra.run.smithi110.stdout:Generating ssh key... 2024-09-12T02:04:23.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-mon[30548]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:23.614 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: Generating public/private rsa key pair. 2024-09-12T02:04:23.615 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: Your identification has been saved in /tmp/tmprefy4bb4/key 2024-09-12T02:04:23.615 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: Your public key has been saved in /tmp/tmprefy4bb4/key.pub 2024-09-12T02:04:23.615 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: The key fingerprint is: 2024-09-12T02:04:23.615 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: SHA256:s/RpsHcKxCxOHB9EVPs/X6Lc4OP6NEcERbJH2xkhXyI ceph-10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:04:23.615 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: The key's randomart image is: 2024-09-12T02:04:23.615 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: +---[RSA 3072]----+ 2024-09-12T02:04:23.615 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: | o+.. E+=oo| 2024-09-12T02:04:23.615 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: | . . *o++| 2024-09-12T02:04:23.615 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: | . . . . +o.| 2024-09-12T02:04:23.615 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: | . = . . o | 2024-09-12T02:04:23.616 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: | + S . . | 2024-09-12T02:04:23.616 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: | o + * . o | 2024-09-12T02:04:23.616 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: | . + = = = .| 2024-09-12T02:04:23.616 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: | + *.* +.| 2024-09-12T02:04:23.616 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: | o+*.. .| 2024-09-12T02:04:23.616 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: +----[SHA256]-----+ 2024-09-12T02:04:23.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.039+0000 7f093b600640 1 Processor -- start 2024-09-12T02:04:23.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.040+0000 7f093b600640 1 -- start start 2024-09-12T02:04:23.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.040+0000 7f093b600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 0x7f0934109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:23.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.040+0000 7f093b600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f093410a1e0 con 0x7f0934109810 2024-09-12T02:04:23.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.040+0000 7f0938c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 0x7f0934109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:23.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.040+0000 7f0938c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 0x7f0934109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39430/0 (socket says 172.21.15.110:39430) 2024-09-12T02:04:23.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.040+0000 7f0938c00640 1 -- 172.21.15.110:0/2145253214 learned_addr learned my addr 172.21.15.110:0/2145253214 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:23.917 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.041+0000 7f0938c00640 1 -- 172.21.15.110:0/2145253214 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093410a950 con 0x7f0934109810 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.041+0000 7f0938c00640 1 --2- 172.21.15.110:0/2145253214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 0x7f0934109c10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0924009820 tx=0x7f092402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c605bb5a2ca1a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.042+0000 7f0933e00640 1 -- 172.21.15.110:0/2145253214 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0924037070 con 0x7f0934109810 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.042+0000 7f0933e00640 1 -- 172.21.15.110:0/2145253214 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0924032900 con 0x7f0934109810 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.042+0000 7f0933e00640 1 -- 172.21.15.110:0/2145253214 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0924030850 con 0x7f0934109810 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.042+0000 7f093b600640 1 -- 172.21.15.110:0/2145253214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 msgr2=0x7f0934109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.042+0000 7f093b600640 1 --2- 172.21.15.110:0/2145253214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 0x7f0934109c10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0924009820 tx=0x7f092402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.042+0000 7f093b600640 1 -- 172.21.15.110:0/2145253214 shutdown_connections 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.042+0000 7f093b600640 1 --2- 172.21.15.110:0/2145253214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 0x7f0934109c10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.042+0000 7f093b600640 1 -- 172.21.15.110:0/2145253214 >> 172.21.15.110:0/2145253214 conn(0x7f093407ccf0 msgr2=0x7f093407d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.043+0000 7f093b600640 1 -- 172.21.15.110:0/2145253214 shutdown_connections 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.043+0000 7f093b600640 1 -- 172.21.15.110:0/2145253214 wait complete. 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.044+0000 7f093b600640 1 Processor -- start 2024-09-12T02:04:23.918 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.044+0000 7f093b600640 1 -- start start 2024-09-12T02:04:23.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.044+0000 7f093b600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 0x7f093419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:23.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.044+0000 7f093b600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f093410dd00 con 0x7f0934109810 2024-09-12T02:04:23.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.044+0000 7f0938c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 0x7f093419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:23.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.044+0000 7f0938c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 0x7f093419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39440/0 (socket says 172.21.15.110:39440) 2024-09-12T02:04:23.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.044+0000 7f0938c00640 1 -- 172.21.15.110:0/3624060335 learned_addr learned my addr 172.21.15.110:0/3624060335 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:23.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.045+0000 7f0938c00640 1 -- 172.21.15.110:0/3624060335 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093419dd10 con 0x7f0934109810 2024-09-12T02:04:23.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.045+0000 7f0938c00640 1 --2- 172.21.15.110:0/3624060335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 0x7f093419d7d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0924030460 tx=0x7f0924030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:23.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.047+0000 7f0932000640 1 -- 172.21.15.110:0/3624060335 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0924042070 con 0x7f0934109810 2024-09-12T02:04:23.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.047+0000 7f0932000640 1 -- 172.21.15.110:0/3624060335 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0924032be0 con 0x7f0934109810 2024-09-12T02:04:23.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.047+0000 7f0932000640 1 -- 172.21.15.110:0/3624060335 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0924037040 con 0x7f0934109810 2024-09-12T02:04:23.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.047+0000 7f093b600640 1 -- 172.21.15.110:0/3624060335 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093419dfa0 con 0x7f0934109810 2024-09-12T02:04:23.919 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.047+0000 7f093b600640 1 -- 172.21.15.110:0/3624060335 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09341a0c90 con 0x7f0934109810 2024-09-12T02:04:23.920 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.049+0000 7f093b600640 1 -- 172.21.15.110:0/3624060335 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0934109c10 con 0x7f0934109810 2024-09-12T02:04:23.920 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.049+0000 7f0932000640 1 -- 172.21.15.110:0/3624060335 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0924045070 con 0x7f0934109810 2024-09-12T02:04:23.920 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.049+0000 7f0932000640 1 --2- 172.21.15.110:0/3624060335 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f0918038fc0 0x7f091803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:23.920 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.049+0000 7f0932000640 1 -- 172.21.15.110:0/3624060335 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f092406be10 con 0x7f0934109810 2024-09-12T02:04:23.920 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.049+0000 7f092be00640 1 --2- 172.21.15.110:0/3624060335 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f0918038fc0 0x7f091803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:23.920 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.050+0000 7f092be00640 1 --2- 172.21.15.110:0/3624060335 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f0918038fc0 0x7f091803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f091c0098c0 tx=0x7f091c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:23.920 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.054+0000 7f0932000640 1 -- 172.21.15.110:0/3624060335 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0924045360 con 0x7f0934109810 2024-09-12T02:04:23.920 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.229+0000 7f093b600640 1 -- 172.21.15.110:0/3624060335 --> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f0934107be0 con 0x7f0918038fc0 2024-09-12T02:04:23.920 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.316+0000 7f0932000640 1 -- 172.21.15.110:0/3624060335 <== mgr.14118 v2:172.21.15.110:6800/3137576010 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0934107be0 con 0x7f0918038fc0 2024-09-12T02:04:23.920 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.318+0000 7f093b600640 1 -- 172.21.15.110:0/3624060335 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f0918038fc0 msgr2=0x7f091803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:23.920 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.318+0000 7f093b600640 1 --2- 172.21.15.110:0/3624060335 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f0918038fc0 0x7f091803b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f091c0098c0 tx=0x7f091c006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:23.921 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.318+0000 7f093b600640 1 -- 172.21.15.110:0/3624060335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 msgr2=0x7f093419d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:23.921 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.318+0000 7f093b600640 1 --2- 172.21.15.110:0/3624060335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 0x7f093419d7d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0924030460 tx=0x7f0924030d80 comp rx=0 tx=0).stop 2024-09-12T02:04:23.921 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.318+0000 7f093b600640 1 -- 172.21.15.110:0/3624060335 shutdown_connections 2024-09-12T02:04:23.921 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.318+0000 7f093b600640 1 --2- 172.21.15.110:0/3624060335 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f0918038fc0 0x7f091803b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:23.921 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.318+0000 7f093b600640 1 --2- 172.21.15.110:0/3624060335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0934109810 0x7f093419d7d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:23.921 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.318+0000 7f093b600640 1 -- 172.21.15.110:0/3624060335 >> 172.21.15.110:0/3624060335 conn(0x7f093407ccf0 msgr2=0x7f09341074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:23.921 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.319+0000 7f093b600640 1 -- 172.21.15.110:0/3624060335 shutdown_connections 2024-09-12T02:04:23.921 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:23.319+0000 7f093b600640 1 -- 172.21.15.110:0/3624060335 wait complete. 2024-09-12T02:04:24.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:24 smithi110 ceph-mon[30548]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:24.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:24 smithi110 ceph-mon[30548]: Generating ssh key... 2024-09-12T02:04:24.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:24 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:24.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:24 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:25.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW90JcbPTu4OXHy4V42pO6DE+hi+mFMKUUj3KD3JYrPRGXj2/FVIYJqfiuOyORFVi7QXUBQVFCTKNwFS696nE0rJv5Qidv0SQRhryk8eRPxq/SJZQ8KKGfMox/QsNh5M2Ebn5eKeeU1ME6N86HBQoYUPkjDWDtmSogz8iorr4is+OvUb4Vki9CP2vP7MV8cs7vyuvGyPRSmUA/GEmceiaXfF+xWxZUWQWxE2zDfspzp0m4y4ypAhNmP/VYaoXZ0kwDJL2yVdwGt0K5Uc4di0wwECnrqu+/MeKLt0ENAZy+U2iD04Iuy5/uRz8PGxsnzZ4kqZIFtIFnBICevxN9LiLl/Fpg0ICU7746po+jVoyNqhUSzfzlWuv2VgaMAwTh/cbj6JbZZySfUY5gsy67RmEmc1o/GfP5TVO/HkVH4Glkkg1rmnqa3gVl1ca8cprKht5GC3zrW9vn+GtCpWjsaKcxN8fnic6xcVBuCWsDbuH0zMy3vnKaKj3hNkaQcCDlP10= ceph-10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:04:25.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.396+0000 7f885ce00640 1 Processor -- start 2024-09-12T02:04:25.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.396+0000 7f885ce00640 1 -- start start 2024-09-12T02:04:25.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.397+0000 7f885ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 0x7f8858109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:25.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.397+0000 7f885ce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f885810a1e0 con 0x7f8858109810 2024-09-12T02:04:25.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.397+0000 7f8855e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 0x7f8858109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:25.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.397+0000 7f8855e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 0x7f8858109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39442/0 (socket says 172.21.15.110:39442) 2024-09-12T02:04:25.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.397+0000 7f8855e00640 1 -- 172.21.15.110:0/2456971165 learned_addr learned my addr 172.21.15.110:0/2456971165 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:25.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.397+0000 7f8855e00640 1 -- 172.21.15.110:0/2456971165 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885810a950 con 0x7f8858109810 2024-09-12T02:04:25.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.398+0000 7f8855e00640 1 --2- 172.21.15.110:0/2456971165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 0x7f8858109c10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8848009e80 tx=0x7f884802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712c8030fc77dd7f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:25.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.399+0000 7f8854a00640 1 -- 172.21.15.110:0/2456971165 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8848036070 con 0x7f8858109810 2024-09-12T02:04:25.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.399+0000 7f8854a00640 1 -- 172.21.15.110:0/2456971165 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88480318c0 con 0x7f8858109810 2024-09-12T02:04:25.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.399+0000 7f8854a00640 1 -- 172.21.15.110:0/2456971165 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8848007ab0 con 0x7f8858109810 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.399+0000 7f885ce00640 1 -- 172.21.15.110:0/2456971165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 msgr2=0x7f8858109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.399+0000 7f885ce00640 1 --2- 172.21.15.110:0/2456971165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 0x7f8858109c10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8848009e80 tx=0x7f884802a7a0 comp rx=0 tx=0).stop 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.399+0000 7f885ce00640 1 -- 172.21.15.110:0/2456971165 shutdown_connections 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.399+0000 7f885ce00640 1 --2- 172.21.15.110:0/2456971165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 0x7f8858109c10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.399+0000 7f885ce00640 1 -- 172.21.15.110:0/2456971165 >> 172.21.15.110:0/2456971165 conn(0x7f885807ccf0 msgr2=0x7f885807d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.399+0000 7f885ce00640 1 -- 172.21.15.110:0/2456971165 shutdown_connections 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.399+0000 7f885ce00640 1 -- 172.21.15.110:0/2456971165 wait complete. 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.400+0000 7f885ce00640 1 Processor -- start 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.400+0000 7f885ce00640 1 -- start start 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.401+0000 7f885ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 0x7f885819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.401+0000 7f885ce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f885810dd00 con 0x7f8858109810 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.401+0000 7f8855e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 0x7f885819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.401+0000 7f8855e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 0x7f885819d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39454/0 (socket says 172.21.15.110:39454) 2024-09-12T02:04:25.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.401+0000 7f8855e00640 1 -- 172.21.15.110:0/2571993770 learned_addr learned my addr 172.21.15.110:0/2571993770 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.401+0000 7f8855e00640 1 -- 172.21.15.110:0/2571993770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885819dd10 con 0x7f8858109810 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.401+0000 7f8855e00640 1 --2- 172.21.15.110:0/2571993770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 0x7f885819d7d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8848009e50 tx=0x7f8848031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.402+0000 7f884ea00640 1 -- 172.21.15.110:0/2571993770 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8848036050 con 0x7f8858109810 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.402+0000 7f884ea00640 1 -- 172.21.15.110:0/2571993770 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8848042070 con 0x7f8858109810 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.402+0000 7f884ea00640 1 -- 172.21.15.110:0/2571993770 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f884803d8e0 con 0x7f8858109810 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.402+0000 7f885ce00640 1 -- 172.21.15.110:0/2571993770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885819dfa0 con 0x7f8858109810 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.402+0000 7f885ce00640 1 -- 172.21.15.110:0/2571993770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88581a0c90 con 0x7f8858109810 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.403+0000 7f884ea00640 1 -- 172.21.15.110:0/2571993770 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f884803b610 con 0x7f8858109810 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.403+0000 7f885ce00640 1 -- 172.21.15.110:0/2571993770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8858109c10 con 0x7f8858109810 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.403+0000 7f884ea00640 1 --2- 172.21.15.110:0/2571993770 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f883c038fc0 0x7f883c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.403+0000 7f884ea00640 1 -- 172.21.15.110:0/2571993770 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f884806d330 con 0x7f8858109810 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.404+0000 7f8855400640 1 --2- 172.21.15.110:0/2571993770 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f883c038fc0 0x7f883c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:25.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.404+0000 7f8855400640 1 --2- 172.21.15.110:0/2571993770 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f883c038fc0 0x7f883c03b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88440098c0 tx=0x7f8844006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:25.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.409+0000 7f884ea00640 1 -- 172.21.15.110:0/2571993770 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8848042220 con 0x7f8858109810 2024-09-12T02:04:25.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.583+0000 7f885ce00640 1 -- 172.21.15.110:0/2571993770 --> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f8858107be0 con 0x7f883c038fc0 2024-09-12T02:04:25.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.583+0000 7f884ea00640 1 -- 172.21.15.110:0/2571993770 <== mgr.14118 v2:172.21.15.110:6800/3137576010 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f8858107be0 con 0x7f883c038fc0 2024-09-12T02:04:25.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.585+0000 7f885ce00640 1 -- 172.21.15.110:0/2571993770 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f883c038fc0 msgr2=0x7f883c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:25.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.585+0000 7f885ce00640 1 --2- 172.21.15.110:0/2571993770 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f883c038fc0 0x7f883c03b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f88440098c0 tx=0x7f8844006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:25.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.585+0000 7f885ce00640 1 -- 172.21.15.110:0/2571993770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 msgr2=0x7f885819d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:25.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.585+0000 7f885ce00640 1 --2- 172.21.15.110:0/2571993770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 0x7f885819d7d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8848009e50 tx=0x7f8848031ca0 comp rx=0 tx=0).stop 2024-09-12T02:04:25.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.586+0000 7f885ce00640 1 -- 172.21.15.110:0/2571993770 shutdown_connections 2024-09-12T02:04:25.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.586+0000 7f885ce00640 1 --2- 172.21.15.110:0/2571993770 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f883c038fc0 0x7f883c03b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:25.286 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.586+0000 7f885ce00640 1 --2- 172.21.15.110:0/2571993770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8858109810 0x7f885819d7d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:25.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.586+0000 7f885ce00640 1 -- 172.21.15.110:0/2571993770 >> 172.21.15.110:0/2571993770 conn(0x7f885807ccf0 msgr2=0x7f88581074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:25.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.586+0000 7f885ce00640 1 -- 172.21.15.110:0/2571993770 shutdown_connections 2024-09-12T02:04:25.287 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:24.586+0000 7f885ce00640 1 -- 172.21.15.110:0/2571993770 wait complete. 2024-09-12T02:04:25.287 INFO:teuthology.orchestra.run.smithi110.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:04:25.287 INFO:teuthology.orchestra.run.smithi110.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T02:04:25.287 INFO:teuthology.orchestra.run.smithi110.stdout:Adding host smithi110... 2024-09-12T02:04:25.593 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:25 smithi110 ceph-mon[30548]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:26.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:26 smithi110 ceph-mon[30548]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi110", "addr": "172.21.15.110", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:27.612 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:27 smithi110 ceph-mon[30548]: Deploying cephadm binary to smithi110 2024-09-12T02:04:30.600 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Added host 'smithi110' with addr '172.21.15.110' 2024-09-12T02:04:30.601 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.822+0000 7f05d8c00640 1 Processor -- start 2024-09-12T02:04:30.605 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.822+0000 7f05d8c00640 1 -- start start 2024-09-12T02:04:30.605 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.822+0000 7f05d8c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 0x7f05d407b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:30.605 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.822+0000 7f05d8c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f05d407b690 con 0x7f05d407ccf0 2024-09-12T02:04:30.605 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.822+0000 7f05d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 0x7f05d407b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:30.605 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.823+0000 7f05d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 0x7f05d407b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39458/0 (socket says 172.21.15.110:39458) 2024-09-12T02:04:30.605 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.823+0000 7f05d3400640 1 -- 172.21.15.110:0/3200720826 learned_addr learned my addr 172.21.15.110:0/3200720826 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:30.606 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.823+0000 7f05d3400640 1 -- 172.21.15.110:0/3200720826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d407b810 con 0x7f05d407ccf0 2024-09-12T02:04:30.606 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.824+0000 7f05d3400640 1 --2- 172.21.15.110:0/3200720826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 0x7f05d407b150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f05c4009820 tx=0x7f05c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bdf0f53136a4fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:30.606 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.824+0000 7f05d2000640 1 -- 172.21.15.110:0/3200720826 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c4037070 con 0x7f05d407ccf0 2024-09-12T02:04:30.606 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.824+0000 7f05d2000640 1 -- 172.21.15.110:0/3200720826 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05c4032900 con 0x7f05d407ccf0 2024-09-12T02:04:30.606 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.824+0000 7f05d2000640 1 -- 172.21.15.110:0/3200720826 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c4030850 con 0x7f05d407ccf0 2024-09-12T02:04:30.606 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.825+0000 7f05d8c00640 1 -- 172.21.15.110:0/3200720826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 msgr2=0x7f05d407b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:30.606 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.825+0000 7f05d8c00640 1 --2- 172.21.15.110:0/3200720826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 0x7f05d407b150 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f05c4009820 tx=0x7f05c402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:30.606 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.825+0000 7f05d8c00640 1 -- 172.21.15.110:0/3200720826 shutdown_connections 2024-09-12T02:04:30.606 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.825+0000 7f05d8c00640 1 --2- 172.21.15.110:0/3200720826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 0x7f05d407b150 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:30.606 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.825+0000 7f05d8c00640 1 -- 172.21.15.110:0/3200720826 >> 172.21.15.110:0/3200720826 conn(0x7f05d4102b90 msgr2=0x7f05d4104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:30.606 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.825+0000 7f05d8c00640 1 -- 172.21.15.110:0/3200720826 shutdown_connections 2024-09-12T02:04:30.607 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.825+0000 7f05d8c00640 1 -- 172.21.15.110:0/3200720826 wait complete. 2024-09-12T02:04:30.607 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.826+0000 7f05d8c00640 1 Processor -- start 2024-09-12T02:04:30.607 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.826+0000 7f05d8c00640 1 -- start start 2024-09-12T02:04:30.607 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.826+0000 7f05d8c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 0x7f05d419d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:30.607 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.826+0000 7f05d8c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f05d410d9f0 con 0x7f05d407ccf0 2024-09-12T02:04:30.607 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.827+0000 7f05d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 0x7f05d419d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:30.607 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.827+0000 7f05d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 0x7f05d419d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39474/0 (socket says 172.21.15.110:39474) 2024-09-12T02:04:30.607 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.827+0000 7f05d3400640 1 -- 172.21.15.110:0/2902092756 learned_addr learned my addr 172.21.15.110:0/2902092756 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:30.607 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.827+0000 7f05d3400640 1 -- 172.21.15.110:0/2902092756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d419da80 con 0x7f05d407ccf0 2024-09-12T02:04:30.607 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.827+0000 7f05d3400640 1 --2- 172.21.15.110:0/2902092756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 0x7f05d419d540 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f05c40097f0 tx=0x7f05c4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:30.608 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.828+0000 7f05cbe00640 1 -- 172.21.15.110:0/2902092756 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c4037040 con 0x7f05d407ccf0 2024-09-12T02:04:30.608 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.828+0000 7f05cbe00640 1 -- 172.21.15.110:0/2902092756 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05c4040070 con 0x7f05d407ccf0 2024-09-12T02:04:30.608 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.828+0000 7f05cbe00640 1 -- 172.21.15.110:0/2902092756 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c403a390 con 0x7f05d407ccf0 2024-09-12T02:04:30.608 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.828+0000 7f05d8c00640 1 -- 172.21.15.110:0/2902092756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d419dd10 con 0x7f05d407ccf0 2024-09-12T02:04:30.608 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.828+0000 7f05d8c00640 1 -- 172.21.15.110:0/2902092756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d41a0a00 con 0x7f05d407ccf0 2024-09-12T02:04:30.608 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.829+0000 7f05d8c00640 1 -- 172.21.15.110:0/2902092756 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d407b1d0 con 0x7f05d407ccf0 2024-09-12T02:04:30.608 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.829+0000 7f05cbe00640 1 -- 172.21.15.110:0/2902092756 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f05c403b430 con 0x7f05d407ccf0 2024-09-12T02:04:30.608 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.830+0000 7f05cbe00640 1 --2- 172.21.15.110:0/2902092756 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f05b8038fc0 0x7f05b803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:30.608 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.830+0000 7f05cbe00640 1 -- 172.21.15.110:0/2902092756 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f05c406c500 con 0x7f05d407ccf0 2024-09-12T02:04:30.608 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.830+0000 7f05d2a00640 1 --2- 172.21.15.110:0/2902092756 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f05b8038fc0 0x7f05b803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:30.608 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.831+0000 7f05d2a00640 1 --2- 172.21.15.110:0/2902092756 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f05b8038fc0 0x7f05b803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f05c00098c0 tx=0x7f05c0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:30.608 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:25.835+0000 7f05cbe00640 1 -- 172.21.15.110:0/2902092756 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05c40371e0 con 0x7f05d407ccf0 2024-09-12T02:04:30.609 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:26.021+0000 7f05d8c00640 1 -- 172.21.15.110:0/2902092756 --> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi110", "addr": "172.21.15.110", "target": ["mon-mgr", ""]}) -- 0x7f05d4103db0 con 0x7f05b8038fc0 2024-09-12T02:04:30.609 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:29.918+0000 7f05cbe00640 1 -- 172.21.15.110:0/2902092756 <== mgr.14118 v2:172.21.15.110:6800/3137576010 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f05d4103db0 con 0x7f05b8038fc0 2024-09-12T02:04:30.609 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:29.921+0000 7f05d8c00640 1 -- 172.21.15.110:0/2902092756 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f05b8038fc0 msgr2=0x7f05b803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:30.609 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:29.921+0000 7f05d8c00640 1 --2- 172.21.15.110:0/2902092756 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f05b8038fc0 0x7f05b803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f05c00098c0 tx=0x7f05c0006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:30.609 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:29.921+0000 7f05d8c00640 1 -- 172.21.15.110:0/2902092756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 msgr2=0x7f05d419d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:30.609 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:29.921+0000 7f05d8c00640 1 --2- 172.21.15.110:0/2902092756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 0x7f05d419d540 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f05c40097f0 tx=0x7f05c4030d80 comp rx=0 tx=0).stop 2024-09-12T02:04:30.609 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:29.921+0000 7f05d8c00640 1 -- 172.21.15.110:0/2902092756 shutdown_connections 2024-09-12T02:04:30.609 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:29.921+0000 7f05d8c00640 1 --2- 172.21.15.110:0/2902092756 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f05b8038fc0 0x7f05b803b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:30.609 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:29.921+0000 7f05d8c00640 1 --2- 172.21.15.110:0/2902092756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05d407ccf0 0x7f05d419d540 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:30.609 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:29.921+0000 7f05d8c00640 1 -- 172.21.15.110:0/2902092756 >> 172.21.15.110:0/2902092756 conn(0x7f05d4102b90 msgr2=0x7f05d41036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:30.609 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:29.921+0000 7f05d8c00640 1 -- 172.21.15.110:0/2902092756 shutdown_connections 2024-09-12T02:04:30.610 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:29.921+0000 7f05d8c00640 1 -- 172.21.15.110:0/2902092756 wait complete. 2024-09-12T02:04:30.610 INFO:teuthology.orchestra.run.smithi110.stdout:Deploying unmanaged mon service... 2024-09-12T02:04:31.126 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:30 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:31.126 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:30 smithi110 ceph-mon[30548]: Added host smithi110 2024-09-12T02:04:31.126 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:30 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:32.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T02:04:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.231+0000 7f26b1600640 1 Processor -- start 2024-09-12T02:04:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.231+0000 7f26b1600640 1 -- start start 2024-09-12T02:04:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.231+0000 7f26b1600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 0x7f26ac109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.231+0000 7f26b1600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac10a1e0 con 0x7f26ac109810 2024-09-12T02:04:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.232+0000 7f26aaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 0x7f26ac109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.232+0000 7f26aaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 0x7f26ac109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55068/0 (socket says 172.21.15.110:55068) 2024-09-12T02:04:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.232+0000 7f26aaa00640 1 -- 172.21.15.110:0/3958096926 learned_addr learned my addr 172.21.15.110:0/3958096926 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.232+0000 7f26aaa00640 1 -- 172.21.15.110:0/3958096926 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac10a950 con 0x7f26ac109810 2024-09-12T02:04:32.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.233+0000 7f26aaa00640 1 --2- 172.21.15.110:0/3958096926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 0x7f26ac109c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f269c009820 tx=0x7f269c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d84c660ba0fcbd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.233+0000 7f26a9600640 1 -- 172.21.15.110:0/3958096926 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c037070 con 0x7f26ac109810 2024-09-12T02:04:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.233+0000 7f26a9600640 1 -- 172.21.15.110:0/3958096926 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f269c032900 con 0x7f26ac109810 2024-09-12T02:04:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.233+0000 7f26a9600640 1 -- 172.21.15.110:0/3958096926 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c030850 con 0x7f26ac109810 2024-09-12T02:04:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.234+0000 7f26b1600640 1 -- 172.21.15.110:0/3958096926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 msgr2=0x7f26ac109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.234+0000 7f26b1600640 1 --2- 172.21.15.110:0/3958096926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 0x7f26ac109c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f269c009820 tx=0x7f269c02a270 comp rx=0 tx=0).stop 2024-09-12T02:04:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.234+0000 7f26b1600640 1 -- 172.21.15.110:0/3958096926 shutdown_connections 2024-09-12T02:04:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.234+0000 7f26b1600640 1 --2- 172.21.15.110:0/3958096926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 0x7f26ac109c10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.234+0000 7f26b1600640 1 -- 172.21.15.110:0/3958096926 >> 172.21.15.110:0/3958096926 conn(0x7f26ac07ccf0 msgr2=0x7f26ac07d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.234+0000 7f26b1600640 1 -- 172.21.15.110:0/3958096926 shutdown_connections 2024-09-12T02:04:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.234+0000 7f26b1600640 1 -- 172.21.15.110:0/3958096926 wait complete. 2024-09-12T02:04:32.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.235+0000 7f26b1600640 1 Processor -- start 2024-09-12T02:04:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.235+0000 7f26b1600640 1 -- start start 2024-09-12T02:04:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.235+0000 7f26b1600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 0x7f26ac19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.235+0000 7f26b1600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac10dd00 con 0x7f26ac109810 2024-09-12T02:04:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.236+0000 7f26aaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 0x7f26ac19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.236+0000 7f26aaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 0x7f26ac19d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55078/0 (socket says 172.21.15.110:55078) 2024-09-12T02:04:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.236+0000 7f26aaa00640 1 -- 172.21.15.110:0/1584288992 learned_addr learned my addr 172.21.15.110:0/1584288992 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.236+0000 7f26aaa00640 1 -- 172.21.15.110:0/1584288992 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac19dd10 con 0x7f26ac109810 2024-09-12T02:04:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.236+0000 7f26aaa00640 1 --2- 172.21.15.110:0/1584288992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 0x7f26ac19d7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f269c009940 tx=0x7f269c0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.236+0000 7f26a3400640 1 -- 172.21.15.110:0/1584288992 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c042070 con 0x7f26ac109810 2024-09-12T02:04:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.237+0000 7f26a3400640 1 -- 172.21.15.110:0/1584288992 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f269c032be0 con 0x7f26ac109810 2024-09-12T02:04:32.331 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.237+0000 7f26b1600640 1 -- 172.21.15.110:0/1584288992 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ac19dfa0 con 0x7f26ac109810 2024-09-12T02:04:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.237+0000 7f26a3400640 1 -- 172.21.15.110:0/1584288992 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f269c037040 con 0x7f26ac109810 2024-09-12T02:04:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.237+0000 7f26b1600640 1 -- 172.21.15.110:0/1584288992 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ac1a0c90 con 0x7f26ac109810 2024-09-12T02:04:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.238+0000 7f26a3400640 1 -- 172.21.15.110:0/1584288992 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f269c045070 con 0x7f26ac109810 2024-09-12T02:04:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.238+0000 7f26b1600640 1 -- 172.21.15.110:0/1584288992 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26ac109c10 con 0x7f26ac109810 2024-09-12T02:04:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.238+0000 7f26a3400640 1 --2- 172.21.15.110:0/1584288992 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f2690038f70 0x7f269003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.238+0000 7f26a3400640 1 -- 172.21.15.110:0/1584288992 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f269c06bfb0 con 0x7f26ac109810 2024-09-12T02:04:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.238+0000 7f26aa000640 1 --2- 172.21.15.110:0/1584288992 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f2690038f70 0x7f269003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.239+0000 7f26aa000640 1 --2- 172.21.15.110:0/1584288992 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f2690038f70 0x7f269003b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f26980098c0 tx=0x7f2698006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.248+0000 7f26a3400640 1 -- 172.21.15.110:0/1584288992 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f269c04b170 con 0x7f26ac109810 2024-09-12T02:04:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.462+0000 7f26b1600640 1 -- 172.21.15.110:0/1584288992 --> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f26ac107be0 con 0x7f2690038f70 2024-09-12T02:04:32.332 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.467+0000 7f26a3400640 1 -- 172.21.15.110:0/1584288992 <== mgr.14118 v2:172.21.15.110:6800/3137576010 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f26ac107be0 con 0x7f2690038f70 2024-09-12T02:04:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.470+0000 7f26b1600640 1 -- 172.21.15.110:0/1584288992 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f2690038f70 msgr2=0x7f269003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.470+0000 7f26b1600640 1 --2- 172.21.15.110:0/1584288992 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f2690038f70 0x7f269003b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f26980098c0 tx=0x7f2698006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.470+0000 7f26b1600640 1 -- 172.21.15.110:0/1584288992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 msgr2=0x7f26ac19d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.470+0000 7f26b1600640 1 --2- 172.21.15.110:0/1584288992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 0x7f26ac19d7d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f269c009940 tx=0x7f269c0326e0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.470+0000 7f26b1600640 1 -- 172.21.15.110:0/1584288992 shutdown_connections 2024-09-12T02:04:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.470+0000 7f26b1600640 1 --2- 172.21.15.110:0/1584288992 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f2690038f70 0x7f269003b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.470+0000 7f26b1600640 1 --2- 172.21.15.110:0/1584288992 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ac109810 0x7f26ac19d7d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.470+0000 7f26b1600640 1 -- 172.21.15.110:0/1584288992 >> 172.21.15.110:0/1584288992 conn(0x7f26ac07ccf0 msgr2=0x7f26ac1074d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.470+0000 7f26b1600640 1 -- 172.21.15.110:0/1584288992 shutdown_connections 2024-09-12T02:04:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:31.470+0000 7f26b1600640 1 -- 172.21.15.110:0/1584288992 wait complete. 2024-09-12T02:04:32.333 INFO:teuthology.orchestra.run.smithi110.stdout:Deploying unmanaged mgr service... 2024-09-12T02:04:32.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:32 smithi110 ceph-mon[30548]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:32.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:32 smithi110 ceph-mon[30548]: Saving service mon spec with placement count:5 2024-09-12T02:04:32.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:32 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:34.403 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:34 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:34.403 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:34 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:34.403 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:34 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:34.703 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T02:04:34.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.762+0000 7f2d63c00640 1 Processor -- start 2024-09-12T02:04:34.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.762+0000 7f2d63c00640 1 -- start start 2024-09-12T02:04:34.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.763+0000 7f2d63c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 0x7f2d5c109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.763+0000 7f2d63c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c10a1e0 con 0x7f2d5c109810 2024-09-12T02:04:34.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.763+0000 7f2d61200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 0x7f2d5c109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.763+0000 7f2d61200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 0x7f2d5c109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55088/0 (socket says 172.21.15.110:55088) 2024-09-12T02:04:34.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.763+0000 7f2d61200640 1 -- 172.21.15.110:0/2269018733 learned_addr learned my addr 172.21.15.110:0/2269018733 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:34.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.763+0000 7f2d61200640 1 -- 172.21.15.110:0/2269018733 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c10a950 con 0x7f2d5c109810 2024-09-12T02:04:34.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.764+0000 7f2d61200640 1 --2- 172.21.15.110:0/2269018733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 0x7f2d5c109c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009820 tx=0x7f2d5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5a466842213c1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:34.704 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.765+0000 7f2d5b400640 1 -- 172.21.15.110:0/2269018733 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d50037070 con 0x7f2d5c109810 2024-09-12T02:04:34.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.765+0000 7f2d5b400640 1 -- 172.21.15.110:0/2269018733 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d50032920 con 0x7f2d5c109810 2024-09-12T02:04:34.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.765+0000 7f2d5b400640 1 -- 172.21.15.110:0/2269018733 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d50030810 con 0x7f2d5c109810 2024-09-12T02:04:34.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.765+0000 7f2d63c00640 1 -- 172.21.15.110:0/2269018733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 msgr2=0x7f2d5c109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.765+0000 7f2d63c00640 1 --2- 172.21.15.110:0/2269018733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 0x7f2d5c109c10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009820 tx=0x7f2d5002a270 comp rx=0 tx=0).stop 2024-09-12T02:04:34.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.766+0000 7f2d63c00640 1 -- 172.21.15.110:0/2269018733 shutdown_connections 2024-09-12T02:04:34.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.766+0000 7f2d63c00640 1 --2- 172.21.15.110:0/2269018733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 0x7f2d5c109c10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.766+0000 7f2d63c00640 1 -- 172.21.15.110:0/2269018733 >> 172.21.15.110:0/2269018733 conn(0x7f2d5c07ccf0 msgr2=0x7f2d5c07d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:34.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.766+0000 7f2d63c00640 1 -- 172.21.15.110:0/2269018733 shutdown_connections 2024-09-12T02:04:34.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.766+0000 7f2d63c00640 1 -- 172.21.15.110:0/2269018733 wait complete. 2024-09-12T02:04:34.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.767+0000 7f2d63c00640 1 Processor -- start 2024-09-12T02:04:34.705 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.767+0000 7f2d63c00640 1 -- start start 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.767+0000 7f2d63c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 0x7f2d5c19d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.767+0000 7f2d63c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c10dd00 con 0x7f2d5c109810 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.768+0000 7f2d61200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 0x7f2d5c19d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.768+0000 7f2d61200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 0x7f2d5c19d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55104/0 (socket says 172.21.15.110:55104) 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.768+0000 7f2d61200640 1 -- 172.21.15.110:0/617401000 learned_addr learned my addr 172.21.15.110:0/617401000 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.768+0000 7f2d61200640 1 -- 172.21.15.110:0/617401000 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c19dcf0 con 0x7f2d5c109810 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.769+0000 7f2d61200640 1 --2- 172.21.15.110:0/617401000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 0x7f2d5c19d7b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d50030420 tx=0x7f2d50032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.769+0000 7f2d59600640 1 -- 172.21.15.110:0/617401000 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d50037040 con 0x7f2d5c109810 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.769+0000 7f2d59600640 1 -- 172.21.15.110:0/617401000 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d50040070 con 0x7f2d5c109810 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.769+0000 7f2d63c00640 1 -- 172.21.15.110:0/617401000 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5c19df80 con 0x7f2d5c109810 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.769+0000 7f2d59600640 1 -- 172.21.15.110:0/617401000 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d5003a6e0 con 0x7f2d5c109810 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.769+0000 7f2d63c00640 1 -- 172.21.15.110:0/617401000 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d5c1a0c70 con 0x7f2d5c109810 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.770+0000 7f2d59600640 1 -- 172.21.15.110:0/617401000 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f2d5003a990 con 0x7f2d5c109810 2024-09-12T02:04:34.706 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.770+0000 7f2d63c00640 1 -- 172.21.15.110:0/617401000 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d5c109c90 con 0x7f2d5c109810 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.771+0000 7f2d59600640 1 --2- 172.21.15.110:0/617401000 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f2d44038fc0 0x7f2d4403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.771+0000 7f2d59600640 1 -- 172.21.15.110:0/617401000 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2d5006c580 con 0x7f2d5c109810 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.771+0000 7f2d5be00640 1 --2- 172.21.15.110:0/617401000 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f2d44038fc0 0x7f2d4403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.772+0000 7f2d5be00640 1 --2- 172.21.15.110:0/617401000 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f2d44038fc0 0x7f2d4403b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2d480098c0 tx=0x7f2d48006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.776+0000 7f2d59600640 1 -- 172.21.15.110:0/617401000 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d50044c70 con 0x7f2d5c109810 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.980+0000 7f2d63c00640 1 -- 172.21.15.110:0/617401000 --> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2d5c107c70 con 0x7f2d44038fc0 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.985+0000 7f2d59600640 1 -- 172.21.15.110:0/617401000 <== mgr.14118 v2:172.21.15.110:6800/3137576010 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2d5c107c70 con 0x7f2d44038fc0 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.988+0000 7f2d63c00640 1 -- 172.21.15.110:0/617401000 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f2d44038fc0 msgr2=0x7f2d4403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.988+0000 7f2d63c00640 1 --2- 172.21.15.110:0/617401000 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f2d44038fc0 0x7f2d4403b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2d480098c0 tx=0x7f2d48006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.988+0000 7f2d63c00640 1 -- 172.21.15.110:0/617401000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 msgr2=0x7f2d5c19d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.988+0000 7f2d63c00640 1 --2- 172.21.15.110:0/617401000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 0x7f2d5c19d7b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d50030420 tx=0x7f2d50032670 comp rx=0 tx=0).stop 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.988+0000 7f2d63c00640 1 -- 172.21.15.110:0/617401000 shutdown_connections 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.988+0000 7f2d63c00640 1 --2- 172.21.15.110:0/617401000 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f2d44038fc0 0x7f2d4403b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.707 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.988+0000 7f2d63c00640 1 --2- 172.21.15.110:0/617401000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d5c109810 0x7f2d5c19d7b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:34.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.988+0000 7f2d63c00640 1 -- 172.21.15.110:0/617401000 >> 172.21.15.110:0/617401000 conn(0x7f2d5c07ccf0 msgr2=0x7f2d5c107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:34.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.988+0000 7f2d63c00640 1 -- 172.21.15.110:0/617401000 shutdown_connections 2024-09-12T02:04:34.708 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:33.988+0000 7f2d63c00640 1 -- 172.21.15.110:0/617401000 wait complete. 2024-09-12T02:04:35.485 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:35 smithi110 ceph-mon[30548]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:35.485 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:35 smithi110 ceph-mon[30548]: Saving service mgr spec with placement count:2 2024-09-12T02:04:36.713 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:36 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1364327543' entity='client.admin' 2024-09-12T02:04:36.713 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:36 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:36.723 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.227+0000 7f4afe200640 1 Processor -- start 2024-09-12T02:04:36.723 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.227+0000 7f4afe200640 1 -- start start 2024-09-12T02:04:36.723 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.227+0000 7f4afe200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 0x7f4af8107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.723 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.227+0000 7f4afe200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8107f00 con 0x7f4af8107530 2024-09-12T02:04:36.723 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.228+0000 7f4af7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 0x7f4af8107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.723 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.228+0000 7f4af7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 0x7f4af8107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55118/0 (socket says 172.21.15.110:55118) 2024-09-12T02:04:36.723 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.228+0000 7f4af7400640 1 -- 172.21.15.110:0/907060128 learned_addr learned my addr 172.21.15.110:0/907060128 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:36.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.228+0000 7f4af7400640 1 -- 172.21.15.110:0/907060128 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af8108730 con 0x7f4af8107530 2024-09-12T02:04:36.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.229+0000 7f4af7400640 1 --2- 172.21.15.110:0/907060128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 0x7f4af8107930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009820 tx=0x7f4ae802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb5fbb7826afdcd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:36.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.229+0000 7f4af6a00640 1 -- 172.21.15.110:0/907060128 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae8037070 con 0x7f4af8107530 2024-09-12T02:04:36.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.229+0000 7f4af6a00640 1 -- 172.21.15.110:0/907060128 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae8032920 con 0x7f4af8107530 2024-09-12T02:04:36.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.229+0000 7f4af6a00640 1 -- 172.21.15.110:0/907060128 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae8030810 con 0x7f4af8107530 2024-09-12T02:04:36.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.230+0000 7f4afe200640 1 -- 172.21.15.110:0/907060128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 msgr2=0x7f4af8107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:36.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.230+0000 7f4afe200640 1 --2- 172.21.15.110:0/907060128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 0x7f4af8107930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009820 tx=0x7f4ae802a270 comp rx=0 tx=0).stop 2024-09-12T02:04:36.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.230+0000 7f4afe200640 1 -- 172.21.15.110:0/907060128 shutdown_connections 2024-09-12T02:04:36.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.230+0000 7f4afe200640 1 --2- 172.21.15.110:0/907060128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 0x7f4af8107930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.230+0000 7f4afe200640 1 -- 172.21.15.110:0/907060128 >> 172.21.15.110:0/907060128 conn(0x7f4af8102d20 msgr2=0x7f4af8105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:36.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.230+0000 7f4afe200640 1 -- 172.21.15.110:0/907060128 shutdown_connections 2024-09-12T02:04:36.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.230+0000 7f4afe200640 1 -- 172.21.15.110:0/907060128 wait complete. 2024-09-12T02:04:36.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.231+0000 7f4afe200640 1 Processor -- start 2024-09-12T02:04:36.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.231+0000 7f4afe200640 1 -- start start 2024-09-12T02:04:36.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.232+0000 7f4afe200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 0x7f4af807ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.232+0000 7f4afe200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4af810bae0 con 0x7f4af8107530 2024-09-12T02:04:36.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.232+0000 7f4af7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 0x7f4af807ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.232+0000 7f4af7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 0x7f4af807ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55124/0 (socket says 172.21.15.110:55124) 2024-09-12T02:04:36.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.232+0000 7f4af7400640 1 -- 172.21.15.110:0/1364327543 learned_addr learned my addr 172.21.15.110:0/1364327543 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:36.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.232+0000 7f4af7400640 1 -- 172.21.15.110:0/1364327543 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af807cf40 con 0x7f4af8107530 2024-09-12T02:04:36.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.233+0000 7f4af7400640 1 --2- 172.21.15.110:0/1364327543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 0x7f4af807ca00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80097f0 tx=0x7f4ae80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:36.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.233+0000 7f4af4c00640 1 -- 172.21.15.110:0/1364327543 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae8037040 con 0x7f4af8107530 2024-09-12T02:04:36.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.233+0000 7f4afe200640 1 -- 172.21.15.110:0/1364327543 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af807b130 con 0x7f4af8107530 2024-09-12T02:04:36.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.233+0000 7f4af4c00640 1 -- 172.21.15.110:0/1364327543 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae8030cc0 con 0x7f4af8107530 2024-09-12T02:04:36.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.233+0000 7f4af4c00640 1 -- 172.21.15.110:0/1364327543 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae803a640 con 0x7f4af8107530 2024-09-12T02:04:36.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.233+0000 7f4afe200640 1 -- 172.21.15.110:0/1364327543 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af807b670 con 0x7f4af8107530 2024-09-12T02:04:36.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.234+0000 7f4af4c00640 1 -- 172.21.15.110:0/1364327543 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4ae803a940 con 0x7f4af8107530 2024-09-12T02:04:36.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.235+0000 7f4afe200640 1 -- 172.21.15.110:0/1364327543 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af810bc60 con 0x7f4af8107530 2024-09-12T02:04:36.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.235+0000 7f4af4c00640 1 --2- 172.21.15.110:0/1364327543 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f4adc038f70 0x7f4adc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:36.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.235+0000 7f4af4c00640 1 -- 172.21.15.110:0/1364327543 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4ae806c5e0 con 0x7f4af8107530 2024-09-12T02:04:36.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.235+0000 7f4aefe00640 1 --2- 172.21.15.110:0/1364327543 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f4adc038f70 0x7f4adc03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:36.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.236+0000 7f4aefe00640 1 --2- 172.21.15.110:0/1364327543 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f4adc038f70 0x7f4adc03b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00098c0 tx=0x7f4ae0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:36.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.241+0000 7f4af4c00640 1 -- 172.21.15.110:0/1364327543 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ae806bf30 con 0x7f4af8107530 2024-09-12T02:04:36.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.466+0000 7f4afe200640 1 -- 172.21.15.110:0/1364327543 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f4af81079b0 con 0x7f4af8107530 2024-09-12T02:04:36.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.469+0000 7f4af4c00640 1 -- 172.21.15.110:0/1364327543 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f4ae803ba40 con 0x7f4af8107530 2024-09-12T02:04:36.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.471+0000 7f4afe200640 1 -- 172.21.15.110:0/1364327543 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f4adc038f70 msgr2=0x7f4adc03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:36.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.471+0000 7f4afe200640 1 --2- 172.21.15.110:0/1364327543 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f4adc038f70 0x7f4adc03b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00098c0 tx=0x7f4ae0006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.471+0000 7f4afe200640 1 -- 172.21.15.110:0/1364327543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 msgr2=0x7f4af807ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:36.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.471+0000 7f4afe200640 1 --2- 172.21.15.110:0/1364327543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 0x7f4af807ca00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80097f0 tx=0x7f4ae80327b0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.471+0000 7f4afe200640 1 -- 172.21.15.110:0/1364327543 shutdown_connections 2024-09-12T02:04:36.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.471+0000 7f4afe200640 1 --2- 172.21.15.110:0/1364327543 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f4adc038f70 0x7f4adc03b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.471+0000 7f4afe200640 1 --2- 172.21.15.110:0/1364327543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4af8107530 0x7f4af807ca00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:36.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.471+0000 7f4afe200640 1 -- 172.21.15.110:0/1364327543 >> 172.21.15.110:0/1364327543 conn(0x7f4af8102d20 msgr2=0x7f4af8103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:36.728 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.472+0000 7f4afe200640 1 -- 172.21.15.110:0/1364327543 shutdown_connections 2024-09-12T02:04:36.728 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:35.472+0000 7f4afe200640 1 -- 172.21.15.110:0/1364327543 wait complete. 2024-09-12T02:04:38.179 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.271+0000 7f2597200640 1 Processor -- start 2024-09-12T02:04:38.180 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.271+0000 7f2597200640 1 -- start start 2024-09-12T02:04:38.180 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.272+0000 7f2597200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 0x7f2598107750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.180 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.272+0000 7f2597200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2598107d20 con 0x7f2598107350 2024-09-12T02:04:38.180 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.272+0000 7f2595e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 0x7f2598107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.180 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.272+0000 7f2595e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 0x7f2598107750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55130/0 (socket says 172.21.15.110:55130) 2024-09-12T02:04:38.180 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.272+0000 7f2595e00640 1 -- 172.21.15.110:0/226522030 learned_addr learned my addr 172.21.15.110:0/226522030 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:38.180 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.273+0000 7f2595e00640 1 -- 172.21.15.110:0/226522030 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2598108550 con 0x7f2598107350 2024-09-12T02:04:38.180 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.274+0000 7f2595e00640 1 --2- 172.21.15.110:0/226522030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 0x7f2598107750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2588009820 tx=0x7f258802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2cf8f6b666742c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:38.180 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.274+0000 7f2594a00640 1 -- 172.21.15.110:0/226522030 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2588037070 con 0x7f2598107350 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.274+0000 7f2594a00640 1 -- 172.21.15.110:0/226522030 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2588032920 con 0x7f2598107350 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.274+0000 7f2594a00640 1 -- 172.21.15.110:0/226522030 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2588030810 con 0x7f2598107350 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.275+0000 7f2597200640 1 -- 172.21.15.110:0/226522030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 msgr2=0x7f2598107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.275+0000 7f2597200640 1 --2- 172.21.15.110:0/226522030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 0x7f2598107750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2588009820 tx=0x7f258802a270 comp rx=0 tx=0).stop 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.275+0000 7f2597200640 1 -- 172.21.15.110:0/226522030 shutdown_connections 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.275+0000 7f2597200640 1 --2- 172.21.15.110:0/226522030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 0x7f2598107750 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.275+0000 7f2597200640 1 -- 172.21.15.110:0/226522030 >> 172.21.15.110:0/226522030 conn(0x7f2598102ae0 msgr2=0x7f2598104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.275+0000 7f2597200640 1 -- 172.21.15.110:0/226522030 shutdown_connections 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.275+0000 7f2597200640 1 -- 172.21.15.110:0/226522030 wait complete. 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.276+0000 7f2597200640 1 Processor -- start 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.276+0000 7f2597200640 1 -- start start 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.276+0000 7f2597200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 0x7f259819d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.276+0000 7f2597200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f259810b900 con 0x7f2598107350 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.276+0000 7f2595e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 0x7f259819d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.277+0000 7f2595e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 0x7f259819d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55144/0 (socket says 172.21.15.110:55144) 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.277+0000 7f2595e00640 1 -- 172.21.15.110:0/2042712956 learned_addr learned my addr 172.21.15.110:0/2042712956 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.277+0000 7f2595e00640 1 -- 172.21.15.110:0/2042712956 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259819db10 con 0x7f2598107350 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.277+0000 7f2595e00640 1 --2- 172.21.15.110:0/2042712956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 0x7f259819d5d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f25880097f0 tx=0x7f25880327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.277+0000 7f258ea00640 1 -- 172.21.15.110:0/2042712956 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2588037040 con 0x7f2598107350 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.277+0000 7f258ea00640 1 -- 172.21.15.110:0/2042712956 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2588030cc0 con 0x7f2598107350 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.277+0000 7f2597200640 1 -- 172.21.15.110:0/2042712956 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f259819dda0 con 0x7f2598107350 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.277+0000 7f258ea00640 1 -- 172.21.15.110:0/2042712956 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f258803a640 con 0x7f2598107350 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.278+0000 7f2597200640 1 -- 172.21.15.110:0/2042712956 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25981a0a90 con 0x7f2598107350 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.279+0000 7f258ea00640 1 -- 172.21.15.110:0/2042712956 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f258803b3f0 con 0x7f2598107350 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.279+0000 7f2597200640 1 -- 172.21.15.110:0/2042712956 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f259810ba80 con 0x7f2598107350 2024-09-12T02:04:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.279+0000 7f258ea00640 1 --2- 172.21.15.110:0/2042712956 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f257c038f70 0x7f257c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.279+0000 7f258ea00640 1 -- 172.21.15.110:0/2042712956 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f258806c5a0 con 0x7f2598107350 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.280+0000 7f2595400640 1 --2- 172.21.15.110:0/2042712956 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f257c038f70 0x7f257c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.280+0000 7f2595400640 1 --2- 172.21.15.110:0/2042712956 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f257c038f70 0x7f257c03b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f25840098c0 tx=0x7f2584006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.284+0000 7f258ea00640 1 -- 172.21.15.110:0/2042712956 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2588042e10 con 0x7f2598107350 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.469+0000 7f2597200640 1 -- 172.21.15.110:0/2042712956 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f25981077d0 con 0x7f2598107350 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.471+0000 7f258ea00640 1 -- 172.21.15.110:0/2042712956 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f258806bef0 con 0x7f2598107350 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.474+0000 7f2597200640 1 -- 172.21.15.110:0/2042712956 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f257c038f70 msgr2=0x7f257c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.474+0000 7f2597200640 1 --2- 172.21.15.110:0/2042712956 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f257c038f70 0x7f257c03b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f25840098c0 tx=0x7f2584006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.474+0000 7f2597200640 1 -- 172.21.15.110:0/2042712956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 msgr2=0x7f259819d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.474+0000 7f2597200640 1 --2- 172.21.15.110:0/2042712956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 0x7f259819d5d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f25880097f0 tx=0x7f25880327b0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.474+0000 7f2597200640 1 -- 172.21.15.110:0/2042712956 shutdown_connections 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.474+0000 7f2597200640 1 --2- 172.21.15.110:0/2042712956 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f257c038f70 0x7f257c03b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.183 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.474+0000 7f2597200640 1 --2- 172.21.15.110:0/2042712956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2598107350 0x7f259819d5d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:38.184 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.474+0000 7f2597200640 1 -- 172.21.15.110:0/2042712956 >> 172.21.15.110:0/2042712956 conn(0x7f2598102ae0 msgr2=0x7f2598103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:38.184 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.474+0000 7f2597200640 1 -- 172.21.15.110:0/2042712956 shutdown_connections 2024-09-12T02:04:38.184 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:37.474+0000 7f2597200640 1 -- 172.21.15.110:0/2042712956 wait complete. 2024-09-12T02:04:38.184 INFO:teuthology.orchestra.run.smithi110.stdout:Enabling the dashboard module... 2024-09-12T02:04:38.932 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:38 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2042712956' entity='client.admin' 2024-09-12T02:04:38.932 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:38 smithi110 ceph-mon[30548]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:04:38.932 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:38 smithi110 ceph-mon[30548]: from='mgr.14118 172.21.15.110:0/4282228454' entity='mgr.x' 2024-09-12T02:04:39.784 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:39 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1350267650' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T02:04:39.785 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:39 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: ignoring --setuser ceph since I am not root 2024-09-12T02:04:39.785 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:39 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: ignoring --setgroup ceph since I am not root 2024-09-12T02:04:39.785 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:39 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:39.714+0000 7fc6d9634040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:04:39.785 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:39 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:39.784+0000 7fc6d9634040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:04:40.048 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:39 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:39.969+0000 7fc6d9634040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:04:40.049 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:40 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:40.048+0000 7fc6d9634040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:04:40.302 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:40 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:40.220+0000 7fc6d9634040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:04:40.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.683+0000 7fd210200640 1 Processor -- start 2024-09-12T02:04:40.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.683+0000 7fd210200640 1 -- start start 2024-09-12T02:04:40.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.683+0000 7fd210200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 0x7fd208109c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.683+0000 7fd210200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd20810a1e0 con 0x7fd208109810 2024-09-12T02:04:40.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.684+0000 7fd20d800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 0x7fd208109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.684+0000 7fd20d800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 0x7fd208109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55154/0 (socket says 172.21.15.110:55154) 2024-09-12T02:04:40.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.684+0000 7fd20d800640 1 -- 172.21.15.110:0/3697103305 learned_addr learned my addr 172.21.15.110:0/3697103305 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:40.307 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.684+0000 7fd20d800640 1 -- 172.21.15.110:0/3697103305 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20810a950 con 0x7fd208109810 2024-09-12T02:04:40.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.685+0000 7fd20d800640 1 --2- 172.21.15.110:0/3697103305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 0x7fd208109c10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009820 tx=0x7fd1fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59716ca1e561af2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.685+0000 7fd207e00640 1 -- 172.21.15.110:0/3697103305 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc037070 con 0x7fd208109810 2024-09-12T02:04:40.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.685+0000 7fd207e00640 1 -- 172.21.15.110:0/3697103305 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1fc032920 con 0x7fd208109810 2024-09-12T02:04:40.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.685+0000 7fd207e00640 1 -- 172.21.15.110:0/3697103305 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc030810 con 0x7fd208109810 2024-09-12T02:04:40.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.686+0000 7fd210200640 1 -- 172.21.15.110:0/3697103305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 msgr2=0x7fd208109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:40.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.686+0000 7fd210200640 1 --2- 172.21.15.110:0/3697103305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 0x7fd208109c10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009820 tx=0x7fd1fc02a270 comp rx=0 tx=0).stop 2024-09-12T02:04:40.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.686+0000 7fd210200640 1 -- 172.21.15.110:0/3697103305 shutdown_connections 2024-09-12T02:04:40.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.686+0000 7fd210200640 1 --2- 172.21.15.110:0/3697103305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 0x7fd208109c10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.686+0000 7fd210200640 1 -- 172.21.15.110:0/3697103305 >> 172.21.15.110:0/3697103305 conn(0x7fd20807ccf0 msgr2=0x7fd20807d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:40.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.686+0000 7fd210200640 1 -- 172.21.15.110:0/3697103305 shutdown_connections 2024-09-12T02:04:40.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.686+0000 7fd210200640 1 -- 172.21.15.110:0/3697103305 wait complete. 2024-09-12T02:04:40.308 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.687+0000 7fd210200640 1 Processor -- start 2024-09-12T02:04:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.687+0000 7fd210200640 1 -- start start 2024-09-12T02:04:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.687+0000 7fd210200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 0x7fd20819d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.687+0000 7fd210200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd20810dd00 con 0x7fd208109810 2024-09-12T02:04:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.688+0000 7fd20d800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 0x7fd20819d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.688+0000 7fd20d800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 0x7fd20819d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55170/0 (socket says 172.21.15.110:55170) 2024-09-12T02:04:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.688+0000 7fd20d800640 1 -- 172.21.15.110:0/1350267650 learned_addr learned my addr 172.21.15.110:0/1350267650 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.688+0000 7fd20d800640 1 -- 172.21.15.110:0/1350267650 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20819dcf0 con 0x7fd208109810 2024-09-12T02:04:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.688+0000 7fd20d800640 1 --2- 172.21.15.110:0/1350267650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 0x7fd20819d7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0097f0 tx=0x7fd1fc0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.688+0000 7fd206000640 1 -- 172.21.15.110:0/1350267650 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc037040 con 0x7fd208109810 2024-09-12T02:04:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.689+0000 7fd206000640 1 -- 172.21.15.110:0/1350267650 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1fc030c40 con 0x7fd208109810 2024-09-12T02:04:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.689+0000 7fd210200640 1 -- 172.21.15.110:0/1350267650 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20819df80 con 0x7fd208109810 2024-09-12T02:04:40.309 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.689+0000 7fd206000640 1 -- 172.21.15.110:0/1350267650 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1fc03a5d0 con 0x7fd208109810 2024-09-12T02:04:40.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.689+0000 7fd210200640 1 -- 172.21.15.110:0/1350267650 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2081a0c70 con 0x7fd208109810 2024-09-12T02:04:40.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.690+0000 7fd206000640 1 -- 172.21.15.110:0/1350267650 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd1fc03b3f0 con 0x7fd208109810 2024-09-12T02:04:40.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.690+0000 7fd210200640 1 -- 172.21.15.110:0/1350267650 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd208109c90 con 0x7fd208109810 2024-09-12T02:04:40.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.690+0000 7fd206000640 1 --2- 172.21.15.110:0/1350267650 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fd1f0038fc0 0x7fd1f003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:40.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.690+0000 7fd206000640 1 -- 172.21.15.110:0/1350267650 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd1fc06c4f0 con 0x7fd208109810 2024-09-12T02:04:40.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.691+0000 7fd20ce00640 1 --2- 172.21.15.110:0/1350267650 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fd1f0038fc0 0x7fd1f003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:40.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.691+0000 7fd20ce00640 1 --2- 172.21.15.110:0/1350267650 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fd1f0038fc0 0x7fd1f003b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40098c0 tx=0x7fd1f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:40.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.695+0000 7fd206000640 1 -- 172.21.15.110:0/1350267650 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1fc06be40 con 0x7fd208109810 2024-09-12T02:04:40.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:38.931+0000 7fd210200640 1 -- 172.21.15.110:0/1350267650 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fd2081a0e40 con 0x7fd208109810 2024-09-12T02:04:40.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:39.474+0000 7fd206000640 1 -- 172.21.15.110:0/1350267650 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fd1fc03b6e0 con 0x7fd208109810 2024-09-12T02:04:40.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:39.476+0000 7fd206000640 1 -- 172.21.15.110:0/1350267650 <== mon.0 v2:172.21.15.110:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fd1fc03a7c0 con 0x7fd208109810 2024-09-12T02:04:40.310 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:39.478+0000 7fd210200640 1 -- 172.21.15.110:0/1350267650 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fd1f0038fc0 msgr2=0x7fd1f003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:40.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:39.478+0000 7fd210200640 1 --2- 172.21.15.110:0/1350267650 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fd1f0038fc0 0x7fd1f003b480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd1f40098c0 tx=0x7fd1f4006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:39.478+0000 7fd210200640 1 -- 172.21.15.110:0/1350267650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 msgr2=0x7fd20819d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:40.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:39.478+0000 7fd210200640 1 --2- 172.21.15.110:0/1350267650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 0x7fd20819d7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0097f0 tx=0x7fd1fc0327b0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:39.478+0000 7fd210200640 1 -- 172.21.15.110:0/1350267650 shutdown_connections 2024-09-12T02:04:40.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:39.478+0000 7fd210200640 1 --2- 172.21.15.110:0/1350267650 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7fd1f0038fc0 0x7fd1f003b480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:39.478+0000 7fd210200640 1 --2- 172.21.15.110:0/1350267650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd208109810 0x7fd20819d7b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:40.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:39.478+0000 7fd210200640 1 -- 172.21.15.110:0/1350267650 >> 172.21.15.110:0/1350267650 conn(0x7fd20807ccf0 msgr2=0x7fd208107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:40.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:39.478+0000 7fd210200640 1 -- 172.21.15.110:0/1350267650 shutdown_connections 2024-09-12T02:04:40.311 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:39.478+0000 7fd210200640 1 -- 172.21.15.110:0/1350267650 wait complete. 2024-09-12T02:04:40.559 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:40 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1350267650' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T02:04:40.559 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:40 smithi110 ceph-mon[30548]: mgrmap e9: x(active, since 21s) 2024-09-12T02:04:40.559 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:40 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:40.390+0000 7fc6d9634040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:04:40.851 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:40 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:40.773+0000 7fc6d9634040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:04:40.851 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:40 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:40.851+0000 7fc6d9634040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:04:41.186 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:41 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:41.077+0000 7fc6d9634040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:04:41.550 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:41 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1510725825' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T02:04:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:04:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T02:04:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T02:04:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-12T02:04:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T02:04:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:04:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.792+0000 7f131fe00640 1 Processor -- start 2024-09-12T02:04:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.792+0000 7f131fe00640 1 -- start start 2024-09-12T02:04:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.792+0000 7f131fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 0x7f132007b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.792+0000 7f131fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f132007b690 con 0x7f132007ccf0 2024-09-12T02:04:41.947 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.793+0000 7f131ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 0x7f132007b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.948 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.793+0000 7f131ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 0x7f132007b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59024/0 (socket says 172.21.15.110:59024) 2024-09-12T02:04:41.948 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.793+0000 7f131ea00640 1 -- 172.21.15.110:0/2931341044 learned_addr learned my addr 172.21.15.110:0/2931341044 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:41.948 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.793+0000 7f131ea00640 1 -- 172.21.15.110:0/2931341044 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132007b810 con 0x7f132007ccf0 2024-09-12T02:04:41.948 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.794+0000 7f131ea00640 1 --2- 172.21.15.110:0/2931341044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 0x7f132007b150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1310009820 tx=0x7f131002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0a39aac27995fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.948 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.795+0000 7f131d600640 1 -- 172.21.15.110:0/2931341044 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1310037070 con 0x7f132007ccf0 2024-09-12T02:04:41.948 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.795+0000 7f131d600640 1 -- 172.21.15.110:0/2931341044 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1310032920 con 0x7f132007ccf0 2024-09-12T02:04:41.948 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.795+0000 7f131d600640 1 -- 172.21.15.110:0/2931341044 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1310030810 con 0x7f132007ccf0 2024-09-12T02:04:41.948 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.795+0000 7f131fe00640 1 -- 172.21.15.110:0/2931341044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 msgr2=0x7f132007b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.948 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.795+0000 7f131fe00640 1 --2- 172.21.15.110:0/2931341044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 0x7f132007b150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1310009820 tx=0x7f131002a270 comp rx=0 tx=0).stop 2024-09-12T02:04:41.948 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.795+0000 7f131fe00640 1 -- 172.21.15.110:0/2931341044 shutdown_connections 2024-09-12T02:04:41.948 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.795+0000 7f131fe00640 1 --2- 172.21.15.110:0/2931341044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 0x7f132007b150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.949 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.795+0000 7f131fe00640 1 -- 172.21.15.110:0/2931341044 >> 172.21.15.110:0/2931341044 conn(0x7f1320102b90 msgr2=0x7f1320104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:41.949 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.795+0000 7f131fe00640 1 -- 172.21.15.110:0/2931341044 shutdown_connections 2024-09-12T02:04:41.949 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.795+0000 7f131fe00640 1 -- 172.21.15.110:0/2931341044 wait complete. 2024-09-12T02:04:41.949 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.796+0000 7f131fe00640 1 Processor -- start 2024-09-12T02:04:41.949 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.797+0000 7f131fe00640 1 -- start start 2024-09-12T02:04:41.949 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.797+0000 7f131fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 0x7f132019d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.949 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.797+0000 7f131fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f132010d9f0 con 0x7f132007ccf0 2024-09-12T02:04:41.949 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.797+0000 7f131ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 0x7f132019d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:41.949 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.797+0000 7f131ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 0x7f132019d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59040/0 (socket says 172.21.15.110:59040) 2024-09-12T02:04:41.949 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.797+0000 7f131ea00640 1 -- 172.21.15.110:0/1510725825 learned_addr learned my addr 172.21.15.110:0/1510725825 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:41.949 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.798+0000 7f131ea00640 1 -- 172.21.15.110:0/1510725825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132019daf0 con 0x7f132007ccf0 2024-09-12T02:04:41.949 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.798+0000 7f131ea00640 1 --2- 172.21.15.110:0/1510725825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 0x7f132019d5b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1310030380 tx=0x7f1310032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:41.950 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.798+0000 7f1317400640 1 -- 172.21.15.110:0/1510725825 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1310037040 con 0x7f132007ccf0 2024-09-12T02:04:41.950 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.798+0000 7f1317400640 1 -- 172.21.15.110:0/1510725825 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1310040070 con 0x7f132007ccf0 2024-09-12T02:04:41.950 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.798+0000 7f1317400640 1 -- 172.21.15.110:0/1510725825 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f131003a7b0 con 0x7f132007ccf0 2024-09-12T02:04:41.950 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.798+0000 7f131fe00640 1 -- 172.21.15.110:0/1510725825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132019dd80 con 0x7f132007ccf0 2024-09-12T02:04:41.950 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.798+0000 7f131fe00640 1 -- 172.21.15.110:0/1510725825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13201a0a70 con 0x7f132007ccf0 2024-09-12T02:04:41.950 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.799+0000 7f1317400640 1 -- 172.21.15.110:0/1510725825 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f131003bc00 con 0x7f132007ccf0 2024-09-12T02:04:41.950 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.799+0000 7f131fe00640 1 -- 172.21.15.110:0/1510725825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132007b1d0 con 0x7f132007ccf0 2024-09-12T02:04:41.950 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.800+0000 7f1317400640 1 --2- 172.21.15.110:0/1510725825 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1304039020 0x7f130403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:41.950 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.800+0000 7f1317400640 1 -- 172.21.15.110:0/1510725825 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f131006c620 con 0x7f132007ccf0 2024-09-12T02:04:41.950 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.800+0000 7f131e000640 1 -- 172.21.15.110:0/1510725825 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1304039020 msgr2=0x7f130403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3137576010 2024-09-12T02:04:41.951 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.800+0000 7f131e000640 1 --2- 172.21.15.110:0/1510725825 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1304039020 0x7f130403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:04:41.951 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:40.805+0000 7f1317400640 1 -- 172.21.15.110:0/1510725825 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1310040220 con 0x7f132007ccf0 2024-09-12T02:04:41.951 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.001+0000 7f131e000640 1 -- 172.21.15.110:0/1510725825 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1304039020 msgr2=0x7f130403b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3137576010 2024-09-12T02:04:41.951 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.001+0000 7f131e000640 1 --2- 172.21.15.110:0/1510725825 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1304039020 0x7f130403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:04:41.951 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.039+0000 7f131fe00640 1 -- 172.21.15.110:0/1510725825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f13201a0c40 con 0x7f132007ccf0 2024-09-12T02:04:41.951 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.040+0000 7f1317400640 1 -- 172.21.15.110:0/1510725825 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f13201a0c40 con 0x7f132007ccf0 2024-09-12T02:04:41.951 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.044+0000 7f131fe00640 1 -- 172.21.15.110:0/1510725825 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1304039020 msgr2=0x7f130403b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:04:41.951 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.044+0000 7f131fe00640 1 --2- 172.21.15.110:0/1510725825 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1304039020 0x7f130403b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.951 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.044+0000 7f131fe00640 1 -- 172.21.15.110:0/1510725825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 msgr2=0x7f132019d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:41.951 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.044+0000 7f131fe00640 1 --2- 172.21.15.110:0/1510725825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 0x7f132019d5b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1310030380 tx=0x7f1310032670 comp rx=0 tx=0).stop 2024-09-12T02:04:41.952 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.044+0000 7f131fe00640 1 -- 172.21.15.110:0/1510725825 shutdown_connections 2024-09-12T02:04:41.952 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.044+0000 7f131fe00640 1 --2- 172.21.15.110:0/1510725825 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1304039020 0x7f130403b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.952 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.044+0000 7f131fe00640 1 --2- 172.21.15.110:0/1510725825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f132007ccf0 0x7f132019d5b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:41.952 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.044+0000 7f131fe00640 1 -- 172.21.15.110:0/1510725825 >> 172.21.15.110:0/1510725825 conn(0x7f1320102b90 msgr2=0x7f1320103730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:41.952 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.044+0000 7f131fe00640 1 -- 172.21.15.110:0/1510725825 shutdown_connections 2024-09-12T02:04:41.952 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:41.044+0000 7f131fe00640 1 -- 172.21.15.110:0/1510725825 wait complete. 2024-09-12T02:04:41.952 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for the mgr to restart... 2024-09-12T02:04:41.952 INFO:teuthology.orchestra.run.smithi110.stdout:Waiting for mgr epoch 9... 2024-09-12T02:04:42.527 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:42 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:42.201+0000 7fc6d9634040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:04:42.527 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:42 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:42.287+0000 7fc6d9634040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:04:43.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:43.208+0000 7fc6d9634040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:04:43.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:43.341+0000 7fc6d9634040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:04:43.821 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:43.501+0000 7fc6d9634040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:04:43.821 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:43.574+0000 7fc6d9634040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:04:43.821 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:43.741+0000 7fc6d9634040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:04:43.821 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:43.821+0000 7fc6d9634040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:04:44.146 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:43.892+0000 7fc6d9634040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:04:44.146 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:44 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:44.069+0000 7fc6d9634040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:04:44.146 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:44 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:44.146+0000 7fc6d9634040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:04:44.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:44 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:44.225+0000 7fc6d9634040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:04:44.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:44 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:44.320+0000 7fc6d9634040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:04:44.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:44 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:44.389+0000 7fc6d9634040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:04:44.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:44 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:44.458+0000 7fc6d9634040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:04:45.686 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:45 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:45.355+0000 7fc6d9634040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:04:45.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:45 smithi110 ceph-mon[30548]: Active manager daemon x restarted 2024-09-12T02:04:45.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:45 smithi110 ceph-mon[30548]: Activating manager daemon x 2024-09-12T02:04:45.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:45 smithi110 ceph-mon[30548]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T02:04:45.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:45 smithi110 ceph-mon[30548]: mgrmap e10: x(active, starting, since 0.00430008s) 2024-09-12T02:04:45.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:04:45.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:04:45.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:04:45.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:04:45.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:04:45.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:45 smithi110 ceph-mon[30548]: Manager daemon x is now available 2024-09-12T02:04:45.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:46.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:04:46.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:04:46.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-mon[30548]: mgrmap e11: x(active, since 1.00781s) 2024-09-12T02:04:46.687 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:46.554+0000 7fc636a00640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:04:46] ENGINE Error in HTTPServer.serve 2024-09-12T02:04:46.687 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: Traceback (most recent call last): 2024-09-12T02:04:46.687 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:04:46.687 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: self._connections.run(self.expiration_interval) 2024-09-12T02:04:46.687 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:04:46.687 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: self._run(expiration_interval) 2024-09-12T02:04:46.687 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:04:46.687 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:04:46.688 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:04:46.688 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:04:46.688 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:04:46.688 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: s = self.context.wrap_socket( 2024-09-12T02:04:46.688 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:04:46.688 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: return self.sslsocket_class._create( 2024-09-12T02:04:46.688 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:04:46.688 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: self.do_handshake() 2024-09-12T02:04:46.688 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:04:46.688 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: self._sslobj.do_handshake() 2024-09-12T02:04:46.688 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:04:46.688 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:04:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:04:47.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout { 2024-09-12T02:04:47.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T02:04:47.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T02:04:47.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout } 2024-09-12T02:04:47.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.542+0000 7f1c6ac00640 1 Processor -- start 2024-09-12T02:04:47.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.542+0000 7f1c6ac00640 1 -- start start 2024-09-12T02:04:47.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.543+0000 7f1c6ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 0x7f1c64109bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.543+0000 7f1c6ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6410a1a0 con 0x7f1c641097d0 2024-09-12T02:04:47.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.543+0000 7f1c63e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 0x7f1c64109bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.026 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.543+0000 7f1c63e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 0x7f1c64109bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59056/0 (socket says 172.21.15.110:59056) 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.543+0000 7f1c63e00640 1 -- 172.21.15.110:0/3481001015 learned_addr learned my addr 172.21.15.110:0/3481001015 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.543+0000 7f1c63e00640 1 -- 172.21.15.110:0/3481001015 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6410a970 con 0x7f1c641097d0 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.544+0000 7f1c63e00640 1 --2- 172.21.15.110:0/3481001015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 0x7f1c64109bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009820 tx=0x7f1c5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81dccde58758bce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.545+0000 7f1c62a00640 1 -- 172.21.15.110:0/3481001015 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c54037070 con 0x7f1c641097d0 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.545+0000 7f1c62a00640 1 -- 172.21.15.110:0/3481001015 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c54032920 con 0x7f1c641097d0 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.545+0000 7f1c62a00640 1 -- 172.21.15.110:0/3481001015 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c54030810 con 0x7f1c641097d0 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.545+0000 7f1c6ac00640 1 -- 172.21.15.110:0/3481001015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 msgr2=0x7f1c64109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.545+0000 7f1c6ac00640 1 --2- 172.21.15.110:0/3481001015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 0x7f1c64109bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009820 tx=0x7f1c5402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.546+0000 7f1c6ac00640 1 -- 172.21.15.110:0/3481001015 shutdown_connections 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.546+0000 7f1c6ac00640 1 --2- 172.21.15.110:0/3481001015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 0x7f1c64109bd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.546+0000 7f1c6ac00640 1 -- 172.21.15.110:0/3481001015 >> 172.21.15.110:0/3481001015 conn(0x7f1c6407cd20 msgr2=0x7f1c6407d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.546+0000 7f1c6ac00640 1 -- 172.21.15.110:0/3481001015 shutdown_connections 2024-09-12T02:04:47.027 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.546+0000 7f1c6ac00640 1 -- 172.21.15.110:0/3481001015 wait complete. 2024-09-12T02:04:47.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.547+0000 7f1c6ac00640 1 Processor -- start 2024-09-12T02:04:47.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.547+0000 7f1c6ac00640 1 -- start start 2024-09-12T02:04:47.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.547+0000 7f1c6ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 0x7f1c6419d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.547+0000 7f1c6ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6410dd20 con 0x7f1c641097d0 2024-09-12T02:04:47.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.547+0000 7f1c63e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 0x7f1c6419d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.547+0000 7f1c63e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 0x7f1c6419d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59070/0 (socket says 172.21.15.110:59070) 2024-09-12T02:04:47.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.547+0000 7f1c63e00640 1 -- 172.21.15.110:0/4271564126 learned_addr learned my addr 172.21.15.110:0/4271564126 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:47.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.548+0000 7f1c63e00640 1 -- 172.21.15.110:0/4271564126 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6419dd10 con 0x7f1c641097d0 2024-09-12T02:04:47.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.548+0000 7f1c63e00640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 0x7f1c6419d7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1c54030560 tx=0x7f1c54032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:47.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.548+0000 7f1c60c00640 1 -- 172.21.15.110:0/4271564126 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c54037040 con 0x7f1c641097d0 2024-09-12T02:04:47.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.548+0000 7f1c60c00640 1 -- 172.21.15.110:0/4271564126 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c54040070 con 0x7f1c641097d0 2024-09-12T02:04:47.028 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.548+0000 7f1c60c00640 1 -- 172.21.15.110:0/4271564126 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c5403a740 con 0x7f1c641097d0 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.548+0000 7f1c6ac00640 1 -- 172.21.15.110:0/4271564126 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6419dfa0 con 0x7f1c641097d0 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.548+0000 7f1c6ac00640 1 -- 172.21.15.110:0/4271564126 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c641a0c90 con 0x7f1c641097d0 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.549+0000 7f1c60c00640 1 -- 172.21.15.110:0/4271564126 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f1c5403bb90 con 0x7f1c641097d0 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.550+0000 7f1c60c00640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1c48039020 0x7f1c4803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.550+0000 7f1c60c00640 1 -- 172.21.15.110:0/4271564126 --> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1c4803bbf0 con 0x7f1c48039020 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.550+0000 7f1c60c00640 1 -- 172.21.15.110:0/4271564126 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1c5406c580 con 0x7f1c641097d0 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.550+0000 7f1c63400640 1 -- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1c48039020 msgr2=0x7f1c4803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3137576010 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.550+0000 7f1c63400640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1c48039020 0x7f1c4803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.751+0000 7f1c63400640 1 -- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1c48039020 msgr2=0x7f1c4803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3137576010 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:42.751+0000 7f1c63400640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1c48039020 0x7f1c4803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:43.152+0000 7f1c63400640 1 -- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1c48039020 msgr2=0x7f1c4803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3137576010 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:43.152+0000 7f1c63400640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1c48039020 0x7f1c4803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T02:04:47.029 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:43.953+0000 7f1c63400640 1 -- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1c48039020 msgr2=0x7f1c4803b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/3137576010 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:43.953+0000 7f1c63400640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1c48039020 0x7f1c4803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:45.359+0000 7f1c60c00640 1 -- 172.21.15.110:0/4271564126 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f1c5406b030 con 0x7f1c641097d0 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:45.360+0000 7f1c60c00640 1 -- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1c48039020 msgr2=0x7f1c4803b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:45.360+0000 7f1c60c00640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1c48039020 0x7f1c4803b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.360+0000 7f1c60c00640 1 -- 172.21.15.110:0/4271564126 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f1c5403b420 con 0x7f1c641097d0 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.361+0000 7f1c60c00640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1c4803cae0 0x7f1c4803eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.361+0000 7f1c60c00640 1 -- 172.21.15.110:0/4271564126 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1c540656a0 con 0x7f1c4803cae0 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.361+0000 7f1c63400640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1c4803cae0 0x7f1c4803eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.363+0000 7f1c63400640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1c4803cae0 0x7f1c4803eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1c50003980 tx=0x7f1c500092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.364+0000 7f1c60c00640 1 -- 172.21.15.110:0/4271564126 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f1c540656a0 con 0x7f1c4803cae0 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.372+0000 7f1c6ac00640 1 -- 172.21.15.110:0/4271564126 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f1c64109bd0 con 0x7f1c4803cae0 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.372+0000 7f1c60c00640 1 -- 172.21.15.110:0/4271564126 <== mgr.14150 v2:172.21.15.110:6800/511769794 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f1c64109bd0 con 0x7f1c4803cae0 2024-09-12T02:04:47.030 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.372+0000 7f1c6ac00640 1 -- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1c4803cae0 msgr2=0x7f1c4803eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.031 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.372+0000 7f1c6ac00640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1c4803cae0 0x7f1c4803eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1c50003980 tx=0x7f1c500092b0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.031 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.372+0000 7f1c6ac00640 1 -- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 msgr2=0x7f1c6419d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:47.031 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.372+0000 7f1c6ac00640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 0x7f1c6419d7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1c54030560 tx=0x7f1c54032670 comp rx=0 tx=0).stop 2024-09-12T02:04:47.031 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.372+0000 7f1c6ac00640 1 -- 172.21.15.110:0/4271564126 shutdown_connections 2024-09-12T02:04:47.031 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.373+0000 7f1c6ac00640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1c4803cae0 0x7f1c4803eed0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.031 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.373+0000 7f1c6ac00640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:6800/3137576010,v1:172.21.15.110:6801/3137576010] conn(0x7f1c48039020 0x7f1c4803b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.031 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.373+0000 7f1c6ac00640 1 --2- 172.21.15.110:0/4271564126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c641097d0 0x7f1c6419d7d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:47.031 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.373+0000 7f1c6ac00640 1 -- 172.21.15.110:0/4271564126 >> 172.21.15.110:0/4271564126 conn(0x7f1c6407cd20 msgr2=0x7f1c641074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:47.031 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.373+0000 7f1c6ac00640 1 -- 172.21.15.110:0/4271564126 shutdown_connections 2024-09-12T02:04:47.031 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:46.373+0000 7f1c6ac00640 1 -- 172.21.15.110:0/4271564126 wait complete. 2024-09-12T02:04:47.031 INFO:teuthology.orchestra.run.smithi110.stdout:mgr epoch 9 is available 2024-09-12T02:04:47.031 INFO:teuthology.orchestra.run.smithi110.stdout:Generating a dashboard self-signed certificate... 2024-09-12T02:04:47.535 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:47 smithi110 ceph-mon[30548]: [12/Sep/2024:02:04:46] ENGINE Bus STARTING 2024-09-12T02:04:47.536 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:47 smithi110 ceph-mon[30548]: [12/Sep/2024:02:04:46] ENGINE Serving on https://172.21.15.110:7150 2024-09-12T02:04:47.536 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:47 smithi110 ceph-mon[30548]: [12/Sep/2024:02:04:46] ENGINE Error in HTTPServer.serve 2024-09-12T02:04:47.536 INFO:journalctl@ceph.mon.a.smithi110.stdout: Traceback (most recent call last): 2024-09-12T02:04:47.536 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:04:47.536 INFO:journalctl@ceph.mon.a.smithi110.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:04:47.536 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:04:47.536 INFO:journalctl@ceph.mon.a.smithi110.stdout: self._run(expiration_interval) 2024-09-12T02:04:47.536 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:04:47.536 INFO:journalctl@ceph.mon.a.smithi110.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:04:47.536 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:04:47.536 INFO:journalctl@ceph.mon.a.smithi110.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:04:47.536 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:04:47.537 INFO:journalctl@ceph.mon.a.smithi110.stdout: s = self.context.wrap_socket( 2024-09-12T02:04:47.537 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:04:47.537 INFO:journalctl@ceph.mon.a.smithi110.stdout: return self.sslsocket_class._create( 2024-09-12T02:04:47.537 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:04:47.537 INFO:journalctl@ceph.mon.a.smithi110.stdout: self.do_handshake() 2024-09-12T02:04:47.537 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:04:47.537 INFO:journalctl@ceph.mon.a.smithi110.stdout: self._sslobj.do_handshake() 2024-09-12T02:04:47.537 INFO:journalctl@ceph.mon.a.smithi110.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:04:48.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:48 smithi110 ceph-mon[30548]: [12/Sep/2024:02:04:46] ENGINE Serving on http://172.21.15.110:8765 2024-09-12T02:04:48.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:48 smithi110 ceph-mon[30548]: [12/Sep/2024:02:04:46] ENGINE Bus STARTED 2024-09-12T02:04:48.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:48 smithi110 ceph-mon[30548]: mgrmap e12: x(active, since 2s) 2024-09-12T02:04:48.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:04:48.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:04:48.723 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T02:04:48.723 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.640+0000 7f660ae00640 1 Processor -- start 2024-09-12T02:04:48.723 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.640+0000 7f660ae00640 1 -- start start 2024-09-12T02:04:48.723 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.640+0000 7f660ae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 0x7f660410a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.723 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.640+0000 7f660ae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6604075790 con 0x7f6604107eb0 2024-09-12T02:04:48.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.641+0000 7f6609a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 0x7f660410a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.641+0000 7f6609a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 0x7f660410a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59132/0 (socket says 172.21.15.110:59132) 2024-09-12T02:04:48.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.641+0000 7f6609a00640 1 -- 172.21.15.110:0/4280573664 learned_addr learned my addr 172.21.15.110:0/4280573664 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:48.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.641+0000 7f6609a00640 1 -- 172.21.15.110:0/4280573664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660410a7e0 con 0x7f6604107eb0 2024-09-12T02:04:48.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.642+0000 7f6609a00640 1 --2- 172.21.15.110:0/4280573664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 0x7f660410a2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009e80 tx=0x7f65f802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13928a57a553351 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:48.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.642+0000 7f6603e00640 1 -- 172.21.15.110:0/4280573664 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65f8036070 con 0x7f6604107eb0 2024-09-12T02:04:48.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.642+0000 7f6603e00640 1 -- 172.21.15.110:0/4280573664 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f80318e0 con 0x7f6604107eb0 2024-09-12T02:04:48.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.642+0000 7f6603e00640 1 -- 172.21.15.110:0/4280573664 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65f8007a00 con 0x7f6604107eb0 2024-09-12T02:04:48.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.643+0000 7f660ae00640 1 -- 172.21.15.110:0/4280573664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 msgr2=0x7f660410a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.643+0000 7f660ae00640 1 --2- 172.21.15.110:0/4280573664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 0x7f660410a2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009e80 tx=0x7f65f802a7a0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.724 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.643+0000 7f660ae00640 1 -- 172.21.15.110:0/4280573664 shutdown_connections 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.643+0000 7f660ae00640 1 --2- 172.21.15.110:0/4280573664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 0x7f660410a2a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.643+0000 7f660ae00640 1 -- 172.21.15.110:0/4280573664 >> 172.21.15.110:0/4280573664 conn(0x7f6604101ab0 msgr2=0x7f6604103ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.643+0000 7f660ae00640 1 -- 172.21.15.110:0/4280573664 shutdown_connections 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.643+0000 7f660ae00640 1 -- 172.21.15.110:0/4280573664 wait complete. 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.644+0000 7f660ae00640 1 Processor -- start 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.644+0000 7f660ae00640 1 -- start start 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.645+0000 7f660ae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 0x7f660419d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.645+0000 7f660ae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f660410b800 con 0x7f6604107eb0 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.645+0000 7f6609a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 0x7f660419d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.645+0000 7f6609a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 0x7f660419d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59146/0 (socket says 172.21.15.110:59146) 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.645+0000 7f6609a00640 1 -- 172.21.15.110:0/1023509504 learned_addr learned my addr 172.21.15.110:0/1023509504 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.645+0000 7f6609a00640 1 -- 172.21.15.110:0/1023509504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660419db30 con 0x7f6604107eb0 2024-09-12T02:04:48.725 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.645+0000 7f6609a00640 1 --2- 172.21.15.110:0/1023509504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 0x7f660419d5f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f65f802acc0 tx=0x7f65f8031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:48.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.646+0000 7f6602000640 1 -- 172.21.15.110:0/1023509504 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65f8036050 con 0x7f6604107eb0 2024-09-12T02:04:48.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.646+0000 7f6602000640 1 -- 172.21.15.110:0/1023509504 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f8037040 con 0x7f6604107eb0 2024-09-12T02:04:48.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.646+0000 7f660ae00640 1 -- 172.21.15.110:0/1023509504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660419ddc0 con 0x7f6604107eb0 2024-09-12T02:04:48.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.646+0000 7f6602000640 1 -- 172.21.15.110:0/1023509504 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65f803d8e0 con 0x7f6604107eb0 2024-09-12T02:04:48.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.646+0000 7f660ae00640 1 -- 172.21.15.110:0/1023509504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66041a0ab0 con 0x7f6604107eb0 2024-09-12T02:04:48.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.647+0000 7f6602000640 1 -- 172.21.15.110:0/1023509504 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f65f8044020 con 0x7f6604107eb0 2024-09-12T02:04:48.726 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.647+0000 7f660ae00640 1 -- 172.21.15.110:0/1023509504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6604108310 con 0x7f6604107eb0 2024-09-12T02:04:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.647+0000 7f6602000640 1 --2- 172.21.15.110:0/1023509504 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f65ec038fc0 0x7f65ec03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.647+0000 7f6602000640 1 -- 172.21.15.110:0/1023509504 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f65f8042020 con 0x7f6604107eb0 2024-09-12T02:04:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.648+0000 7f6609000640 1 --2- 172.21.15.110:0/1023509504 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f65ec038fc0 0x7f65ec03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.648+0000 7f6609000640 1 --2- 172.21.15.110:0/1023509504 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f65ec038fc0 0x7f65ec03b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f65f00098c0 tx=0x7f65f0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.652+0000 7f6602000640 1 -- 172.21.15.110:0/1023509504 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f65f804b020 con 0x7f6604107eb0 2024-09-12T02:04:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.834+0000 7f660ae00640 1 -- 172.21.15.110:0/1023509504 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f6604102ce0 con 0x7f65ec038fc0 2024-09-12T02:04:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.943+0000 7f6602000640 1 -- 172.21.15.110:0/1023509504 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f6604102ce0 con 0x7f65ec038fc0 2024-09-12T02:04:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.945+0000 7f660ae00640 1 -- 172.21.15.110:0/1023509504 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f65ec038fc0 msgr2=0x7f65ec03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.945+0000 7f660ae00640 1 --2- 172.21.15.110:0/1023509504 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f65ec038fc0 0x7f65ec03b480 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f65f00098c0 tx=0x7f65f0006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.945+0000 7f660ae00640 1 -- 172.21.15.110:0/1023509504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 msgr2=0x7f660419d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.945+0000 7f660ae00640 1 --2- 172.21.15.110:0/1023509504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 0x7f660419d5f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f65f802acc0 tx=0x7f65f8031cc0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.727 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.946+0000 7f660ae00640 1 -- 172.21.15.110:0/1023509504 shutdown_connections 2024-09-12T02:04:48.728 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.946+0000 7f660ae00640 1 --2- 172.21.15.110:0/1023509504 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f65ec038fc0 0x7f65ec03b480 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.728 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.946+0000 7f660ae00640 1 --2- 172.21.15.110:0/1023509504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6604107eb0 0x7f660419d5f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:48.728 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.946+0000 7f660ae00640 1 -- 172.21.15.110:0/1023509504 >> 172.21.15.110:0/1023509504 conn(0x7f6604101ab0 msgr2=0x7f66041025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:48.728 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.946+0000 7f660ae00640 1 -- 172.21.15.110:0/1023509504 shutdown_connections 2024-09-12T02:04:48.728 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:47.946+0000 7f660ae00640 1 -- 172.21.15.110:0/1023509504 wait complete. 2024-09-12T02:04:48.728 INFO:teuthology.orchestra.run.smithi110.stdout:Creating initial admin user... 2024-09-12T02:04:49.657 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:49 smithi110 ceph-mon[30548]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:49.657 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:04:50.376 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$FvJ40hx9LxiDaHCkwGz2x.QvFu3S0inJO3BofRxlAL4iPwVeKvnrW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726106689, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T02:04:50.376 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.222+0000 7f0136800640 1 Processor -- start 2024-09-12T02:04:50.376 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.222+0000 7f0136800640 1 -- start start 2024-09-12T02:04:50.376 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.223+0000 7f0136800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 0x7f0130107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.223+0000 7f0136800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0130107f00 con 0x7f0130107530 2024-09-12T02:04:50.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.223+0000 7f012f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 0x7f0130107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.223+0000 7f012f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 0x7f0130107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46736/0 (socket says 172.21.15.110:46736) 2024-09-12T02:04:50.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.223+0000 7f012f400640 1 -- 172.21.15.110:0/3571668970 learned_addr learned my addr 172.21.15.110:0/3571668970 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:50.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.224+0000 7f012f400640 1 -- 172.21.15.110:0/3571668970 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0130108730 con 0x7f0130107530 2024-09-12T02:04:50.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.225+0000 7f012f400640 1 --2- 172.21.15.110:0/3571668970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 0x7f0130107930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0120009820 tx=0x7f012002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da24b7cbd8b3998 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:50.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.225+0000 7f012e000640 1 -- 172.21.15.110:0/3571668970 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0120037070 con 0x7f0130107530 2024-09-12T02:04:50.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.225+0000 7f012e000640 1 -- 172.21.15.110:0/3571668970 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0120032920 con 0x7f0130107530 2024-09-12T02:04:50.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.225+0000 7f012e000640 1 -- 172.21.15.110:0/3571668970 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0120030810 con 0x7f0130107530 2024-09-12T02:04:50.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.226+0000 7f0136800640 1 -- 172.21.15.110:0/3571668970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 msgr2=0x7f0130107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.226+0000 7f0136800640 1 --2- 172.21.15.110:0/3571668970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 0x7f0130107930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0120009820 tx=0x7f012002a270 comp rx=0 tx=0).stop 2024-09-12T02:04:50.377 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.226+0000 7f0136800640 1 -- 172.21.15.110:0/3571668970 shutdown_connections 2024-09-12T02:04:50.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.226+0000 7f0136800640 1 --2- 172.21.15.110:0/3571668970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 0x7f0130107930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.226+0000 7f0136800640 1 -- 172.21.15.110:0/3571668970 >> 172.21.15.110:0/3571668970 conn(0x7f0130102cc0 msgr2=0x7f0130105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:50.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.226+0000 7f0136800640 1 -- 172.21.15.110:0/3571668970 shutdown_connections 2024-09-12T02:04:50.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.226+0000 7f0136800640 1 -- 172.21.15.110:0/3571668970 wait complete. 2024-09-12T02:04:50.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.227+0000 7f0136800640 1 Processor -- start 2024-09-12T02:04:50.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.227+0000 7f0136800640 1 -- start start 2024-09-12T02:04:50.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.227+0000 7f0136800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 0x7f013019b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.227+0000 7f0136800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f013010bae0 con 0x7f0130107530 2024-09-12T02:04:50.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.227+0000 7f012f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 0x7f013019b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.378 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.227+0000 7f012f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 0x7f013019b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46742/0 (socket says 172.21.15.110:46742) 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.227+0000 7f012f400640 1 -- 172.21.15.110:0/1109760785 learned_addr learned my addr 172.21.15.110:0/1109760785 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.228+0000 7f012f400640 1 -- 172.21.15.110:0/1109760785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013019bb50 con 0x7f0130107530 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.228+0000 7f012f400640 1 --2- 172.21.15.110:0/1109760785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 0x7f013019b610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01200097f0 tx=0x7f01200327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.228+0000 7f0127e00640 1 -- 172.21.15.110:0/1109760785 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0120037040 con 0x7f0130107530 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.228+0000 7f0127e00640 1 -- 172.21.15.110:0/1109760785 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0120030c40 con 0x7f0130107530 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.228+0000 7f0136800640 1 -- 172.21.15.110:0/1109760785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013019bde0 con 0x7f0130107530 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.228+0000 7f0127e00640 1 -- 172.21.15.110:0/1109760785 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f012003a5b0 con 0x7f0130107530 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.229+0000 7f0136800640 1 -- 172.21.15.110:0/1109760785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013019ead0 con 0x7f0130107530 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.230+0000 7f0127e00640 1 -- 172.21.15.110:0/1109760785 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f012003b3f0 con 0x7f0130107530 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.230+0000 7f0136800640 1 -- 172.21.15.110:0/1109760785 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f013010bc60 con 0x7f0130107530 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.230+0000 7f0127e00640 1 --2- 172.21.15.110:0/1109760785 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0114039020 0x7f011403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.230+0000 7f0127e00640 1 -- 172.21.15.110:0/1109760785 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f012006c580 con 0x7f0130107530 2024-09-12T02:04:50.379 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.230+0000 7f012ea00640 1 --2- 172.21.15.110:0/1109760785 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0114039020 0x7f011403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:50.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.231+0000 7f012ea00640 1 --2- 172.21.15.110:0/1109760785 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0114039020 0x7f011403b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f011c0098c0 tx=0x7f011c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:50.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.235+0000 7f0127e00640 1 -- 172.21.15.110:0/1109760785 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0120044dc0 con 0x7f0130107530 2024-09-12T02:04:50.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.432+0000 7f0136800640 1 -- 172.21.15.110:0/1109760785 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f013019eca0 con 0x7f0114039020 2024-09-12T02:04:50.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.657+0000 7f0127e00640 1 -- 172.21.15.110:0/1109760785 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f013019eca0 con 0x7f0114039020 2024-09-12T02:04:50.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.660+0000 7f0136800640 1 -- 172.21.15.110:0/1109760785 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0114039020 msgr2=0x7f011403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.660+0000 7f0136800640 1 --2- 172.21.15.110:0/1109760785 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0114039020 0x7f011403b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f011c0098c0 tx=0x7f011c006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.660+0000 7f0136800640 1 -- 172.21.15.110:0/1109760785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 msgr2=0x7f013019b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:50.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.660+0000 7f0136800640 1 --2- 172.21.15.110:0/1109760785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 0x7f013019b610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01200097f0 tx=0x7f01200327b0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.660+0000 7f0136800640 1 -- 172.21.15.110:0/1109760785 shutdown_connections 2024-09-12T02:04:50.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.660+0000 7f0136800640 1 --2- 172.21.15.110:0/1109760785 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0114039020 0x7f011403b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.660+0000 7f0136800640 1 --2- 172.21.15.110:0/1109760785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0130107530 0x7f013019b610 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:50.380 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.660+0000 7f0136800640 1 -- 172.21.15.110:0/1109760785 >> 172.21.15.110:0/1109760785 conn(0x7f0130102cc0 msgr2=0x7f0130103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:50.381 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.661+0000 7f0136800640 1 -- 172.21.15.110:0/1109760785 shutdown_connections 2024-09-12T02:04:50.381 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:49.661+0000 7f0136800640 1 -- 172.21.15.110:0/1109760785 wait complete. 2024-09-12T02:04:50.381 INFO:teuthology.orchestra.run.smithi110.stdout:Fetching dashboard port number... 2024-09-12T02:04:50.672 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:50 smithi110 ceph-mon[30548]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:50.672 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:50 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:04:50.672 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:50 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:04:51.606 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:51 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1260403929' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T02:04:52.326 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T02:04:52.326 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.925+0000 7fa8d5600640 1 Processor -- start 2024-09-12T02:04:52.326 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.925+0000 7fa8d5600640 1 -- start start 2024-09-12T02:04:52.326 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.925+0000 7fa8d5600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 0x7fa8d007b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.925+0000 7fa8d5600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d007b760 con 0x7fa8d007cd30 2024-09-12T02:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.925+0000 7fa8cfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 0x7fa8d007b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.926+0000 7fa8cfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 0x7fa8d007b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46748/0 (socket says 172.21.15.110:46748) 2024-09-12T02:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.926+0000 7fa8cfe00640 1 -- 172.21.15.110:0/374595173 learned_addr learned my addr 172.21.15.110:0/374595173 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.926+0000 7fa8cfe00640 1 -- 172.21.15.110:0/374595173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d007b8e0 con 0x7fa8d007cd30 2024-09-12T02:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.927+0000 7fa8cfe00640 1 --2- 172.21.15.110:0/374595173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 0x7fa8d007b190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009820 tx=0x7fa8c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc93424add815fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.927+0000 7fa8cea00640 1 -- 172.21.15.110:0/374595173 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8c0037070 con 0x7fa8d007cd30 2024-09-12T02:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.927+0000 7fa8cea00640 1 -- 172.21.15.110:0/374595173 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8c0032920 con 0x7fa8d007cd30 2024-09-12T02:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.927+0000 7fa8cea00640 1 -- 172.21.15.110:0/374595173 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8c0030810 con 0x7fa8d007cd30 2024-09-12T02:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.928+0000 7fa8d5600640 1 -- 172.21.15.110:0/374595173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 msgr2=0x7fa8d007b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.928+0000 7fa8d5600640 1 --2- 172.21.15.110:0/374595173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 0x7fa8d007b190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009820 tx=0x7fa8c002a270 comp rx=0 tx=0).stop 2024-09-12T02:04:52.327 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.928+0000 7fa8d5600640 1 -- 172.21.15.110:0/374595173 shutdown_connections 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.928+0000 7fa8d5600640 1 --2- 172.21.15.110:0/374595173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 0x7fa8d007b190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.928+0000 7fa8d5600640 1 -- 172.21.15.110:0/374595173 >> 172.21.15.110:0/374595173 conn(0x7fa8d0102b90 msgr2=0x7fa8d0104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.928+0000 7fa8d5600640 1 -- 172.21.15.110:0/374595173 shutdown_connections 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.928+0000 7fa8d5600640 1 -- 172.21.15.110:0/374595173 wait complete. 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.929+0000 7fa8d5600640 1 Processor -- start 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.929+0000 7fa8d5600640 1 -- start start 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.929+0000 7fa8d5600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 0x7fa8d019d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.929+0000 7fa8d5600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d010da70 con 0x7fa8d007cd30 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.929+0000 7fa8cfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 0x7fa8d019d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.929+0000 7fa8cfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 0x7fa8d019d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46752/0 (socket says 172.21.15.110:46752) 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.929+0000 7fa8cfe00640 1 -- 172.21.15.110:0/1260403929 learned_addr learned my addr 172.21.15.110:0/1260403929 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.930+0000 7fa8cfe00640 1 -- 172.21.15.110:0/1260403929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d019daf0 con 0x7fa8d007cd30 2024-09-12T02:04:52.328 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.930+0000 7fa8cfe00640 1 --2- 172.21.15.110:0/1260403929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 0x7fa8d019d5b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00097f0 tx=0x7fa8c00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.930+0000 7fa8ccc00640 1 -- 172.21.15.110:0/1260403929 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8c0037040 con 0x7fa8d007cd30 2024-09-12T02:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.930+0000 7fa8ccc00640 1 -- 172.21.15.110:0/1260403929 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8c0030cc0 con 0x7fa8d007cd30 2024-09-12T02:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.930+0000 7fa8ccc00640 1 -- 172.21.15.110:0/1260403929 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa8c003a6b0 con 0x7fa8d007cd30 2024-09-12T02:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.930+0000 7fa8d5600640 1 -- 172.21.15.110:0/1260403929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d019dd80 con 0x7fa8d007cd30 2024-09-12T02:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.930+0000 7fa8d5600640 1 -- 172.21.15.110:0/1260403929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d01a0a70 con 0x7fa8d007cd30 2024-09-12T02:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.932+0000 7fa8ccc00640 1 -- 172.21.15.110:0/1260403929 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fa8c003baf0 con 0x7fa8d007cd30 2024-09-12T02:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.932+0000 7fa8d5600640 1 -- 172.21.15.110:0/1260403929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d007b210 con 0x7fa8d007cd30 2024-09-12T02:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.932+0000 7fa8ccc00640 1 --2- 172.21.15.110:0/1260403929 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa8b4039020 0x7fa8b403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.932+0000 7fa8ccc00640 1 -- 172.21.15.110:0/1260403929 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa8c006c640 con 0x7fa8d007cd30 2024-09-12T02:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.932+0000 7fa8cf400640 1 --2- 172.21.15.110:0/1260403929 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa8b4039020 0x7fa8b403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.933+0000 7fa8cf400640 1 --2- 172.21.15.110:0/1260403929 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa8b4039020 0x7fa8b403b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0098c0 tx=0x7fa8bc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:52.329 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:50.938+0000 7fa8ccc00640 1 -- 172.21.15.110:0/1260403929 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa8c0042e10 con 0x7fa8d007cd30 2024-09-12T02:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:51.123+0000 7fa8d5600640 1 -- 172.21.15.110:0/1260403929 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fa8d01a1060 con 0x7fa8d007cd30 2024-09-12T02:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:51.123+0000 7fa8ccc00640 1 -- 172.21.15.110:0/1260403929 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fa8c003a850 con 0x7fa8d007cd30 2024-09-12T02:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:51.125+0000 7fa8d5600640 1 -- 172.21.15.110:0/1260403929 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa8b4039020 msgr2=0x7fa8b403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:51.125+0000 7fa8d5600640 1 --2- 172.21.15.110:0/1260403929 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa8b4039020 0x7fa8b403b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0098c0 tx=0x7fa8bc006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:51.125+0000 7fa8d5600640 1 -- 172.21.15.110:0/1260403929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 msgr2=0x7fa8d019d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:51.125+0000 7fa8d5600640 1 --2- 172.21.15.110:0/1260403929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 0x7fa8d019d5b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00097f0 tx=0x7fa8c00327b0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:51.125+0000 7fa8d5600640 1 -- 172.21.15.110:0/1260403929 shutdown_connections 2024-09-12T02:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:51.125+0000 7fa8d5600640 1 --2- 172.21.15.110:0/1260403929 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa8b4039020 0x7fa8b403b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:51.125+0000 7fa8d5600640 1 --2- 172.21.15.110:0/1260403929 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d007cd30 0x7fa8d019d5b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:51.125+0000 7fa8d5600640 1 -- 172.21.15.110:0/1260403929 >> 172.21.15.110:0/1260403929 conn(0x7fa8d0102b90 msgr2=0x7fa8d01036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:51.126+0000 7fa8d5600640 1 -- 172.21.15.110:0/1260403929 shutdown_connections 2024-09-12T02:04:52.330 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:51.126+0000 7fa8d5600640 1 -- 172.21.15.110:0/1260403929 wait complete. 2024-09-12T02:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T02:04:52.345 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout disabled 2024-09-12T02:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T02:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout:systemctl: stdout inactive 2024-09-12T02:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout:firewalld.service is not enabled 2024-09-12T02:04:52.359 INFO:teuthology.orchestra.run.smithi110.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T02:04:52.361 INFO:teuthology.orchestra.run.smithi110.stdout:Ceph Dashboard is now available at: 2024-09-12T02:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: URL: https://smithi110.front.sepia.ceph.com:8443/ 2024-09-12T02:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: User: admin 2024-09-12T02:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: Password: wccuwwjej0 2024-09-12T02:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:04:52.362 INFO:teuthology.orchestra.run.smithi110.stdout:Saving cluster configuration to /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config directory 2024-09-12T02:04:52.578 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:52 smithi110 ceph-mon[30548]: mgrmap e13: x(active, since 6s) 2024-09-12T02:04:54.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.321+0000 7f5698000640 1 Processor -- start 2024-09-12T02:04:54.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.321+0000 7f5698000640 1 -- start start 2024-09-12T02:04:54.282 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.322+0000 7f5698000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 0x7f5690107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.322+0000 7f5698000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5690107f00 con 0x7f5690107530 2024-09-12T02:04:54.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.322+0000 7f5695600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 0x7f5690107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.322+0000 7f5695600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 0x7f5690107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46760/0 (socket says 172.21.15.110:46760) 2024-09-12T02:04:54.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.322+0000 7f5695600640 1 -- 172.21.15.110:0/3486349013 learned_addr learned my addr 172.21.15.110:0/3486349013 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:54.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.322+0000 7f5695600640 1 -- 172.21.15.110:0/3486349013 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5690108730 con 0x7f5690107530 2024-09-12T02:04:54.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.323+0000 7f5695600640 1 --2- 172.21.15.110:0/3486349013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 0x7f5690107930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5684009820 tx=0x7f568402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2438f2439ca2429 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:54.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.324+0000 7f568fe00640 1 -- 172.21.15.110:0/3486349013 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5684037070 con 0x7f5690107530 2024-09-12T02:04:54.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.324+0000 7f568fe00640 1 -- 172.21.15.110:0/3486349013 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5684032920 con 0x7f5690107530 2024-09-12T02:04:54.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.324+0000 7f568fe00640 1 -- 172.21.15.110:0/3486349013 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5684030810 con 0x7f5690107530 2024-09-12T02:04:54.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.324+0000 7f5698000640 1 -- 172.21.15.110:0/3486349013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 msgr2=0x7f5690107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.283 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.324+0000 7f5698000640 1 --2- 172.21.15.110:0/3486349013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 0x7f5690107930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5684009820 tx=0x7f568402a270 comp rx=0 tx=0).stop 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.324+0000 7f5698000640 1 -- 172.21.15.110:0/3486349013 shutdown_connections 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.324+0000 7f5698000640 1 --2- 172.21.15.110:0/3486349013 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 0x7f5690107930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.324+0000 7f5698000640 1 -- 172.21.15.110:0/3486349013 >> 172.21.15.110:0/3486349013 conn(0x7f5690102cc0 msgr2=0x7f5690105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.324+0000 7f5698000640 1 -- 172.21.15.110:0/3486349013 shutdown_connections 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.325+0000 7f5698000640 1 -- 172.21.15.110:0/3486349013 wait complete. 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.325+0000 7f5698000640 1 Processor -- start 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.325+0000 7f5698000640 1 -- start start 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.326+0000 7f5698000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 0x7f569019d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.326+0000 7f5698000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f569010bae0 con 0x7f5690107530 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.326+0000 7f5695600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 0x7f569019d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.326+0000 7f5695600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 0x7f569019d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46774/0 (socket says 172.21.15.110:46774) 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.326+0000 7f5695600640 1 -- 172.21.15.110:0/2544633303 learned_addr learned my addr 172.21.15.110:0/2544633303 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:54.284 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.326+0000 7f5695600640 1 -- 172.21.15.110:0/2544633303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569019dcf0 con 0x7f5690107530 2024-09-12T02:04:54.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.327+0000 7f5695600640 1 --2- 172.21.15.110:0/2544633303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 0x7f569019d7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56840097f0 tx=0x7f56840327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:54.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.327+0000 7f568e000640 1 -- 172.21.15.110:0/2544633303 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5684037040 con 0x7f5690107530 2024-09-12T02:04:54.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.327+0000 7f568e000640 1 -- 172.21.15.110:0/2544633303 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5684030cc0 con 0x7f5690107530 2024-09-12T02:04:54.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.327+0000 7f568e000640 1 -- 172.21.15.110:0/2544633303 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f568403a640 con 0x7f5690107530 2024-09-12T02:04:54.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.327+0000 7f5698000640 1 -- 172.21.15.110:0/2544633303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569019df80 con 0x7f5690107530 2024-09-12T02:04:54.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.327+0000 7f5698000640 1 -- 172.21.15.110:0/2544633303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56901a0c70 con 0x7f5690107530 2024-09-12T02:04:54.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.328+0000 7f568e000640 1 -- 172.21.15.110:0/2544633303 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f568403b3f0 con 0x7f5690107530 2024-09-12T02:04:54.285 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.328+0000 7f5698000640 1 -- 172.21.15.110:0/2544633303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569010bc60 con 0x7f5690107530 2024-09-12T02:04:54.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.328+0000 7f568e000640 1 --2- 172.21.15.110:0/2544633303 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5678039060 0x7f567803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:54.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.328+0000 7f568e000640 1 -- 172.21.15.110:0/2544633303 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f568406c7a0 con 0x7f5690107530 2024-09-12T02:04:54.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.329+0000 7f5694c00640 1 --2- 172.21.15.110:0/2544633303 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5678039060 0x7f567803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:54.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.329+0000 7f5694c00640 1 --2- 172.21.15.110:0/2544633303 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5678039060 0x7f567803b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f567c0098c0 tx=0x7f567c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:54.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.333+0000 7f568e000640 1 -- 172.21.15.110:0/2544633303 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5684043e10 con 0x7f5690107530 2024-09-12T02:04:54.288 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.596+0000 7f5698000640 1 -- 172.21.15.110:0/2544633303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f56901a0e40 con 0x7f5690107530 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.599+0000 7f568e000640 1 -- 172.21.15.110:0/2544633303 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f568403ba40 con 0x7f5690107530 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.601+0000 7f5698000640 1 -- 172.21.15.110:0/2544633303 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5678039060 msgr2=0x7f567803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.601+0000 7f5698000640 1 --2- 172.21.15.110:0/2544633303 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5678039060 0x7f567803b520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f567c0098c0 tx=0x7f567c006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.601+0000 7f5698000640 1 -- 172.21.15.110:0/2544633303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 msgr2=0x7f569019d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.601+0000 7f5698000640 1 --2- 172.21.15.110:0/2544633303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 0x7f569019d7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f56840097f0 tx=0x7f56840327b0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.602+0000 7f5698000640 1 -- 172.21.15.110:0/2544633303 shutdown_connections 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.602+0000 7f5698000640 1 --2- 172.21.15.110:0/2544633303 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5678039060 0x7f567803b520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.602+0000 7f5698000640 1 --2- 172.21.15.110:0/2544633303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5690107530 0x7f569019d7b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.602+0000 7f5698000640 1 -- 172.21.15.110:0/2544633303 >> 172.21.15.110:0/2544633303 conn(0x7f5690102cc0 msgr2=0x7f5690103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.602+0000 7f5698000640 1 -- 172.21.15.110:0/2544633303 shutdown_connections 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/bin/ceph: stderr 2024-09-12T02:04:53.602+0000 7f5698000640 1 -- 172.21.15.110:0/2544633303 wait complete. 2024-09-12T02:04:54.289 INFO:teuthology.orchestra.run.smithi110.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout: ceph telemetry on 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout:For more information see: 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:04:54.290 INFO:teuthology.orchestra.run.smithi110.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-12T02:04:54.291 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:04:54.291 INFO:teuthology.orchestra.run.smithi110.stdout:Bootstrap complete. 2024-09-12T02:04:54.337 INFO:tasks.cephadm:Fetching config... 2024-09-12T02:04:54.337 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:04:54.337 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T02:04:54.373 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T02:04:54.373 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:04:54.373 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T02:04:54.449 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T02:04:54.450 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:04:54.450 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-12T02:04:54.546 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T02:04:54.546 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:04:54.546 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T02:04:54.622 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T02:04:54.622 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW90JcbPTu4OXHy4V42pO6DE+hi+mFMKUUj3KD3JYrPRGXj2/FVIYJqfiuOyORFVi7QXUBQVFCTKNwFS696nE0rJv5Qidv0SQRhryk8eRPxq/SJZQ8KKGfMox/QsNh5M2Ebn5eKeeU1ME6N86HBQoYUPkjDWDtmSogz8iorr4is+OvUb4Vki9CP2vP7MV8cs7vyuvGyPRSmUA/GEmceiaXfF+xWxZUWQWxE2zDfspzp0m4y4ypAhNmP/VYaoXZ0kwDJL2yVdwGt0K5Uc4di0wwECnrqu+/MeKLt0ENAZy+U2iD04Iuy5/uRz8PGxsnzZ4kqZIFtIFnBICevxN9LiLl/Fpg0ICU7746po+jVoyNqhUSzfzlWuv2VgaMAwTh/cbj6JbZZySfUY5gsy67RmEmc1o/GfP5TVO/HkVH4Glkkg1rmnqa3gVl1ca8cprKht5GC3zrW9vn+GtCpWjsaKcxN8fnic6xcVBuCWsDbuH0zMy3vnKaKj3hNkaQcCDlP10= ceph-10ead734-70ab-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:04:54.741 INFO:teuthology.orchestra.run.smithi110.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW90JcbPTu4OXHy4V42pO6DE+hi+mFMKUUj3KD3JYrPRGXj2/FVIYJqfiuOyORFVi7QXUBQVFCTKNwFS696nE0rJv5Qidv0SQRhryk8eRPxq/SJZQ8KKGfMox/QsNh5M2Ebn5eKeeU1ME6N86HBQoYUPkjDWDtmSogz8iorr4is+OvUb4Vki9CP2vP7MV8cs7vyuvGyPRSmUA/GEmceiaXfF+xWxZUWQWxE2zDfspzp0m4y4ypAhNmP/VYaoXZ0kwDJL2yVdwGt0K5Uc4di0wwECnrqu+/MeKLt0ENAZy+U2iD04Iuy5/uRz8PGxsnzZ4kqZIFtIFnBICevxN9LiLl/Fpg0ICU7746po+jVoyNqhUSzfzlWuv2VgaMAwTh/cbj6JbZZySfUY5gsy67RmEmc1o/GfP5TVO/HkVH4Glkkg1rmnqa3gVl1ca8cprKht5GC3zrW9vn+GtCpWjsaKcxN8fnic6xcVBuCWsDbuH0zMy3vnKaKj3hNkaQcCDlP10= ceph-10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:04:54.766 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW90JcbPTu4OXHy4V42pO6DE+hi+mFMKUUj3KD3JYrPRGXj2/FVIYJqfiuOyORFVi7QXUBQVFCTKNwFS696nE0rJv5Qidv0SQRhryk8eRPxq/SJZQ8KKGfMox/QsNh5M2Ebn5eKeeU1ME6N86HBQoYUPkjDWDtmSogz8iorr4is+OvUb4Vki9CP2vP7MV8cs7vyuvGyPRSmUA/GEmceiaXfF+xWxZUWQWxE2zDfspzp0m4y4ypAhNmP/VYaoXZ0kwDJL2yVdwGt0K5Uc4di0wwECnrqu+/MeKLt0ENAZy+U2iD04Iuy5/uRz8PGxsnzZ4kqZIFtIFnBICevxN9LiLl/Fpg0ICU7746po+jVoyNqhUSzfzlWuv2VgaMAwTh/cbj6JbZZySfUY5gsy67RmEmc1o/GfP5TVO/HkVH4Glkkg1rmnqa3gVl1ca8cprKht5GC3zrW9vn+GtCpWjsaKcxN8fnic6xcVBuCWsDbuH0zMy3vnKaKj3hNkaQcCDlP10= ceph-10ead734-70ab-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:04:54.809 INFO:teuthology.orchestra.run.smithi115.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW90JcbPTu4OXHy4V42pO6DE+hi+mFMKUUj3KD3JYrPRGXj2/FVIYJqfiuOyORFVi7QXUBQVFCTKNwFS696nE0rJv5Qidv0SQRhryk8eRPxq/SJZQ8KKGfMox/QsNh5M2Ebn5eKeeU1ME6N86HBQoYUPkjDWDtmSogz8iorr4is+OvUb4Vki9CP2vP7MV8cs7vyuvGyPRSmUA/GEmceiaXfF+xWxZUWQWxE2zDfspzp0m4y4ypAhNmP/VYaoXZ0kwDJL2yVdwGt0K5Uc4di0wwECnrqu+/MeKLt0ENAZy+U2iD04Iuy5/uRz8PGxsnzZ4kqZIFtIFnBICevxN9LiLl/Fpg0ICU7746po+jVoyNqhUSzfzlWuv2VgaMAwTh/cbj6JbZZySfUY5gsy67RmEmc1o/GfP5TVO/HkVH4Glkkg1rmnqa3gVl1ca8cprKht5GC3zrW9vn+GtCpWjsaKcxN8fnic6xcVBuCWsDbuH0zMy3vnKaKj3hNkaQcCDlP10= ceph-10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:04:54.812 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:54 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2544633303' entity='client.admin' 2024-09-12T02:04:54.822 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW90JcbPTu4OXHy4V42pO6DE+hi+mFMKUUj3KD3JYrPRGXj2/FVIYJqfiuOyORFVi7QXUBQVFCTKNwFS696nE0rJv5Qidv0SQRhryk8eRPxq/SJZQ8KKGfMox/QsNh5M2Ebn5eKeeU1ME6N86HBQoYUPkjDWDtmSogz8iorr4is+OvUb4Vki9CP2vP7MV8cs7vyuvGyPRSmUA/GEmceiaXfF+xWxZUWQWxE2zDfspzp0m4y4ypAhNmP/VYaoXZ0kwDJL2yVdwGt0K5Uc4di0wwECnrqu+/MeKLt0ENAZy+U2iD04Iuy5/uRz8PGxsnzZ4kqZIFtIFnBICevxN9LiLl/Fpg0ICU7746po+jVoyNqhUSzfzlWuv2VgaMAwTh/cbj6JbZZySfUY5gsy67RmEmc1o/GfP5TVO/HkVH4Glkkg1rmnqa3gVl1ca8cprKht5GC3zrW9vn+GtCpWjsaKcxN8fnic6xcVBuCWsDbuH0zMy3vnKaKj3hNkaQcCDlP10= ceph-10ead734-70ab-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T02:04:54.864 INFO:teuthology.orchestra.run.smithi136.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW90JcbPTu4OXHy4V42pO6DE+hi+mFMKUUj3KD3JYrPRGXj2/FVIYJqfiuOyORFVi7QXUBQVFCTKNwFS696nE0rJv5Qidv0SQRhryk8eRPxq/SJZQ8KKGfMox/QsNh5M2Ebn5eKeeU1ME6N86HBQoYUPkjDWDtmSogz8iorr4is+OvUb4Vki9CP2vP7MV8cs7vyuvGyPRSmUA/GEmceiaXfF+xWxZUWQWxE2zDfspzp0m4y4ypAhNmP/VYaoXZ0kwDJL2yVdwGt0K5Uc4di0wwECnrqu+/MeKLt0ENAZy+U2iD04Iuy5/uRz8PGxsnzZ4kqZIFtIFnBICevxN9LiLl/Fpg0ICU7746po+jVoyNqhUSzfzlWuv2VgaMAwTh/cbj6JbZZySfUY5gsy67RmEmc1o/GfP5TVO/HkVH4Glkkg1rmnqa3gVl1ca8cprKht5GC3zrW9vn+GtCpWjsaKcxN8fnic6xcVBuCWsDbuH0zMy3vnKaKj3hNkaQcCDlP10= ceph-10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:04:54.879 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T02:04:55.241 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:55.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.841+0000 7fec39600640 1 -- 172.21.15.110:0/3977359228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec34103820 msgr2=0x7fec34103c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:55.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.841+0000 7fec39600640 1 --2- 172.21.15.110:0/3977359228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec34103820 0x7fec34103c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec24009880 tx=0x7fec2402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.841+0000 7fec39600640 1 -- 172.21.15.110:0/3977359228 shutdown_connections 2024-09-12T02:04:55.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.841+0000 7fec39600640 1 --2- 172.21.15.110:0/3977359228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec34103820 0x7fec34103c20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:55.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.841+0000 7fec39600640 1 -- 172.21.15.110:0/3977359228 >> 172.21.15.110:0/3977359228 conn(0x7fec340feff0 msgr2=0x7fec34101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:55.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.841+0000 7fec39600640 1 -- 172.21.15.110:0/3977359228 shutdown_connections 2024-09-12T02:04:55.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.842+0000 7fec39600640 1 -- 172.21.15.110:0/3977359228 wait complete. 2024-09-12T02:04:55.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.842+0000 7fec39600640 1 Processor -- start 2024-09-12T02:04:55.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.843+0000 7fec39600640 1 -- start start 2024-09-12T02:04:55.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.843+0000 7fec39600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec34103820 0x7fec34198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:55.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.843+0000 7fec39600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fec34109930 con 0x7fec34103820 2024-09-12T02:04:55.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.843+0000 7fec32a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec34103820 0x7fec34198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.843+0000 7fec32a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec34103820 0x7fec34198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46796/0 (socket says 172.21.15.110:46796) 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.843+0000 7fec32a00640 1 -- 172.21.15.110:0/3584346421 learned_addr learned my addr 172.21.15.110:0/3584346421 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.843+0000 7fec32a00640 1 -- 172.21.15.110:0/3584346421 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec341994c0 con 0x7fec34103820 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.844+0000 7fec32a00640 1 --2- 172.21.15.110:0/3584346421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec34103820 0x7fec34198f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec24004f60 tx=0x7fec240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.844+0000 7fec2b400640 1 -- 172.21.15.110:0/3584346421 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec2403f070 con 0x7fec34103820 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.844+0000 7fec2b400640 1 -- 172.21.15.110:0/3584346421 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec24004cc0 con 0x7fec34103820 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.844+0000 7fec39600640 1 -- 172.21.15.110:0/3584346421 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec34199750 con 0x7fec34103820 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.844+0000 7fec2b400640 1 -- 172.21.15.110:0/3584346421 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec24035030 con 0x7fec34103820 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.844+0000 7fec39600640 1 -- 172.21.15.110:0/3584346421 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec3419c440 con 0x7fec34103820 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.846+0000 7fec2b400640 1 -- 172.21.15.110:0/3584346421 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fec24042070 con 0x7fec34103820 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.846+0000 7fec39600640 1 -- 172.21.15.110:0/3584346421 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3410a0b0 con 0x7fec34103820 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.846+0000 7fec2b400640 1 --2- 172.21.15.110:0/3584346421 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fec180390c0 0x7fec1803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:55.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.846+0000 7fec2b400640 1 -- 172.21.15.110:0/3584346421 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fec2406cf30 con 0x7fec34103820 2024-09-12T02:04:55.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.846+0000 7fec32000640 1 --2- 172.21.15.110:0/3584346421 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fec180390c0 0x7fec1803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:55.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.847+0000 7fec32000640 1 --2- 172.21.15.110:0/3584346421 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fec180390c0 0x7fec1803b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec200098c0 tx=0x7fec20006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:55.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:55.852+0000 7fec2b400640 1 -- 172.21.15.110:0/3584346421 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec240303a0 con 0x7fec34103820 2024-09-12T02:04:56.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:56.033+0000 7fec39600640 1 -- 172.21.15.110:0/3584346421 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fec3402d830 con 0x7fec34103820 2024-09-12T02:04:56.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:56.035+0000 7fec2b400640 1 -- 172.21.15.110:0/3584346421 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fec24003dd0 con 0x7fec34103820 2024-09-12T02:04:56.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:56.038+0000 7fec39600640 1 -- 172.21.15.110:0/3584346421 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fec180390c0 msgr2=0x7fec1803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:56.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:56.038+0000 7fec39600640 1 --2- 172.21.15.110:0/3584346421 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fec180390c0 0x7fec1803b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec200098c0 tx=0x7fec20006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:56.038+0000 7fec39600640 1 -- 172.21.15.110:0/3584346421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec34103820 msgr2=0x7fec34198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:56.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:56.038+0000 7fec39600640 1 --2- 172.21.15.110:0/3584346421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec34103820 0x7fec34198f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec24004f60 tx=0x7fec240048f0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:56.038+0000 7fec39600640 1 -- 172.21.15.110:0/3584346421 shutdown_connections 2024-09-12T02:04:56.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:56.038+0000 7fec39600640 1 --2- 172.21.15.110:0/3584346421 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fec180390c0 0x7fec1803b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:56.038+0000 7fec39600640 1 --2- 172.21.15.110:0/3584346421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec34103820 0x7fec34198f80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:56.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:56.038+0000 7fec39600640 1 -- 172.21.15.110:0/3584346421 >> 172.21.15.110:0/3584346421 conn(0x7fec340feff0 msgr2=0x7fec340ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:56.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:56.038+0000 7fec39600640 1 -- 172.21.15.110:0/3584346421 shutdown_connections 2024-09-12T02:04:56.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:56.038+0000 7fec39600640 1 -- 172.21.15.110:0/3584346421 wait complete. 2024-09-12T02:04:56.931 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T02:04:56.932 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T02:04:57.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:57 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3584346421' entity='client.admin' 2024-09-12T02:04:57.530 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:04:58.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.260+0000 7fedb6e00640 1 -- 172.21.15.110:0/3743913110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb0076220 msgr2=0x7fedb0074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.260+0000 7fedb6e00640 1 --2- 172.21.15.110:0/3743913110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb0076220 0x7fedb0074680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feda4009880 tx=0x7feda402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.260+0000 7fedb6e00640 1 -- 172.21.15.110:0/3743913110 shutdown_connections 2024-09-12T02:04:58.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.260+0000 7fedb6e00640 1 --2- 172.21.15.110:0/3743913110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb0076220 0x7fedb0074680 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.260+0000 7fedb6e00640 1 -- 172.21.15.110:0/3743913110 >> 172.21.15.110:0/3743913110 conn(0x7fedb00fcb90 msgr2=0x7fedb00fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:58.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.260+0000 7fedb6e00640 1 -- 172.21.15.110:0/3743913110 shutdown_connections 2024-09-12T02:04:58.357 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.260+0000 7fedb6e00640 1 -- 172.21.15.110:0/3743913110 wait complete. 2024-09-12T02:04:58.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.261+0000 7fedb6e00640 1 Processor -- start 2024-09-12T02:04:58.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.261+0000 7fedb6e00640 1 -- start start 2024-09-12T02:04:58.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.261+0000 7fedb6e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb0076220 0x7fedb019d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.261+0000 7fedb6e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fedb010db60 con 0x7fedb0076220 2024-09-12T02:04:58.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.262+0000 7fedb5a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb0076220 0x7fedb019d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.262+0000 7fedb5a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb0076220 0x7fedb019d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46824/0 (socket says 172.21.15.110:46824) 2024-09-12T02:04:58.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.262+0000 7fedb5a00640 1 -- 172.21.15.110:0/993257627 learned_addr learned my addr 172.21.15.110:0/993257627 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:04:58.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.262+0000 7fedb5a00640 1 -- 172.21.15.110:0/993257627 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb019d730 con 0x7fedb0076220 2024-09-12T02:04:58.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.262+0000 7fedb5a00640 1 --2- 172.21.15.110:0/993257627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb0076220 0x7fedb019d1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feda4004f60 tx=0x7feda40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:58.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.263+0000 7fedae000640 1 -- 172.21.15.110:0/993257627 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda403f070 con 0x7fedb0076220 2024-09-12T02:04:58.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.263+0000 7fedb6e00640 1 -- 172.21.15.110:0/993257627 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb019d9c0 con 0x7fedb0076220 2024-09-12T02:04:58.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.263+0000 7fedae000640 1 -- 172.21.15.110:0/993257627 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feda4004d40 con 0x7fedb0076220 2024-09-12T02:04:58.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.263+0000 7fedae000640 1 -- 172.21.15.110:0/993257627 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feda4035030 con 0x7fedb0076220 2024-09-12T02:04:58.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.263+0000 7fedb6e00640 1 -- 172.21.15.110:0/993257627 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb01a06b0 con 0x7fedb0076220 2024-09-12T02:04:58.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.264+0000 7fedb6e00640 1 -- 172.21.15.110:0/993257627 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb010e2a0 con 0x7fedb0076220 2024-09-12T02:04:58.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.264+0000 7fedae000640 1 -- 172.21.15.110:0/993257627 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7feda4042070 con 0x7fedb0076220 2024-09-12T02:04:58.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.264+0000 7fedae000640 1 --2- 172.21.15.110:0/993257627 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fed98039060 0x7fed9803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:04:58.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.264+0000 7fedae000640 1 -- 172.21.15.110:0/993257627 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7feda406cdd0 con 0x7fedb0076220 2024-09-12T02:04:58.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.265+0000 7fedb5000640 1 --2- 172.21.15.110:0/993257627 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fed98039060 0x7fed9803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:04:58.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.265+0000 7fedb5000640 1 --2- 172.21.15.110:0/993257627 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fed98039060 0x7fed9803b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0098c0 tx=0x7fed9c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:04:58.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.269+0000 7fedae000640 1 -- 172.21.15.110:0/993257627 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feda404a260 con 0x7fedb0076220 2024-09-12T02:04:58.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.458+0000 7fedb6e00640 1 -- 172.21.15.110:0/993257627 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fedb002d830 con 0x7fed98039060 2024-09-12T02:04:58.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.462+0000 7fedae000640 1 -- 172.21.15.110:0/993257627 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fedb002d830 con 0x7fed98039060 2024-09-12T02:04:58.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.464+0000 7fedb6e00640 1 -- 172.21.15.110:0/993257627 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fed98039060 msgr2=0x7fed9803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.464+0000 7fedb6e00640 1 --2- 172.21.15.110:0/993257627 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fed98039060 0x7fed9803b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0098c0 tx=0x7fed9c006db0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.464+0000 7fedb6e00640 1 -- 172.21.15.110:0/993257627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb0076220 msgr2=0x7fedb019d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:04:58.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.464+0000 7fedb6e00640 1 --2- 172.21.15.110:0/993257627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb0076220 0x7fedb019d1f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feda4004f60 tx=0x7feda40048f0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.464+0000 7fedb6e00640 1 -- 172.21.15.110:0/993257627 shutdown_connections 2024-09-12T02:04:58.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.464+0000 7fedb6e00640 1 --2- 172.21.15.110:0/993257627 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fed98039060 0x7fed9803b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.464+0000 7fedb6e00640 1 --2- 172.21.15.110:0/993257627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedb0076220 0x7fedb019d1f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:04:58.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.464+0000 7fedb6e00640 1 -- 172.21.15.110:0/993257627 >> 172.21.15.110:0/993257627 conn(0x7fedb00fcb90 msgr2=0x7fedb00fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:04:58.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.464+0000 7fedb6e00640 1 -- 172.21.15.110:0/993257627 shutdown_connections 2024-09-12T02:04:58.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:04:58.464+0000 7fedb6e00640 1 -- 172.21.15.110:0/993257627 wait complete. 2024-09-12T02:04:58.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:04:58.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:04:58.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi110", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:04:58.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:04:58.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:58.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:04:58.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:04:58.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:04:58.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:04:58.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:04:59.268 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi115 2024-09-12T02:04:59.268 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-12T02:04:59.268 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/etc/ceph/ceph.conf 2024-09-12T02:04:59.287 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-12T02:04:59.287 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:04:59.346 INFO:tasks.cephadm:Adding host smithi115 to orchestrator... 2024-09-12T02:04:59.346 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch host add smithi115 2024-09-12T02:04:59.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:59 smithi110 ceph-mon[30548]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:04:59.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:04:59 smithi110 ceph-mon[30548]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-12T02:05:00.202 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:00.671 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:00 smithi110 ceph-mon[30548]: Updating smithi110:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:00.671 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:00 smithi110 ceph-mon[30548]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:05:00.671 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:00 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:00.671 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:00 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:00.671 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:00 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:00.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.782+0000 7f1351200640 1 -- 172.21.15.110:0/3698753353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c107660 msgr2=0x7f134c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:00.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.782+0000 7f1351200640 1 --2- 172.21.15.110:0/3698753353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c107660 0x7f134c107a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f133c009880 tx=0x7f133c02a5d0 comp rx=0 tx=0).stop 2024-09-12T02:05:00.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.782+0000 7f1351200640 1 -- 172.21.15.110:0/3698753353 shutdown_connections 2024-09-12T02:05:00.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.782+0000 7f1351200640 1 --2- 172.21.15.110:0/3698753353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c107660 0x7f134c107a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:00.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.782+0000 7f1351200640 1 -- 172.21.15.110:0/3698753353 >> 172.21.15.110:0/3698753353 conn(0x7f134c0fd2b0 msgr2=0x7f134c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:00.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.782+0000 7f1351200640 1 -- 172.21.15.110:0/3698753353 shutdown_connections 2024-09-12T02:05:00.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.782+0000 7f1351200640 1 -- 172.21.15.110:0/3698753353 wait complete. 2024-09-12T02:05:00.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.783+0000 7f1351200640 1 Processor -- start 2024-09-12T02:05:00.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.783+0000 7f1351200640 1 -- start start 2024-09-12T02:05:00.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.784+0000 7f1351200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c107660 0x7f134c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:00.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.784+0000 7f1351200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f134c10bc70 con 0x7f134c107660 2024-09-12T02:05:00.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.784+0000 7f1349e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c107660 0x7f134c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:00.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.784+0000 7f1349e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c107660 0x7f134c199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52944/0 (socket says 172.21.15.110:52944) 2024-09-12T02:05:00.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.784+0000 7f1349e00640 1 -- 172.21.15.110:0/3702878605 learned_addr learned my addr 172.21.15.110:0/3702878605 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:05:00.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.784+0000 7f1349e00640 1 -- 172.21.15.110:0/3702878605 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134c199880 con 0x7f134c107660 2024-09-12T02:05:00.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.785+0000 7f1349e00640 1 --2- 172.21.15.110:0/3702878605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c107660 0x7f134c199340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f133c009230 tx=0x7f133c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:00.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.785+0000 7f1342a00640 1 -- 172.21.15.110:0/3702878605 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f133c03f070 con 0x7f134c107660 2024-09-12T02:05:00.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.785+0000 7f1342a00640 1 -- 172.21.15.110:0/3702878605 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f133c03bd40 con 0x7f134c107660 2024-09-12T02:05:00.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.785+0000 7f1342a00640 1 -- 172.21.15.110:0/3702878605 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f133c035030 con 0x7f134c107660 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.785+0000 7f1351200640 1 -- 172.21.15.110:0/3702878605 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134c199b70 con 0x7f134c107660 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.785+0000 7f1351200640 1 -- 172.21.15.110:0/3702878605 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f134c19dc10 con 0x7f134c107660 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.786+0000 7f1342a00640 1 -- 172.21.15.110:0/3702878605 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f133c042070 con 0x7f134c107660 2024-09-12T02:05:00.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.786+0000 7f1351200640 1 -- 172.21.15.110:0/3702878605 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f134c102d10 con 0x7f134c107660 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.787+0000 7f1342a00640 1 --2- 172.21.15.110:0/3702878605 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f13300390c0 0x7f133003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.787+0000 7f1342a00640 1 -- 172.21.15.110:0/3702878605 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f133c06cc70 con 0x7f134c107660 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.787+0000 7f1349400640 1 --2- 172.21.15.110:0/3702878605 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f13300390c0 0x7f133003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:00.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.787+0000 7f1349400640 1 --2- 172.21.15.110:0/3702878605 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f13300390c0 0x7f133003b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f13380098c0 tx=0x7f1338006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:00.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.792+0000 7f1342a00640 1 -- 172.21.15.110:0/3702878605 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f133c030d60 con 0x7f134c107660 2024-09-12T02:05:00.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:00.972+0000 7f1351200640 1 -- 172.21.15.110:0/3702878605 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi115", "target": ["mon-mgr", ""]}) -- 0x7f134c19a6a0 con 0x7f13300390c0 2024-09-12T02:05:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:01 smithi110 ceph-mon[30548]: Updating smithi110:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:05:02.765 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:02 smithi110 ceph-mon[30548]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi115", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:03.918 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:03 smithi110 ceph-mon[30548]: Deploying cephadm binary to smithi115 2024-09-12T02:05:04.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:04.103+0000 7f1342a00640 1 -- 172.21.15.110:0/3702878605 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f134c19a6a0 con 0x7f13300390c0 2024-09-12T02:05:04.104 INFO:teuthology.orchestra.run.smithi110.stdout:Added host 'smithi115' with addr '172.21.15.115' 2024-09-12T02:05:04.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:04.106+0000 7f1351200640 1 -- 172.21.15.110:0/3702878605 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f13300390c0 msgr2=0x7f133003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:04.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:04.106+0000 7f1351200640 1 --2- 172.21.15.110:0/3702878605 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f13300390c0 0x7f133003b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f13380098c0 tx=0x7f1338006db0 comp rx=0 tx=0).stop 2024-09-12T02:05:04.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:04.106+0000 7f1351200640 1 -- 172.21.15.110:0/3702878605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c107660 msgr2=0x7f134c199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:04.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:04.106+0000 7f1351200640 1 --2- 172.21.15.110:0/3702878605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c107660 0x7f134c199340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f133c009230 tx=0x7f133c003d80 comp rx=0 tx=0).stop 2024-09-12T02:05:04.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:04.106+0000 7f1351200640 1 -- 172.21.15.110:0/3702878605 shutdown_connections 2024-09-12T02:05:04.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:04.106+0000 7f1351200640 1 --2- 172.21.15.110:0/3702878605 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f13300390c0 0x7f133003b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:04.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:04.106+0000 7f1351200640 1 --2- 172.21.15.110:0/3702878605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f134c107660 0x7f134c199340 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:04.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:04.106+0000 7f1351200640 1 -- 172.21.15.110:0/3702878605 >> 172.21.15.110:0/3702878605 conn(0x7f134c0fd2b0 msgr2=0x7f134c075e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:04.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:04.106+0000 7f1351200640 1 -- 172.21.15.110:0/3702878605 shutdown_connections 2024-09-12T02:05:04.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:04.106+0000 7f1351200640 1 -- 172.21.15.110:0/3702878605 wait complete. 2024-09-12T02:05:04.773 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T02:05:05.130 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:05.377 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:05.378 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:05 smithi110 ceph-mon[30548]: Added host smithi115 2024-09-12T02:05:05.378 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:05.378 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:05.378 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:05.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.646+0000 7ffaf4e00640 1 -- 172.21.15.110:0/280506511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffaf0107690 msgr2=0x7ffaf0107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:05.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.646+0000 7ffaf4e00640 1 --2- 172.21.15.110:0/280506511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffaf0107690 0x7ffaf0107a70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009880 tx=0x7ffae002a670 comp rx=0 tx=0).stop 2024-09-12T02:05:05.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.647+0000 7ffaf4e00640 1 -- 172.21.15.110:0/280506511 shutdown_connections 2024-09-12T02:05:05.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.647+0000 7ffaf4e00640 1 --2- 172.21.15.110:0/280506511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffaf0107690 0x7ffaf0107a70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:05.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.647+0000 7ffaf4e00640 1 -- 172.21.15.110:0/280506511 >> 172.21.15.110:0/280506511 conn(0x7ffaf00fb920 msgr2=0x7ffaf00fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:05.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.647+0000 7ffaf4e00640 1 -- 172.21.15.110:0/280506511 shutdown_connections 2024-09-12T02:05:05.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.647+0000 7ffaf4e00640 1 -- 172.21.15.110:0/280506511 wait complete. 2024-09-12T02:05:05.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.648+0000 7ffaf4e00640 1 Processor -- start 2024-09-12T02:05:05.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.648+0000 7ffaf4e00640 1 -- start start 2024-09-12T02:05:05.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.649+0000 7ffaf4e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffaf0107690 0x7ffaf0197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:05.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.649+0000 7ffaf4e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf010bc80 con 0x7ffaf0107690 2024-09-12T02:05:05.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.649+0000 7ffaede00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffaf0107690 0x7ffaf0197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.649+0000 7ffaede00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffaf0107690 0x7ffaf0197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52964/0 (socket says 172.21.15.110:52964) 2024-09-12T02:05:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.649+0000 7ffaede00640 1 -- 172.21.15.110:0/2462500444 learned_addr learned my addr 172.21.15.110:0/2462500444 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:05:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.649+0000 7ffaede00640 1 -- 172.21.15.110:0/2462500444 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf0197660 con 0x7ffaf0107690 2024-09-12T02:05:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.649+0000 7ffaede00640 1 --2- 172.21.15.110:0/2462500444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffaf0107690 0x7ffaf0197120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009230 tx=0x7ffae0003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.650+0000 7ffae7400640 1 -- 172.21.15.110:0/2462500444 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffae003f070 con 0x7ffaf0107690 2024-09-12T02:05:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.650+0000 7ffaf4e00640 1 -- 172.21.15.110:0/2462500444 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf0197950 con 0x7ffaf0107690 2024-09-12T02:05:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.650+0000 7ffae7400640 1 -- 172.21.15.110:0/2462500444 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffae003bd40 con 0x7ffaf0107690 2024-09-12T02:05:05.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.650+0000 7ffae7400640 1 -- 172.21.15.110:0/2462500444 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffae0035030 con 0x7ffaf0107690 2024-09-12T02:05:05.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.650+0000 7ffaf4e00640 1 -- 172.21.15.110:0/2462500444 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf019b9f0 con 0x7ffaf0107690 2024-09-12T02:05:05.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.651+0000 7ffae7400640 1 -- 172.21.15.110:0/2462500444 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7ffae0042070 con 0x7ffaf0107690 2024-09-12T02:05:05.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.651+0000 7ffaf4e00640 1 -- 172.21.15.110:0/2462500444 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf0102d30 con 0x7ffaf0107690 2024-09-12T02:05:05.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.652+0000 7ffae7400640 1 --2- 172.21.15.110:0/2462500444 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ffad4039060 0x7ffad403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:05.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.652+0000 7ffae7400640 1 -- 172.21.15.110:0/2462500444 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ffae006cc30 con 0x7ffaf0107690 2024-09-12T02:05:05.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.652+0000 7ffae5400640 1 --2- 172.21.15.110:0/2462500444 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ffad4039060 0x7ffad403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:05.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.653+0000 7ffae5400640 1 --2- 172.21.15.110:0/2462500444 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ffad4039060 0x7ffad403b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffad800ad30 tx=0x7ffad80093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:05.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.657+0000 7ffae7400640 1 -- 172.21.15.110:0/2462500444 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffae0036df0 con 0x7ffaf0107690 2024-09-12T02:05:05.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.836+0000 7ffaf4e00640 1 -- 172.21.15.110:0/2462500444 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffaf0198480 con 0x7ffad4039060 2024-09-12T02:05:05.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.838+0000 7ffae7400640 1 -- 172.21.15.110:0/2462500444 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7ffaf0198480 con 0x7ffad4039060 2024-09-12T02:05:05.838 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:05:05.838 INFO:teuthology.orchestra.run.smithi110.stdout:[{"addr": "172.21.15.110", "hostname": "smithi110", "labels": [], "status": ""}, {"addr": "172.21.15.115", "hostname": "smithi115", "labels": [], "status": ""}] 2024-09-12T02:05:05.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.840+0000 7ffaf4e00640 1 -- 172.21.15.110:0/2462500444 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ffad4039060 msgr2=0x7ffad403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:05.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.840+0000 7ffaf4e00640 1 --2- 172.21.15.110:0/2462500444 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ffad4039060 0x7ffad403b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffad800ad30 tx=0x7ffad80093f0 comp rx=0 tx=0).stop 2024-09-12T02:05:05.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.840+0000 7ffaf4e00640 1 -- 172.21.15.110:0/2462500444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffaf0107690 msgr2=0x7ffaf0197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:05.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.840+0000 7ffaf4e00640 1 --2- 172.21.15.110:0/2462500444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffaf0107690 0x7ffaf0197120 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009230 tx=0x7ffae0003d80 comp rx=0 tx=0).stop 2024-09-12T02:05:05.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.840+0000 7ffaf4e00640 1 -- 172.21.15.110:0/2462500444 shutdown_connections 2024-09-12T02:05:05.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.840+0000 7ffaf4e00640 1 --2- 172.21.15.110:0/2462500444 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ffad4039060 0x7ffad403b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:05.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.840+0000 7ffaf4e00640 1 --2- 172.21.15.110:0/2462500444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffaf0107690 0x7ffaf0197120 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:05.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.840+0000 7ffaf4e00640 1 -- 172.21.15.110:0/2462500444 >> 172.21.15.110:0/2462500444 conn(0x7ffaf00fb920 msgr2=0x7ffaf00fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:05.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.841+0000 7ffaf4e00640 1 -- 172.21.15.110:0/2462500444 shutdown_connections 2024-09-12T02:05:05.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:05.841+0000 7ffaf4e00640 1 -- 172.21.15.110:0/2462500444 wait complete. 2024-09-12T02:05:06.591 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:06 smithi110 ceph-mon[30548]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:06.591 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:06 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:06.630 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi136 2024-09-12T02:05:06.631 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-12T02:05:06.631 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.conf 2024-09-12T02:05:06.649 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-12T02:05:06.649 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:05:06.705 INFO:tasks.cephadm:Adding host smithi136 to orchestrator... 2024-09-12T02:05:06.705 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch host add smithi136 2024-09-12T02:05:07.061 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:07.485 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:07 smithi110 ceph-mon[30548]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:05:07.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.598+0000 7f2537200640 1 -- 172.21.15.110:0/3795411788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25301097c0 msgr2=0x7f2530109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:07.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.598+0000 7f2537200640 1 --2- 172.21.15.110:0/3795411788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25301097c0 0x7f2530109ba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2520009880 tx=0x7f252002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:05:07.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.598+0000 7f2537200640 1 -- 172.21.15.110:0/3795411788 shutdown_connections 2024-09-12T02:05:07.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.598+0000 7f2537200640 1 --2- 172.21.15.110:0/3795411788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25301097c0 0x7f2530109ba0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:07.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.598+0000 7f2537200640 1 -- 172.21.15.110:0/3795411788 >> 172.21.15.110:0/3795411788 conn(0x7f25300ff4e0 msgr2=0x7f2530101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:07.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.598+0000 7f2537200640 1 -- 172.21.15.110:0/3795411788 shutdown_connections 2024-09-12T02:05:07.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.598+0000 7f2537200640 1 -- 172.21.15.110:0/3795411788 wait complete. 2024-09-12T02:05:07.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.599+0000 7f2537200640 1 Processor -- start 2024-09-12T02:05:07.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.599+0000 7f2537200640 1 -- start start 2024-09-12T02:05:07.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.600+0000 7f2537200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25301097c0 0x7f25301992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:07.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.600+0000 7f2537200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f253010de80 con 0x7f25301097c0 2024-09-12T02:05:07.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.600+0000 7f252fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25301097c0 0x7f25301992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:07.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.600+0000 7f252fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25301097c0 0x7f25301992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52992/0 (socket says 172.21.15.110:52992) 2024-09-12T02:05:07.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.600+0000 7f252fe00640 1 -- 172.21.15.110:0/1591574924 learned_addr learned my addr 172.21.15.110:0/1591574924 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:05:07.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.600+0000 7f252fe00640 1 -- 172.21.15.110:0/1591574924 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2530199830 con 0x7f25301097c0 2024-09-12T02:05:07.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.601+0000 7f252fe00640 1 --2- 172.21.15.110:0/1591574924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25301097c0 0x7f25301992f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2520009230 tx=0x7f2520003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:07.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.601+0000 7f252cc00640 1 -- 172.21.15.110:0/1591574924 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f252003f070 con 0x7f25301097c0 2024-09-12T02:05:07.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.601+0000 7f252cc00640 1 -- 172.21.15.110:0/1591574924 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f252003bc80 con 0x7f25301097c0 2024-09-12T02:05:07.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.601+0000 7f2537200640 1 -- 172.21.15.110:0/1591574924 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2530199b20 con 0x7f25301097c0 2024-09-12T02:05:07.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.601+0000 7f252cc00640 1 -- 172.21.15.110:0/1591574924 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2520035030 con 0x7f25301097c0 2024-09-12T02:05:07.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.601+0000 7f2537200640 1 -- 172.21.15.110:0/1591574924 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253019dbc0 con 0x7f25301097c0 2024-09-12T02:05:07.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.602+0000 7f252cc00640 1 -- 172.21.15.110:0/1591574924 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f2520042070 con 0x7f25301097c0 2024-09-12T02:05:07.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.602+0000 7f2537200640 1 -- 172.21.15.110:0/1591574924 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2530104f00 con 0x7f25301097c0 2024-09-12T02:05:07.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.602+0000 7f252cc00640 1 --2- 172.21.15.110:0/1591574924 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f25140390c0 0x7f251403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:07.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.603+0000 7f252cc00640 1 -- 172.21.15.110:0/1591574924 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f252006cd20 con 0x7f25301097c0 2024-09-12T02:05:07.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.603+0000 7f252f400640 1 --2- 172.21.15.110:0/1591574924 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f25140390c0 0x7f251403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:07.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.603+0000 7f252f400640 1 --2- 172.21.15.110:0/1591574924 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f25140390c0 0x7f251403b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f251c0098c0 tx=0x7f251c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:07.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.607+0000 7f252cc00640 1 -- 172.21.15.110:0/1591574924 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25200372d0 con 0x7f25301097c0 2024-09-12T02:05:07.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:07.786+0000 7f2537200640 1 -- 172.21.15.110:0/1591574924 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}) -- 0x7f253019a650 con 0x7f25140390c0 2024-09-12T02:05:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:08 smithi110 ceph-mon[30548]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:08.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi115", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:05:08.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:08.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:09 smithi110 ceph-mon[30548]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:09 smithi110 ceph-mon[30548]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-12T02:05:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:09 smithi110 ceph-mon[30548]: Updating smithi115:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:09 smithi110 ceph-mon[30548]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:05:09.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:09 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:09.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:09 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:09.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:09 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:10 smithi110 ceph-mon[30548]: Updating smithi115:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:05:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:10 smithi110 ceph-mon[30548]: Deploying cephadm binary to smithi136 2024-09-12T02:05:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:10 smithi110 ceph-mon[30548]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:11.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:11.099+0000 7f252cc00640 1 -- 172.21.15.110:0/1591574924 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f253019a650 con 0x7f25140390c0 2024-09-12T02:05:11.099 INFO:teuthology.orchestra.run.smithi110.stdout:Added host 'smithi136' with addr '172.21.15.136' 2024-09-12T02:05:11.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:11.101+0000 7f2537200640 1 -- 172.21.15.110:0/1591574924 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f25140390c0 msgr2=0x7f251403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:11.101+0000 7f2537200640 1 --2- 172.21.15.110:0/1591574924 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f25140390c0 0x7f251403b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f251c0098c0 tx=0x7f251c006db0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:11.101+0000 7f2537200640 1 -- 172.21.15.110:0/1591574924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25301097c0 msgr2=0x7f25301992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:11.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:11.101+0000 7f2537200640 1 --2- 172.21.15.110:0/1591574924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25301097c0 0x7f25301992f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2520009230 tx=0x7f2520003d40 comp rx=0 tx=0).stop 2024-09-12T02:05:11.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:11.101+0000 7f2537200640 1 -- 172.21.15.110:0/1591574924 shutdown_connections 2024-09-12T02:05:11.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:11.101+0000 7f2537200640 1 --2- 172.21.15.110:0/1591574924 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f25140390c0 0x7f251403b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:11.101+0000 7f2537200640 1 --2- 172.21.15.110:0/1591574924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25301097c0 0x7f25301992f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:11.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:11.101+0000 7f2537200640 1 -- 172.21.15.110:0/1591574924 >> 172.21.15.110:0/1591574924 conn(0x7f25300ff4e0 msgr2=0x7f2530100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:11.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:11.102+0000 7f2537200640 1 -- 172.21.15.110:0/1591574924 shutdown_connections 2024-09-12T02:05:11.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:11.102+0000 7f2537200640 1 -- 172.21.15.110:0/1591574924 wait complete. 2024-09-12T02:05:11.836 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T02:05:12.203 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:12.365 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:12.365 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:12 smithi110 ceph-mon[30548]: Added host smithi136 2024-09-12T02:05:12.365 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:12.365 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:12 smithi110 ceph-mon[30548]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:12.365 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:12.365 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.759+0000 7f4c8d000640 1 -- 172.21.15.110:0/1048994362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88102780 msgr2=0x7f4c88102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.759+0000 7f4c8d000640 1 --2- 172.21.15.110:0/1048994362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88102780 0x7f4c88102b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009880 tx=0x7f4c7802a670 comp rx=0 tx=0).stop 2024-09-12T02:05:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.759+0000 7f4c8d000640 1 -- 172.21.15.110:0/1048994362 shutdown_connections 2024-09-12T02:05:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.759+0000 7f4c8d000640 1 --2- 172.21.15.110:0/1048994362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88102780 0x7f4c88102b60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.759+0000 7f4c8d000640 1 -- 172.21.15.110:0/1048994362 >> 172.21.15.110:0/1048994362 conn(0x7f4c880fc1a0 msgr2=0x7f4c880fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.760+0000 7f4c8d000640 1 -- 172.21.15.110:0/1048994362 shutdown_connections 2024-09-12T02:05:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.760+0000 7f4c8d000640 1 -- 172.21.15.110:0/1048994362 wait complete. 2024-09-12T02:05:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.760+0000 7f4c8d000640 1 Processor -- start 2024-09-12T02:05:12.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.761+0000 7f4c8d000640 1 -- start start 2024-09-12T02:05:12.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.761+0000 7f4c8d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88102780 0x7f4c88197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:12.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.761+0000 7f4c8d000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8810bcf0 con 0x7f4c88102780 2024-09-12T02:05:12.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.761+0000 7f4c85e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88102780 0x7f4c88197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:12.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.761+0000 7f4c85e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88102780 0x7f4c88197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37338/0 (socket says 172.21.15.110:37338) 2024-09-12T02:05:12.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.761+0000 7f4c85e00640 1 -- 172.21.15.110:0/2890838099 learned_addr learned my addr 172.21.15.110:0/2890838099 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:05:12.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.762+0000 7f4c85e00640 1 -- 172.21.15.110:0/2890838099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c88197740 con 0x7f4c88102780 2024-09-12T02:05:12.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.762+0000 7f4c85e00640 1 --2- 172.21.15.110:0/2890838099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88102780 0x7f4c88197200 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009230 tx=0x7f4c78003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:12.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.762+0000 7f4c7f400640 1 -- 172.21.15.110:0/2890838099 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c7803f070 con 0x7f4c88102780 2024-09-12T02:05:12.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.762+0000 7f4c7f400640 1 -- 172.21.15.110:0/2890838099 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c7803bd40 con 0x7f4c88102780 2024-09-12T02:05:12.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.762+0000 7f4c7f400640 1 -- 172.21.15.110:0/2890838099 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c78035030 con 0x7f4c88102780 2024-09-12T02:05:12.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.762+0000 7f4c8d000640 1 -- 172.21.15.110:0/2890838099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c881979d0 con 0x7f4c88102780 2024-09-12T02:05:12.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.762+0000 7f4c8d000640 1 -- 172.21.15.110:0/2890838099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c88197e30 con 0x7f4c88102780 2024-09-12T02:05:12.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.763+0000 7f4c7f400640 1 -- 172.21.15.110:0/2890838099 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f4c78042070 con 0x7f4c88102780 2024-09-12T02:05:12.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.763+0000 7f4c8d000640 1 -- 172.21.15.110:0/2890838099 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c8806a7c0 con 0x7f4c88102780 2024-09-12T02:05:12.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.764+0000 7f4c7f400640 1 --2- 172.21.15.110:0/2890838099 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f4c6c039060 0x7f4c6c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:12.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.764+0000 7f4c7f400640 1 -- 172.21.15.110:0/2890838099 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4c7806cd20 con 0x7f4c88102780 2024-09-12T02:05:12.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.764+0000 7f4c7d400640 1 --2- 172.21.15.110:0/2890838099 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f4c6c039060 0x7f4c6c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:12.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.765+0000 7f4c7d400640 1 --2- 172.21.15.110:0/2890838099 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f4c6c039060 0x7f4c6c03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4c700098c0 tx=0x7f4c70006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:12.769 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.769+0000 7f4c7f400640 1 -- 172.21.15.110:0/2890838099 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4c78030d60 con 0x7f4c88102780 2024-09-12T02:05:12.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.950+0000 7f4c8d000640 1 -- 172.21.15.110:0/2890838099 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c88198560 con 0x7f4c6c039060 2024-09-12T02:05:12.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.951+0000 7f4c7f400640 1 -- 172.21.15.110:0/2890838099 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f4c88198560 con 0x7f4c6c039060 2024-09-12T02:05:12.951 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:05:12.951 INFO:teuthology.orchestra.run.smithi110.stdout:[{"addr": "172.21.15.110", "hostname": "smithi110", "labels": [], "status": ""}, {"addr": "172.21.15.115", "hostname": "smithi115", "labels": [], "status": ""}, {"addr": "172.21.15.136", "hostname": "smithi136", "labels": [], "status": ""}] 2024-09-12T02:05:12.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.953+0000 7f4c8d000640 1 -- 172.21.15.110:0/2890838099 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f4c6c039060 msgr2=0x7f4c6c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:12.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.953+0000 7f4c8d000640 1 --2- 172.21.15.110:0/2890838099 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f4c6c039060 0x7f4c6c03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4c700098c0 tx=0x7f4c70006db0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.953+0000 7f4c8d000640 1 -- 172.21.15.110:0/2890838099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88102780 msgr2=0x7f4c88197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:12.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.953+0000 7f4c8d000640 1 --2- 172.21.15.110:0/2890838099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88102780 0x7f4c88197200 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009230 tx=0x7f4c78003d80 comp rx=0 tx=0).stop 2024-09-12T02:05:12.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.953+0000 7f4c8d000640 1 -- 172.21.15.110:0/2890838099 shutdown_connections 2024-09-12T02:05:12.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.953+0000 7f4c8d000640 1 --2- 172.21.15.110:0/2890838099 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f4c6c039060 0x7f4c6c03b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.953+0000 7f4c8d000640 1 --2- 172.21.15.110:0/2890838099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88102780 0x7f4c88197200 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:12.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.953+0000 7f4c8d000640 1 -- 172.21.15.110:0/2890838099 >> 172.21.15.110:0/2890838099 conn(0x7f4c880fc1a0 msgr2=0x7f4c88103530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:12.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.954+0000 7f4c8d000640 1 -- 172.21.15.110:0/2890838099 shutdown_connections 2024-09-12T02:05:12.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:12.954+0000 7f4c8d000640 1 -- 172.21.15.110:0/2890838099 wait complete. 2024-09-12T02:05:13.613 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:13 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:13.651 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T02:05:13.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T02:05:14.006 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:14.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.517+0000 7f1018600640 1 -- 172.21.15.110:0/1635651636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1010107660 msgr2=0x7f1010107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:14.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.517+0000 7f1018600640 1 --2- 172.21.15.110:0/1635651636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1010107660 0x7f1010107a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1004009880 tx=0x7f100402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.517+0000 7f1018600640 1 -- 172.21.15.110:0/1635651636 shutdown_connections 2024-09-12T02:05:14.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.517+0000 7f1018600640 1 --2- 172.21.15.110:0/1635651636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1010107660 0x7f1010107a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:14.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.517+0000 7f1018600640 1 -- 172.21.15.110:0/1635651636 >> 172.21.15.110:0/1635651636 conn(0x7f10100fd2b0 msgr2=0x7f10100ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:14.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.517+0000 7f1018600640 1 -- 172.21.15.110:0/1635651636 shutdown_connections 2024-09-12T02:05:14.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.517+0000 7f1018600640 1 -- 172.21.15.110:0/1635651636 wait complete. 2024-09-12T02:05:14.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.518+0000 7f1018600640 1 Processor -- start 2024-09-12T02:05:14.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.518+0000 7f1018600640 1 -- start start 2024-09-12T02:05:14.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.519+0000 7f1018600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1010107660 0x7f10101970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.519+0000 7f1018600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f101010bc70 con 0x7f1010107660 2024-09-12T02:05:14.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.519+0000 7f1015c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1010107660 0x7f10101970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.519+0000 7f1015c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1010107660 0x7f10101970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37368/0 (socket says 172.21.15.110:37368) 2024-09-12T02:05:14.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.519+0000 7f1015c00640 1 -- 172.21.15.110:0/181534057 learned_addr learned my addr 172.21.15.110:0/181534057 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:05:14.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.519+0000 7f1015c00640 1 -- 172.21.15.110:0/181534057 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10101975e0 con 0x7f1010107660 2024-09-12T02:05:14.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.520+0000 7f1015c00640 1 --2- 172.21.15.110:0/181534057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1010107660 0x7f10101970a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1004009230 tx=0x7f1004003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:14.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.520+0000 7f100e000640 1 -- 172.21.15.110:0/181534057 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f100403f070 con 0x7f1010107660 2024-09-12T02:05:14.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.520+0000 7f100e000640 1 -- 172.21.15.110:0/181534057 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f100403bd40 con 0x7f1010107660 2024-09-12T02:05:14.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.520+0000 7f1018600640 1 -- 172.21.15.110:0/181534057 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10101978d0 con 0x7f1010107660 2024-09-12T02:05:14.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.520+0000 7f100e000640 1 -- 172.21.15.110:0/181534057 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1004035030 con 0x7f1010107660 2024-09-12T02:05:14.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.520+0000 7f1018600640 1 -- 172.21.15.110:0/181534057 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101019b970 con 0x7f1010107660 2024-09-12T02:05:14.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.521+0000 7f100e000640 1 -- 172.21.15.110:0/181534057 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f1004042070 con 0x7f1010107660 2024-09-12T02:05:14.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.521+0000 7f1018600640 1 -- 172.21.15.110:0/181534057 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1010102d10 con 0x7f1010107660 2024-09-12T02:05:14.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.522+0000 7f100e000640 1 --2- 172.21.15.110:0/181534057 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0ff8039060 0x7f0ff803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:14.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.522+0000 7f100e000640 1 -- 172.21.15.110:0/181534057 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f100406cc70 con 0x7f1010107660 2024-09-12T02:05:14.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.522+0000 7f1015200640 1 --2- 172.21.15.110:0/181534057 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0ff8039060 0x7f0ff803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:14.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.522+0000 7f1015200640 1 --2- 172.21.15.110:0/181534057 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0ff8039060 0x7f0ff803b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0098c0 tx=0x7f0ffc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:14.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.526+0000 7f100e000640 1 -- 172.21.15.110:0/181534057 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1004036df0 con 0x7f1010107660 2024-09-12T02:05:14.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:14 smithi110 ceph-mon[30548]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:05:14.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:14 smithi110 ceph-mon[30548]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:14.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:14.708+0000 7f1018600640 1 -- 172.21.15.110:0/181534057 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1010198400 con 0x7f1010107660 2024-09-12T02:05:15.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:15.473+0000 7f100e000640 1 -- 172.21.15.110:0/181534057 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f1004030d60 con 0x7f1010107660 2024-09-12T02:05:15.474 INFO:teuthology.orchestra.run.smithi110.stderr:adjusted tunables profile to default 2024-09-12T02:05:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:15.476+0000 7f1018600640 1 -- 172.21.15.110:0/181534057 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0ff8039060 msgr2=0x7f0ff803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:15.476+0000 7f1018600640 1 --2- 172.21.15.110:0/181534057 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0ff8039060 0x7f0ff803b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0098c0 tx=0x7f0ffc006db0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:15.476+0000 7f1018600640 1 -- 172.21.15.110:0/181534057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1010107660 msgr2=0x7f10101970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:15.476+0000 7f1018600640 1 --2- 172.21.15.110:0/181534057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1010107660 0x7f10101970a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1004009230 tx=0x7f1004003d80 comp rx=0 tx=0).stop 2024-09-12T02:05:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:15.476+0000 7f1018600640 1 -- 172.21.15.110:0/181534057 shutdown_connections 2024-09-12T02:05:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:15.476+0000 7f1018600640 1 --2- 172.21.15.110:0/181534057 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0ff8039060 0x7f0ff803b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:15.476+0000 7f1018600640 1 --2- 172.21.15.110:0/181534057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1010107660 0x7f10101970a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:15.476+0000 7f1018600640 1 -- 172.21.15.110:0/181534057 >> 172.21.15.110:0/181534057 conn(0x7f10100fd2b0 msgr2=0x7f10100feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:15.476+0000 7f1018600640 1 -- 172.21.15.110:0/181534057 shutdown_connections 2024-09-12T02:05:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:15.476+0000 7f1018600640 1 -- 172.21.15.110:0/181534057 wait complete. 2024-09-12T02:05:15.879 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:15 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/181534057' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T02:05:15.879 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:15.879 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:15.879 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:15.879 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:15.879 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:05:15.880 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:15.880 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:16.293 INFO:tasks.cephadm:Adding mon.a on smithi110 2024-09-12T02:05:16.293 INFO:tasks.cephadm:Adding mon.b on smithi115 2024-09-12T02:05:16.293 INFO:tasks.cephadm:Adding mon.c on smithi136 2024-09-12T02:05:16.293 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi110:172.21.15.110=a;smithi115:172.21.15.115=b;smithi136:172.21.15.136=c' 2024-09-12T02:05:16.526 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:16.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:16 smithi110 ceph-mon[30548]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-12T02:05:16.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:16 smithi110 ceph-mon[30548]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:16.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:16 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/181534057' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T02:05:16.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:16 smithi110 ceph-mon[30548]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:05:16.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:16 smithi110 ceph-mon[30548]: Updating smithi136:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:16.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:16 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:16.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:16 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:16.681 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:16 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:16.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.924+0000 7fa7dc252640 1 -- 172.21.15.136:0/3913159982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d4107690 msgr2=0x7fa7d4107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:16.957 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.924+0000 7fa7dc252640 1 --2- 172.21.15.136:0/3913159982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d4107690 0x7fa7d4107a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009880 tx=0x7fa7d002a5d0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.924+0000 7fa7dc252640 1 -- 172.21.15.136:0/3913159982 shutdown_connections 2024-09-12T02:05:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.924+0000 7fa7dc252640 1 --2- 172.21.15.136:0/3913159982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d4107690 0x7fa7d4107a70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.924+0000 7fa7dc252640 1 -- 172.21.15.136:0/3913159982 >> 172.21.15.136:0/3913159982 conn(0x7fa7d4076250 msgr2=0x7fa7d4076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.924+0000 7fa7dc252640 1 -- 172.21.15.136:0/3913159982 shutdown_connections 2024-09-12T02:05:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.924+0000 7fa7dc252640 1 -- 172.21.15.136:0/3913159982 wait complete. 2024-09-12T02:05:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.924+0000 7fa7dc252640 1 Processor -- start 2024-09-12T02:05:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.924+0000 7fa7dc252640 1 -- start start 2024-09-12T02:05:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.924+0000 7fa7dc252640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d4107690 0x7fa7d4100800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.925+0000 7fa7dc252640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d410bce0 con 0x7fa7d4107690 2024-09-12T02:05:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.925+0000 7fa7d9fee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d4107690 0x7fa7d4100800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.958 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.925+0000 7fa7d9fee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d4107690 0x7fa7d4100800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.136:38584/0 (socket says 172.21.15.136:38584) 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.925+0000 7fa7d9fee640 1 -- 172.21.15.136:0/4198282967 learned_addr learned my addr 172.21.15.136:0/4198282967 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.925+0000 7fa7d9fee640 1 -- 172.21.15.136:0/4198282967 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d41026f0 con 0x7fa7d4107690 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.925+0000 7fa7d9fee640 1 --2- 172.21.15.136:0/4198282967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d4107690 0x7fa7d4100800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009230 tx=0x7fa7d0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.926+0000 7fa7c6ffd640 1 -- 172.21.15.136:0/4198282967 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d003f070 con 0x7fa7d4107690 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.926+0000 7fa7dc252640 1 -- 172.21.15.136:0/4198282967 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d4100d40 con 0x7fa7d4107690 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.926+0000 7fa7dc252640 1 -- 172.21.15.136:0/4198282967 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d4101200 con 0x7fa7d4107690 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.926+0000 7fa7c6ffd640 1 -- 172.21.15.136:0/4198282967 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7d003bc80 con 0x7fa7d4107690 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.926+0000 7fa7c6ffd640 1 -- 172.21.15.136:0/4198282967 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7d0049060 con 0x7fa7d4107690 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.927+0000 7fa7c6ffd640 1 -- 172.21.15.136:0/4198282967 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fa7d0042070 con 0x7fa7d4107690 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.927+0000 7fa7c6ffd640 1 --2- 172.21.15.136:0/4198282967 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa7c0039060 0x7fa7c003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.927+0000 7fa7c6ffd640 1 -- 172.21.15.136:0/4198282967 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa7d006dd60 con 0x7fa7d4107690 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.927+0000 7fa7dc252640 1 -- 172.21.15.136:0/4198282967 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b8005290 con 0x7fa7d4107690 2024-09-12T02:05:16.959 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.927+0000 7fa7d97ed640 1 --2- 172.21.15.136:0/4198282967 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa7c0039060 0x7fa7c003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:16.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.928+0000 7fa7d97ed640 1 --2- 172.21.15.136:0/4198282967 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa7c0039060 0x7fa7c003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80098c0 tx=0x7fa7c8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:16.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:16.933+0000 7fa7c6ffd640 1 -- 172.21.15.136:0/4198282967 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa7d0043ce0 con 0x7fa7d4107690 2024-09-12T02:05:17.118 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:17.118+0000 7fa7dc252640 1 -- 172.21.15.136:0/4198282967 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi110:172.21.15.110=a;smithi115:172.21.15.115=b;smithi136:172.21.15.136=c", "target": ["mon-mgr", ""]}) -- 0x7fa7b8000c80 con 0x7fa7c0039060 2024-09-12T02:05:17.124 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:17.124+0000 7fa7c6ffd640 1 -- 172.21.15.136:0/4198282967 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa7b8000c80 con 0x7fa7c0039060 2024-09-12T02:05:17.124 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled mon update... 2024-09-12T02:05:17.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:17.126+0000 7fa7dc252640 1 -- 172.21.15.136:0/4198282967 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa7c0039060 msgr2=0x7fa7c003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:17.126+0000 7fa7dc252640 1 --2- 172.21.15.136:0/4198282967 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa7c0039060 0x7fa7c003b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80098c0 tx=0x7fa7c8006db0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:17.126+0000 7fa7dc252640 1 -- 172.21.15.136:0/4198282967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d4107690 msgr2=0x7fa7d4100800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:17.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:17.126+0000 7fa7dc252640 1 --2- 172.21.15.136:0/4198282967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d4107690 0x7fa7d4100800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009230 tx=0x7fa7d0003d40 comp rx=0 tx=0).stop 2024-09-12T02:05:17.126 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:17.126+0000 7fa7dc252640 1 -- 172.21.15.136:0/4198282967 shutdown_connections 2024-09-12T02:05:17.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:17.126+0000 7fa7dc252640 1 --2- 172.21.15.136:0/4198282967 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa7c0039060 0x7fa7c003b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:17.126+0000 7fa7dc252640 1 --2- 172.21.15.136:0/4198282967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7d4107690 0x7fa7d4100800 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:17.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:17.126+0000 7fa7dc252640 1 -- 172.21.15.136:0/4198282967 >> 172.21.15.136:0/4198282967 conn(0x7fa7d4076250 msgr2=0x7fa7d40fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:17.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:17.126+0000 7fa7dc252640 1 -- 172.21.15.136:0/4198282967 shutdown_connections 2024-09-12T02:05:17.127 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:17.126+0000 7fa7dc252640 1 -- 172.21.15.136:0/4198282967 wait complete. 2024-09-12T02:05:17.730 DEBUG:teuthology.orchestra.run.smithi115:mon.b> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.b.service 2024-09-12T02:05:17.733 DEBUG:teuthology.orchestra.run.smithi136:mon.c> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.c.service 2024-09-12T02:05:17.735 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:05:17.736 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:05:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:17 smithi110 ceph-mon[30548]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:05:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:17 smithi110 ceph-mon[30548]: Updating smithi136:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:05:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:17.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:17.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:17.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:17.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:05:17.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:18.841 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:18 smithi110 ceph-mon[30548]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi110:172.21.15.110=a;smithi115:172.21.15.115=b;smithi136:172.21.15.136=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:18.841 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:18 smithi110 ceph-mon[30548]: Saving service mon spec with placement smithi110:172.21.15.110=a;smithi115:172.21.15.115=b;smithi136:172.21.15.136=c;count:3 2024-09-12T02:05:18.841 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:18 smithi110 ceph-mon[30548]: Deploying daemon mon.c on smithi136 2024-09-12T02:05:18.841 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:18 smithi110 ceph-mon[30548]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:19.789 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:05:20.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.349+0000 7f568fc34640 1 -- 172.21.15.136:0/3057698592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688106650 msgr2=0x7f5688106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.349+0000 7f568fc34640 1 --2- 172.21.15.136:0/3057698592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688106650 0x7f5688106a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5684009880 tx=0x7f568402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.349+0000 7f568fc34640 1 -- 172.21.15.136:0/3057698592 shutdown_connections 2024-09-12T02:05:20.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.349+0000 7f568fc34640 1 --2- 172.21.15.136:0/3057698592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688106650 0x7f5688106a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.349+0000 7f568fc34640 1 -- 172.21.15.136:0/3057698592 >> 172.21.15.136:0/3057698592 conn(0x7f56880fc280 msgr2=0x7f56880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:20.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.349+0000 7f568fc34640 1 -- 172.21.15.136:0/3057698592 shutdown_connections 2024-09-12T02:05:20.350 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.349+0000 7f568fc34640 1 -- 172.21.15.136:0/3057698592 wait complete. 2024-09-12T02:05:20.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.350+0000 7f568fc34640 1 Processor -- start 2024-09-12T02:05:20.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.350+0000 7f568fc34640 1 -- start start 2024-09-12T02:05:20.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.350+0000 7f568fc34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688106650 0x7f5688197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.351 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.350+0000 7f568fc34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f568810ac80 con 0x7f5688106650 2024-09-12T02:05:20.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.350+0000 7f568d9d0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688106650 0x7f5688197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.350+0000 7f568d9d0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688106650 0x7f5688197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.136:34466/0 (socket says 172.21.15.136:34466) 2024-09-12T02:05:20.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.350+0000 7f568d9d0640 1 -- 172.21.15.136:0/2732133507 learned_addr learned my addr 172.21.15.136:0/2732133507 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-12T02:05:20.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.351+0000 7f568d9d0640 1 -- 172.21.15.136:0/2732133507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56881977a0 con 0x7f5688106650 2024-09-12T02:05:20.352 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.352+0000 7f568d9d0640 1 --2- 172.21.15.136:0/2732133507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688106650 0x7f5688197260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5684009230 tx=0x7f5684003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:20.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.352+0000 7f567effd640 1 -- 172.21.15.136:0/2732133507 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f568403f070 con 0x7f5688106650 2024-09-12T02:05:20.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.352+0000 7f568fc34640 1 -- 172.21.15.136:0/2732133507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5688197a30 con 0x7f5688106650 2024-09-12T02:05:20.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.352+0000 7f567effd640 1 -- 172.21.15.136:0/2732133507 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f568403bc80 con 0x7f5688106650 2024-09-12T02:05:20.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.352+0000 7f567effd640 1 -- 172.21.15.136:0/2732133507 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5684035030 con 0x7f5688106650 2024-09-12T02:05:20.353 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.352+0000 7f568fc34640 1 -- 172.21.15.136:0/2732133507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f568819bb30 con 0x7f5688106650 2024-09-12T02:05:20.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.353+0000 7f568fc34640 1 -- 172.21.15.136:0/2732133507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5688101cc0 con 0x7f5688106650 2024-09-12T02:05:20.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.353+0000 7f567effd640 1 -- 172.21.15.136:0/2732133507 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f5684042070 con 0x7f5688106650 2024-09-12T02:05:20.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.353+0000 7f567effd640 1 --2- 172.21.15.136:0/2732133507 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5674039060 0x7f567403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:20.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.353+0000 7f567effd640 1 -- 172.21.15.136:0/2732133507 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f568406ce00 con 0x7f5688106650 2024-09-12T02:05:20.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.354+0000 7f568d1cf640 1 --2- 172.21.15.136:0/2732133507 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5674039060 0x7f567403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:20.355 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.354+0000 7f568d1cf640 1 --2- 172.21.15.136:0/2732133507 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5674039060 0x7f567403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f56780098c0 tx=0x7f5678006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:20.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.359+0000 7f567effd640 1 -- 172.21.15.136:0/2732133507 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f56840372d0 con 0x7f5688106650 2024-09-12T02:05:20.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.602+0000 7f568fc34640 1 -- 172.21.15.136:0/2732133507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5688106ab0 con 0x7f5688106650 2024-09-12T02:05:20.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.602+0000 7f567effd640 1 -- 172.21.15.136:0/2732133507 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f5684031570 con 0x7f5688106650 2024-09-12T02:05:20.875 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:05:20.875 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","modified":"2024-09-12T02:03:39.733285Z","created":"2024-09-12T02:03:39.733285Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T02:05:20.876 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-09-12T02:05:20.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.605+0000 7f568fc34640 1 -- 172.21.15.136:0/2732133507 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5674039060 msgr2=0x7f567403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.605+0000 7f568fc34640 1 --2- 172.21.15.136:0/2732133507 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5674039060 0x7f567403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f56780098c0 tx=0x7f5678006db0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.605+0000 7f568fc34640 1 -- 172.21.15.136:0/2732133507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688106650 msgr2=0x7f5688197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:20.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.605+0000 7f568fc34640 1 --2- 172.21.15.136:0/2732133507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688106650 0x7f5688197260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5684009230 tx=0x7f5684003d40 comp rx=0 tx=0).stop 2024-09-12T02:05:20.876 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.605+0000 7f568fc34640 1 -- 172.21.15.136:0/2732133507 shutdown_connections 2024-09-12T02:05:20.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.605+0000 7f568fc34640 1 --2- 172.21.15.136:0/2732133507 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5674039060 0x7f567403b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.605+0000 7f568fc34640 1 --2- 172.21.15.136:0/2732133507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5688106650 0x7f5688197260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:20.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.605+0000 7f568fc34640 1 -- 172.21.15.136:0/2732133507 >> 172.21.15.136:0/2732133507 conn(0x7f56880fc280 msgr2=0x7f5688069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:20.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.605+0000 7f568fc34640 1 -- 172.21.15.136:0/2732133507 shutdown_connections 2024-09-12T02:05:20.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:20.605+0000 7f568fc34640 1 -- 172.21.15.136:0/2732133507 wait complete. 2024-09-12T02:05:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:20 smithi110 ceph-mon[30548]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:21.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:21 smithi136 systemd[1]: Started Ceph mon.c for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:05:21.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:21 smithi110 ceph-mon[30548]: from='client.? 172.21.15.136:0/2732133507' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:05:22.210 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:05:22.211 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:05:22.458 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:05:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:05:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: mon.a calling monitor election 2024-09-12T02:05:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: mon.c calling monitor election 2024-09-12T02:05:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: monmap epoch 2 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: last_changed 2024-09-12T02:05:21.668868+0000 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: created 2024-09-12T02:03:39.733285+0000 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: min_mon_release 19 (squid) 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: election_strategy: 1 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: 1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.c 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: fsmap 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:05:27.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: mgrmap e13: x(active, since 41s) 2024-09-12T02:05:27.161 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: overall HEALTH_OK 2024-09-12T02:05:27.161 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:27.161 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:27.161 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:27.161 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:05:27.161 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:27.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:05:27.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:27.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: mon.a calling monitor election 2024-09-12T02:05:27.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:27.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: mon.c calling monitor election 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: monmap epoch 2 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: last_changed 2024-09-12T02:05:21.668868+0000 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: created 2024-09-12T02:03:39.733285+0000 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: min_mon_release 19 (squid) 2024-09-12T02:05:27.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: election_strategy: 1 2024-09-12T02:05:27.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-09-12T02:05:27.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: 1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.c 2024-09-12T02:05:27.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: fsmap 2024-09-12T02:05:27.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:05:27.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: mgrmap e13: x(active, since 41s) 2024-09-12T02:05:27.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: overall HEALTH_OK 2024-09-12T02:05:27.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:27.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:27.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:27.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:05:27.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:27.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.296+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/2772943826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc8003530 msgr2=0x7f9cc80059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.296 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.296+0000 7f9ce4dcb640 1 --2- 172.21.15.136:0/2772943826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc8003530 0x7f9cc80059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0102af0 tx=0x7f9cd002c490 comp rx=0 tx=0).stop 2024-09-12T02:05:27.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.296+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/2772943826 shutdown_connections 2024-09-12T02:05:27.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.296+0000 7f9ce4dcb640 1 --2- 172.21.15.136:0/2772943826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc8003530 0x7f9cc80059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.296+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/2772943826 >> 172.21.15.136:0/2772943826 conn(0x7f9ce00fd320 msgr2=0x7f9ce00ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:27.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.296+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/2772943826 shutdown_connections 2024-09-12T02:05:27.297 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.296+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/2772943826 wait complete. 2024-09-12T02:05:27.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.297+0000 7f9ce4dcb640 1 Processor -- start 2024-09-12T02:05:27.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.297+0000 7f9ce4dcb640 1 -- start start 2024-09-12T02:05:27.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.297+0000 7f9ce4dcb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc8003530 0x7f9ce01994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.297+0000 7f9ce4dcb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0199a10 0x7f9ce019dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.297+0000 7f9ce4dcb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0109780 con 0x7f9cc8003530 2024-09-12T02:05:27.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.297+0000 7f9ce4dcb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0109600 con 0x7f9ce0199a10 2024-09-12T02:05:27.298 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.298+0000 7f9cddd9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0199a10 0x7f9ce019dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.298+0000 7f9cddd9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0199a10 0x7f9ce019dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33732/0 (socket says 172.21.15.136:33732) 2024-09-12T02:05:27.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.298+0000 7f9cddd9b640 1 -- 172.21.15.136:0/3879734564 learned_addr learned my addr 172.21.15.136:0/3879734564 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-12T02:05:27.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.298+0000 7f9cddd9b640 1 -- 172.21.15.136:0/3879734564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0199a10 msgr2=0x7f9ce019dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T02:05:27.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.298+0000 7f9cddd9b640 1 -- 172.21.15.136:0/3879734564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0199a10 msgr2=0x7f9ce019dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:05:27.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.298+0000 7f9cddd9b640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0199a10 0x7f9ce019dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:05:27.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.298+0000 7f9cde59c640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc8003530 0x7f9ce01994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.298+0000 7f9cddd9b640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0199a10 0x7f9ce019dda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:05:27.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.298+0000 7f9cde59c640 1 -- 172.21.15.136:0/3879734564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0199a10 msgr2=0x7f9ce019dda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:05:27.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.298+0000 7f9cde59c640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0199a10 0x7f9ce019dda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.298+0000 7f9cde59c640 1 -- 172.21.15.136:0/3879734564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce019a030 con 0x7f9cc8003530 2024-09-12T02:05:27.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.298+0000 7f9cde59c640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc8003530 0x7f9ce01994d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0005f30 tx=0x7f9cd0033680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:27.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.299+0000 7f9ccf7fe640 1 -- 172.21.15.136:0/3879734564 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9cd0038040 con 0x7f9cc8003530 2024-09-12T02:05:27.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.299+0000 7f9ccf7fe640 1 -- 172.21.15.136:0/3879734564 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cd0032e00 con 0x7f9cc8003530 2024-09-12T02:05:27.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.299+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/3879734564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce019e2e0 con 0x7f9cc8003530 2024-09-12T02:05:27.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.299+0000 7f9ccf7fe640 1 -- 172.21.15.136:0/3879734564 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9cd0004a00 con 0x7f9cc8003530 2024-09-12T02:05:27.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.299+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/3879734564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce019e820 con 0x7f9cc8003530 2024-09-12T02:05:27.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.300+0000 7f9ccf7fe640 1 -- 172.21.15.136:0/3879734564 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f9cd0043020 con 0x7f9cc8003530 2024-09-12T02:05:27.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.300+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/3879734564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce0102da0 con 0x7f9cc8003530 2024-09-12T02:05:27.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.300+0000 7f9ccf7fe640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f9cc0038e50 0x7f9cc003b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:27.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.300+0000 7f9ccf7fe640 1 -- 172.21.15.136:0/3879734564 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9cd006e640 con 0x7f9cc8003530 2024-09-12T02:05:27.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.301+0000 7f9cddd9b640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f9cc0038e50 0x7f9cc003b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:27.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.301+0000 7f9cddd9b640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f9cc0038e50 0x7f9cc003b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4009100 tx=0x7f9cd4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:27.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.306+0000 7f9ccf7fe640 1 -- 172.21.15.136:0/3879734564 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9cd004a020 con 0x7f9cc8003530 2024-09-12T02:05:27.538 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.538+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/3879734564 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9ce0106880 con 0x7f9cc8003530 2024-09-12T02:05:27.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.539+0000 7f9ccf7fe640 1 -- 172.21.15.136:0/3879734564 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f9cd004cbc0 con 0x7f9cc8003530 2024-09-12T02:05:27.539 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:05:27.539 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":2,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","modified":"2024-09-12T02:05:21.668868Z","created":"2024-09-12T02:03:39.733285Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T02:05:27.539 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 2 2024-09-12T02:05:27.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.541+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/3879734564 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f9cc0038e50 msgr2=0x7f9cc003b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.541+0000 7f9ce4dcb640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f9cc0038e50 0x7f9cc003b310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4009100 tx=0x7f9cd4008040 comp rx=0 tx=0).stop 2024-09-12T02:05:27.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.541+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/3879734564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc8003530 msgr2=0x7f9ce01994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:27.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.541+0000 7f9ce4dcb640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc8003530 0x7f9ce01994d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0005f30 tx=0x7f9cd0033680 comp rx=0 tx=0).stop 2024-09-12T02:05:27.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.541+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/3879734564 shutdown_connections 2024-09-12T02:05:27.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.541+0000 7f9ce4dcb640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f9cc0038e50 0x7f9cc003b310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.541 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.541+0000 7f9ce4dcb640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce0199a10 0x7f9ce019dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.541+0000 7f9ce4dcb640 1 --2- 172.21.15.136:0/3879734564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9cc8003530 0x7f9ce01994d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:27.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.541+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/3879734564 >> 172.21.15.136:0/3879734564 conn(0x7f9ce00fd320 msgr2=0x7f9ce00ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:27.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.541+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/3879734564 shutdown_connections 2024-09-12T02:05:27.542 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:27.541+0000 7f9ce4dcb640 1 -- 172.21.15.136:0/3879734564 wait complete. 2024-09-12T02:05:27.904 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:27 smithi136 ceph-mon[35814]: Deploying daemon mon.b on smithi115 2024-09-12T02:05:27.904 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:27 smithi136 ceph-mon[35814]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:27.904 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:27 smithi136 ceph-mon[35814]: from='client.? 172.21.15.136:0/3879734564' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:05:27.904 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:27 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:28.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:27 smithi110 ceph-mon[30548]: Deploying daemon mon.b on smithi115 2024-09-12T02:05:28.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:27 smithi110 ceph-mon[30548]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:28.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:27 smithi110 ceph-mon[30548]: from='client.? 172.21.15.136:0/3879734564' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:05:28.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:27 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:29.199 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:05:29.199 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:05:29.453 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:05:29.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.878+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/392240070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf68106630 msgr2=0x7fcf68106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:29.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.878+0000 7fcf6fa1f640 1 --2- 172.21.15.136:0/392240070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf68106630 0x7fcf68106a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009880 tx=0x7fcf6402a5d0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.880 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.878+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/392240070 shutdown_connections 2024-09-12T02:05:29.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.878+0000 7fcf6fa1f640 1 --2- 172.21.15.136:0/392240070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf68106630 0x7fcf68106a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.878+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/392240070 >> 172.21.15.136:0/392240070 conn(0x7fcf680fc220 msgr2=0x7fcf680fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:29.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.878+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/392240070 shutdown_connections 2024-09-12T02:05:29.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.878+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/392240070 wait complete. 2024-09-12T02:05:29.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.878+0000 7fcf6fa1f640 1 Processor -- start 2024-09-12T02:05:29.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.878+0000 7fcf6fa1f640 1 -- start start 2024-09-12T02:05:29.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6fa1f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf68106630 0x7fcf68195190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:29.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6fa1f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf681956d0 0x7fcf68199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:29.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6fa1f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fcf68109b70 con 0x7fcf68106630 2024-09-12T02:05:29.881 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6fa1f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcf681099f0 con 0x7fcf681956d0 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6cfba640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf681956d0 0x7fcf68199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6cfba640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf681956d0 0x7fcf68199a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:43108/0 (socket says 172.21.15.136:43108) 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6cfba640 1 -- 172.21.15.136:0/340362936 learned_addr learned my addr 172.21.15.136:0/340362936 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6d7bb640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf68106630 0x7fcf68195190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6cfba640 1 -- 172.21.15.136:0/340362936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf681956d0 msgr2=0x7fcf68199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6cfba640 1 -- 172.21.15.136:0/340362936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf681956d0 msgr2=0x7fcf68199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6cfba640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf681956d0 0x7fcf68199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6cfba640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf681956d0 0x7fcf68199a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6d7bb640 1 -- 172.21.15.136:0/340362936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf681956d0 msgr2=0x7fcf68199a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6d7bb640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf681956d0 0x7fcf68199a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.879+0000 7fcf6d7bb640 1 -- 172.21.15.136:0/340362936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf68195cf0 con 0x7fcf68106630 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.880+0000 7fcf6d7bb640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf68106630 0x7fcf68195190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcf64005ab0 tx=0x7fcf64032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.880+0000 7fcf5e7fc640 1 -- 172.21.15.136:0/340362936 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fcf64035070 con 0x7fcf68106630 2024-09-12T02:05:29.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.880+0000 7fcf5e7fc640 1 -- 172.21.15.136:0/340362936 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf64032e40 con 0x7fcf68106630 2024-09-12T02:05:29.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.880+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/340362936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf68199fa0 con 0x7fcf68106630 2024-09-12T02:05:29.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.880+0000 7fcf5e7fc640 1 -- 172.21.15.136:0/340362936 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fcf6403bc10 con 0x7fcf68106630 2024-09-12T02:05:29.883 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.880+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/340362936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6819a500 con 0x7fcf68106630 2024-09-12T02:05:29.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.881+0000 7fcf5e7fc640 1 -- 172.21.15.136:0/340362936 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fcf64042030 con 0x7fcf68106630 2024-09-12T02:05:29.884 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.881+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/340362936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf68101ca0 con 0x7fcf68106630 2024-09-12T02:05:29.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.881+0000 7fcf5e7fc640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fcf5403b010 0x7fcf5403d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:29.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.881+0000 7fcf5e7fc640 1 -- 172.21.15.136:0/340362936 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcf64040070 con 0x7fcf68106630 2024-09-12T02:05:29.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.881+0000 7fcf6cfba640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fcf5403b010 0x7fcf5403d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:29.885 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.882+0000 7fcf6cfba640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fcf5403b010 0x7fcf5403d4d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009100 tx=0x7fcf58008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:29.886 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:29.886+0000 7fcf5e7fc640 1 -- 172.21.15.136:0/340362936 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf6403b460 con 0x7fcf68106630 2024-09-12T02:05:30.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.114+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/340362936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fcf680008d0 con 0x7fcf68106630 2024-09-12T02:05:30.114 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.114+0000 7fcf5e7fc640 1 -- 172.21.15.136:0/340362936 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7fcf640433c0 con 0x7fcf68106630 2024-09-12T02:05:30.114 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:05:30.115 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":2,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","modified":"2024-09-12T02:05:21.668868Z","created":"2024-09-12T02:03:39.733285Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T02:05:30.115 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 2 2024-09-12T02:05:30.116 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.116+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/340362936 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fcf5403b010 msgr2=0x7fcf5403d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:30.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.116+0000 7fcf6fa1f640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fcf5403b010 0x7fcf5403d4d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcf58009100 tx=0x7fcf58008040 comp rx=0 tx=0).stop 2024-09-12T02:05:30.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.116+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/340362936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf68106630 msgr2=0x7fcf68195190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:30.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.116+0000 7fcf6fa1f640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf68106630 0x7fcf68195190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcf64005ab0 tx=0x7fcf64032c50 comp rx=0 tx=0).stop 2024-09-12T02:05:30.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.116+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/340362936 shutdown_connections 2024-09-12T02:05:30.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.116+0000 7fcf6fa1f640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fcf5403b010 0x7fcf5403d4d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:30.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.116+0000 7fcf6fa1f640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcf681956d0 0x7fcf68199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:30.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.116+0000 7fcf6fa1f640 1 --2- 172.21.15.136:0/340362936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf68106630 0x7fcf68195190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:30.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.116+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/340362936 >> 172.21.15.136:0/340362936 conn(0x7fcf680fc220 msgr2=0x7fcf680fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:30.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.116+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/340362936 shutdown_connections 2024-09-12T02:05:30.117 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:30.116+0000 7fcf6fa1f640 1 -- 172.21.15.136:0/340362936 wait complete. 2024-09-12T02:05:30.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:30 smithi115 systemd[1]: Started Ceph mon.b for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:05:31.747 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-12T02:05:31.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T02:05:32.000 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:05:35.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.409+0000 7f156dc21640 1 -- 172.21.15.136:0/3385280801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15681028a0 msgr2=0x7f1554005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.410 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.409+0000 7f156dc21640 1 --2- 172.21.15.136:0/3385280801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15681028a0 0x7f1554005580 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1558011c50 tx=0x7f155802be50 comp rx=0 tx=0).stop 2024-09-12T02:05:35.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.409+0000 7f156dc21640 1 -- 172.21.15.136:0/3385280801 shutdown_connections 2024-09-12T02:05:35.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.409+0000 7f156dc21640 1 --2- 172.21.15.136:0/3385280801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15681028a0 0x7f1554005580 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.409+0000 7f156dc21640 1 -- 172.21.15.136:0/3385280801 >> 172.21.15.136:0/3385280801 conn(0x7f15680fc280 msgr2=0x7f15680fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:35.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.409+0000 7f156dc21640 1 -- 172.21.15.136:0/3385280801 shutdown_connections 2024-09-12T02:05:35.411 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.409+0000 7f156dc21640 1 -- 172.21.15.136:0/3385280801 wait complete. 2024-09-12T02:05:35.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.410+0000 7f156dc21640 1 Processor -- start 2024-09-12T02:05:35.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.410+0000 7f156dc21640 1 -- start start 2024-09-12T02:05:35.413 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f156dc21640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15681028a0 0x7f1568197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f156dc21640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15681978c0 0x7f156819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f156dc21640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f156819c190 0x7f156819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f156dc21640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f15681097b0 con 0x7f156819c190 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f156dc21640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1568109630 con 0x7f15681978c0 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f156dc21640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1568109930 con 0x7f15681028a0 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f15677fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15681028a0 0x7f1568197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f15677fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15681028a0 0x7f1568197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:43110/0 (socket says 172.21.15.136:43110) 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f15677fe640 1 -- 172.21.15.136:0/677364852 learned_addr learned my addr 172.21.15.136:0/677364852 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f1567fff640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f156819c190 0x7f156819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f155ffff640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15681978c0 0x7f156819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.414 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f15677fe640 1 -- 172.21.15.136:0/677364852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15681028a0 msgr2=0x7f1568197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-12T02:05:35.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f15677fe640 1 -- 172.21.15.136:0/677364852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15681028a0 msgr2=0x7f1568197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:05:35.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f15677fe640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15681028a0 0x7f1568197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:05:35.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f15677fe640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15681028a0 0x7f1568197380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:05:35.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f155ffff640 1 -- 172.21.15.136:0/677364852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15681978c0 msgr2=0x7f156819bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-12T02:05:35.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f155ffff640 1 -- 172.21.15.136:0/677364852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15681978c0 msgr2=0x7f156819bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:05:35.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f155ffff640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15681978c0 0x7f156819bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:05:35.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.411+0000 7f155ffff640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15681978c0 0x7f156819bc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:05:35.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.412+0000 7f1567fff640 1 -- 172.21.15.136:0/677364852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15681028a0 msgr2=0x7f1568197380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:05:35.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.412+0000 7f1567fff640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15681028a0 0x7f1568197380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.415 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.412+0000 7f1567fff640 1 -- 172.21.15.136:0/677364852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15681978c0 msgr2=0x7f156819bc50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:05:35.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.412+0000 7f1567fff640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15681978c0 0x7f156819bc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.412+0000 7f1567fff640 1 -- 172.21.15.136:0/677364852 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15681a3f00 con 0x7f156819c190 2024-09-12T02:05:35.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.412+0000 7f1567fff640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f156819c190 0x7f156819c640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f156000bd50 tx=0x7f156000be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.412+0000 7f15657fa640 1 -- 172.21.15.136:0/677364852 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560019070 con 0x7f156819c190 2024-09-12T02:05:35.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.412+0000 7f15657fa640 1 -- 172.21.15.136:0/677364852 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1560014920 con 0x7f156819c190 2024-09-12T02:05:35.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.412+0000 7f156dc21640 1 -- 172.21.15.136:0/677364852 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15681a4130 con 0x7f156819c190 2024-09-12T02:05:35.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.412+0000 7f15657fa640 1 -- 172.21.15.136:0/677364852 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560012990 con 0x7f156819c190 2024-09-12T02:05:35.416 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.412+0000 7f156dc21640 1 -- 172.21.15.136:0/677364852 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15681a4640 con 0x7f156819c190 2024-09-12T02:05:35.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.413+0000 7f15657fa640 1 -- 172.21.15.136:0/677364852 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f156001c070 con 0x7f156819c190 2024-09-12T02:05:35.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.414+0000 7f15657fa640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f15480394f0 0x7f154803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:35.417 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.414+0000 7f156dc21640 1 -- 172.21.15.136:0/677364852 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f156810a8c0 con 0x7f156819c190 2024-09-12T02:05:35.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.414+0000 7f15657fa640 1 -- 172.21.15.136:0/677364852 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f156004bff0 con 0x7f156819c190 2024-09-12T02:05:35.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.414+0000 7f15677fe640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f15480394f0 0x7f154803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:35.418 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.415+0000 7f15677fe640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f15480394f0 0x7f154803b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1558005f50 tx=0x7f1558005bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:35.421 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.420+0000 7f15657fa640 1 -- 172.21.15.136:0/677364852 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1560011df0 con 0x7f156819c190 2024-09-12T02:05:35.665 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.664+0000 7f156dc21640 1 -- 172.21.15.136:0/677364852 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f15681a49f0 con 0x7f156819c190 2024-09-12T02:05:35.665 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.664+0000 7f15657fa640 1 -- 172.21.15.136:0/677364852 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7f1560013ba0 con 0x7f156819c190 2024-09-12T02:05:35.666 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:05:35.666 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":3,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","modified":"2024-09-12T02:05:30.360281Z","created":"2024-09-12T02:03:39.733285Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:3300","nonce":0},{"type":"v1","addr":"172.21.15.115:6789","nonce":0}]},"addr":"172.21.15.115:6789/0","public_addr":"172.21.15.115:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T02:05:35.666 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 3 2024-09-12T02:05:35.666 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:05:35.666 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:35.666 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: mon.c calling monitor election 2024-09-12T02:05:35.666 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: mon.a calling monitor election 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: monmap epoch 3 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: last_changed 2024-09-12T02:05:30.360281+0000 2024-09-12T02:05:35.667 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: created 2024-09-12T02:03:39.733285+0000 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: min_mon_release 19 (squid) 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: election_strategy: 1 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: 1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.c 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: 2: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: fsmap 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: mgrmap e13: x(active, since 50s) 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: overall HEALTH_OK 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:35.668 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:35.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.666+0000 7f156dc21640 1 -- 172.21.15.136:0/677364852 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f15480394f0 msgr2=0x7f154803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.666+0000 7f156dc21640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f15480394f0 0x7f154803b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1558005f50 tx=0x7f1558005bc0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.666+0000 7f156dc21640 1 -- 172.21.15.136:0/677364852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f156819c190 msgr2=0x7f156819c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:35.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.666+0000 7f156dc21640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f156819c190 0x7f156819c640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f156000bd50 tx=0x7f156000be40 comp rx=0 tx=0).stop 2024-09-12T02:05:35.669 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.666+0000 7f156dc21640 1 -- 172.21.15.136:0/677364852 shutdown_connections 2024-09-12T02:05:35.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.666+0000 7f156dc21640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f15480394f0 0x7f154803b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.666+0000 7f156dc21640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f156819c190 0x7f156819c640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.666+0000 7f156dc21640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f15681978c0 0x7f156819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.666+0000 7f156dc21640 1 --2- 172.21.15.136:0/677364852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15681028a0 0x7f1568197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:35.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.666+0000 7f156dc21640 1 -- 172.21.15.136:0/677364852 >> 172.21.15.136:0/677364852 conn(0x7f15680fc280 msgr2=0x7f15680fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:35.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.667+0000 7f156dc21640 1 -- 172.21.15.136:0/677364852 shutdown_connections 2024-09-12T02:05:35.670 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:35.667+0000 7f156dc21640 1 -- 172.21.15.136:0/677364852 wait complete. 2024-09-12T02:05:35.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:05:35.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:35.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: mon.c calling monitor election 2024-09-12T02:05:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: mon.a calling monitor election 2024-09-12T02:05:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:05:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: monmap epoch 3 2024-09-12T02:05:35.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:05:35.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: last_changed 2024-09-12T02:05:30.360281+0000 2024-09-12T02:05:35.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: created 2024-09-12T02:03:39.733285+0000 2024-09-12T02:05:35.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: min_mon_release 19 (squid) 2024-09-12T02:05:35.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: election_strategy: 1 2024-09-12T02:05:35.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-09-12T02:05:35.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: 1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.c 2024-09-12T02:05:35.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: 2: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-09-12T02:05:35.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: fsmap 2024-09-12T02:05:35.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:05:35.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: mgrmap e13: x(active, since 50s) 2024-09-12T02:05:35.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: overall HEALTH_OK 2024-09-12T02:05:35.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:35.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:35.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:35.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:35.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:36.312 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T02:05:36.313 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T02:05:36.550 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:36 smithi136 ceph-mon[35814]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:36.550 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:36.550 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:36 smithi136 ceph-mon[35814]: from='client.? 172.21.15.136:0/677364852' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:05:36.551 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:36.659 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:36 smithi110 ceph-mon[30548]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:36.659 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:36.659 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:36 smithi110 ceph-mon[30548]: from='client.? 172.21.15.136:0/677364852' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:05:36.659 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:36.706 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.238+0000 7fdae2000640 1 -- 172.21.15.110:0/1084852799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc074590 msgr2=0x7fdadc074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.238+0000 7fdae2000640 1 --2- 172.21.15.110:0/1084852799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc074590 0x7fdadc074970 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009880 tx=0x7fdad002a670 comp rx=0 tx=0).stop 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.238+0000 7fdae2000640 1 -- 172.21.15.110:0/1084852799 shutdown_connections 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.238+0000 7fdae2000640 1 --2- 172.21.15.110:0/1084852799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc074590 0x7fdadc074970 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.238+0000 7fdae2000640 1 -- 172.21.15.110:0/1084852799 >> 172.21.15.110:0/1084852799 conn(0x7fdadc0fd0a0 msgr2=0x7fdadc0ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.239+0000 7fdae2000640 1 -- 172.21.15.110:0/1084852799 shutdown_connections 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.239+0000 7fdae2000640 1 -- 172.21.15.110:0/1084852799 wait complete. 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.240+0000 7fdae2000640 1 Processor -- start 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.240+0000 7fdae2000640 1 -- start start 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.240+0000 7fdae2000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc074590 0x7fdadc073c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.240+0000 7fdae2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc071da0 0x7fdadc072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.240+0000 7fdae2000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc072740 0x7fdadc1b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.240+0000 7fdae2000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc112070 con 0x7fdadc071da0 2024-09-12T02:05:37.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.240+0000 7fdae2000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc111ef0 con 0x7fdadc072740 2024-09-12T02:05:37.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.240+0000 7fdae2000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc1121f0 con 0x7fdadc074590 2024-09-12T02:05:37.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae0c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc074590 0x7fdadc073c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdadbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc071da0 0x7fdadc072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae0c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc074590 0x7fdadc073c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:50534/0 (socket says 172.21.15.110:50534) 2024-09-12T02:05:37.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae0c00640 1 -- 172.21.15.110:0/357610571 learned_addr learned my addr 172.21.15.110:0/357610571 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:05:37.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae1600640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc072740 0x7fdadc1b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae1600640 1 -- 172.21.15.110:0/357610571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc072740 msgr2=0x7fdadc1b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-12T02:05:37.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae1600640 1 -- 172.21.15.110:0/357610571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc072740 msgr2=0x7fdadc1b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T02:05:37.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae1600640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc072740 0x7fdadc1b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T02:05:37.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae1600640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc072740 0x7fdadc1b2580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:05:37.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae0c00640 1 -- 172.21.15.110:0/357610571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc072740 msgr2=0x7fdadc1b2580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:05:37.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae0c00640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc072740 0x7fdadc1b2580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae0c00640 1 -- 172.21.15.110:0/357610571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc071da0 msgr2=0x7fdadc072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae0c00640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc071da0 0x7fdadc072200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.241+0000 7fdae0c00640 1 -- 172.21.15.110:0/357610571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc1b2af0 con 0x7fdadc074590 2024-09-12T02:05:37.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.242+0000 7fdae0c00640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc074590 0x7fdadc073c90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdad0031550 tx=0x7fdad00042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.243+0000 7fdad9600640 1 -- 172.21.15.110:0/357610571 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad003f030 con 0x7fdadc074590 2024-09-12T02:05:37.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.243+0000 7fdad9600640 1 -- 172.21.15.110:0/357610571 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdad0003ce0 con 0x7fdadc074590 2024-09-12T02:05:37.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.243+0000 7fdad9600640 1 -- 172.21.15.110:0/357610571 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad0035070 con 0x7fdadc074590 2024-09-12T02:05:37.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.243+0000 7fdae2000640 1 -- 172.21.15.110:0/357610571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdadc1b2d80 con 0x7fdadc074590 2024-09-12T02:05:37.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.243+0000 7fdae2000640 1 -- 172.21.15.110:0/357610571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdadc1b31b0 con 0x7fdadc074590 2024-09-12T02:05:37.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.244+0000 7fdae2000640 1 -- 172.21.15.110:0/357610571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdadc0749f0 con 0x7fdadc074590 2024-09-12T02:05:37.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.244+0000 7fdad9600640 1 -- 172.21.15.110:0/357610571 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fdad0042030 con 0x7fdadc074590 2024-09-12T02:05:37.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.245+0000 7fdad9600640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdac40394f0 0x7fdac403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:37.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.245+0000 7fdad9600640 1 -- 172.21.15.110:0/357610571 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdad006cdf0 con 0x7fdadc074590 2024-09-12T02:05:37.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.245+0000 7fdadbe00640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdac40394f0 0x7fdac403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:37.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.246+0000 7fdadbe00640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdac40394f0 0x7fdac403b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009a30 tx=0x7fdac8009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:37.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.250+0000 7fdad9600640 1 -- 172.21.15.110:0/357610571 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdad0039350 con 0x7fdadc074590 2024-09-12T02:05:37.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.463+0000 7fdae2000640 1 -- 172.21.15.110:0/357610571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fdadc1b3520 con 0x7fdadc074590 2024-09-12T02:05:37.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.463+0000 7fdad9600640 1 -- 172.21.15.110:0/357610571 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7fdad003bce0 con 0x7fdadc074590 2024-09-12T02:05:37.464 INFO:teuthology.orchestra.run.smithi110.stdout:# minimal ceph.conf for 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:05:37.464 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-09-12T02:05:37.464 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:05:37.464 INFO:teuthology.orchestra.run.smithi110.stdout: mon_host = [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] 2024-09-12T02:05:37.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.466+0000 7fdae2000640 1 -- 172.21.15.110:0/357610571 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdac40394f0 msgr2=0x7fdac403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.466+0000 7fdae2000640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdac40394f0 0x7fdac403b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009a30 tx=0x7fdac8009190 comp rx=0 tx=0).stop 2024-09-12T02:05:37.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.466+0000 7fdae2000640 1 -- 172.21.15.110:0/357610571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc074590 msgr2=0x7fdadc073c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:37.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.466+0000 7fdae2000640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc074590 0x7fdadc073c90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdad0031550 tx=0x7fdad00042f0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.467+0000 7fdae2000640 1 -- 172.21.15.110:0/357610571 shutdown_connections 2024-09-12T02:05:37.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.467+0000 7fdae2000640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdac40394f0 0x7fdac403b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.467+0000 7fdae2000640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc072740 0x7fdadc1b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.467+0000 7fdae2000640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc071da0 0x7fdadc072200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.467+0000 7fdae2000640 1 --2- 172.21.15.110:0/357610571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc074590 0x7fdadc073c90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:37.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.467+0000 7fdae2000640 1 -- 172.21.15.110:0/357610571 >> 172.21.15.110:0/357610571 conn(0x7fdadc0fd0a0 msgr2=0x7fdadc0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:37.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.467+0000 7fdae2000640 1 -- 172.21.15.110:0/357610571 shutdown_connections 2024-09-12T02:05:37.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:37.467+0000 7fdae2000640 1 -- 172.21.15.110:0/357610571 wait complete. 2024-09-12T02:05:37.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:05:37.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:37.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: mon.c calling monitor election 2024-09-12T02:05:37.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: mon.a calling monitor election 2024-09-12T02:05:37.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:05:37.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:37.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:37.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:37.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:37.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:37.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:37.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:37.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-12T02:05:37.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: monmap epoch 3 2024-09-12T02:05:37.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:05:37.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: last_changed 2024-09-12T02:05:30.360281+0000 2024-09-12T02:05:37.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: created 2024-09-12T02:03:39.733285+0000 2024-09-12T02:05:37.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: min_mon_release 19 (squid) 2024-09-12T02:05:37.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: election_strategy: 1 2024-09-12T02:05:37.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-09-12T02:05:37.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: 1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.c 2024-09-12T02:05:37.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: 2: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-09-12T02:05:37.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: fsmap 2024-09-12T02:05:37.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:05:37.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: mgrmap e13: x(active, since 50s) 2024-09-12T02:05:37.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: overall HEALTH_OK 2024-09-12T02:05:37.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:37.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:37.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:37.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:37.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:37.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:37.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:37.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='client.? 172.21.15.136:0/677364852' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T02:05:37.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:38.181 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: mon.b calling monitor election 2024-09-12T02:05:38.181 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-12T02:05:38.182 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-12T02:05:38.182 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-12T02:05:38.182 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: Updating smithi136:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:38.182 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: Updating smithi115:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:38.182 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: mon.b calling monitor election 2024-09-12T02:05:38.182 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: mon.c calling monitor election 2024-09-12T02:05:38.182 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: mon.a calling monitor election 2024-09-12T02:05:38.182 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:05:38.182 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:38.182 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: monmap epoch 3 2024-09-12T02:05:38.182 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:05:38.183 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: last_changed 2024-09-12T02:05:30.360281+0000 2024-09-12T02:05:38.183 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: created 2024-09-12T02:03:39.733285+0000 2024-09-12T02:05:38.183 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: min_mon_release 19 (squid) 2024-09-12T02:05:38.183 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: election_strategy: 1 2024-09-12T02:05:38.183 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-09-12T02:05:38.183 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: 1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.c 2024-09-12T02:05:38.183 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: 2: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-09-12T02:05:38.183 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: fsmap 2024-09-12T02:05:38.183 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:05:38.183 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: mgrmap e13: x(active, since 52s) 2024-09-12T02:05:38.183 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: overall HEALTH_OK 2024-09-12T02:05:38.184 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/357610571' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:38.184 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:38.184 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:38.184 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:38.184 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:38.184 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:38 smithi110 ceph-mon[30548]: Updating smithi110:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:38.222 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T02:05:38.222 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:05:38.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:05:38.280 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:05:38.280 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:05:38.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: mon.b calling monitor election 2024-09-12T02:05:38.296 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-12T02:05:38.296 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-12T02:05:38.296 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: Updating smithi136:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: Updating smithi115:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: mon.b calling monitor election 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: mon.c calling monitor election 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: mon.a calling monitor election 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: monmap epoch 3 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: last_changed 2024-09-12T02:05:30.360281+0000 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: created 2024-09-12T02:03:39.733285+0000 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: min_mon_release 19 (squid) 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: election_strategy: 1 2024-09-12T02:05:38.297 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-09-12T02:05:38.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: 1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.c 2024-09-12T02:05:38.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: 2: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-09-12T02:05:38.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: fsmap 2024-09-12T02:05:38.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:05:38.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: mgrmap e13: x(active, since 52s) 2024-09-12T02:05:38.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: overall HEALTH_OK 2024-09-12T02:05:38.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/357610571' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:38.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:38.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:38.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:38.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:38.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:38 smithi115 ceph-mon[35351]: Updating smithi110:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:38.378 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-12T02:05:38.379 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:05:38.406 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-12T02:05:38.406 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:05:38.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: mon.b calling monitor election 2024-09-12T02:05:38.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-12T02:05:38.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-12T02:05:38.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-12T02:05:38.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: Updating smithi136:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:38.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: Updating smithi115:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:38.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: mon.b calling monitor election 2024-09-12T02:05:38.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: mon.c calling monitor election 2024-09-12T02:05:38.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: mon.a calling monitor election 2024-09-12T02:05:38.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-12T02:05:38.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:38.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: monmap epoch 3 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: last_changed 2024-09-12T02:05:30.360281+0000 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: created 2024-09-12T02:03:39.733285+0000 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: min_mon_release 19 (squid) 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: election_strategy: 1 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: 0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: 1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.c 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: 2: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: fsmap 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: mgrmap e13: x(active, since 52s) 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: overall HEALTH_OK 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/357610571' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:38.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:38.411 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:38.411 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:38.411 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:38 smithi136 ceph-mon[35814]: Updating smithi110:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:05:38.471 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-12T02:05:38.471 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T02:05:38.498 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-12T02:05:38.498 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:05:38.563 INFO:tasks.cephadm:Adding mgr.x on smithi110 2024-09-12T02:05:38.563 INFO:tasks.cephadm:Adding mgr.y on smithi115 2024-09-12T02:05:38.563 INFO:tasks.cephadm:Adding mgr.z on smithi136 2024-09-12T02:05:38.563 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi110=x;smithi115=y;smithi136=z' 2024-09-12T02:05:38.838 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:05:39.204 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.204 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.204 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.204 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.204 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.204 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.204 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.204 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:05:39.205 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:05:39.205 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:05:39.205 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:39.205 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: Reconfiguring daemon mon.a on smithi110 2024-09-12T02:05:39.205 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:39 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:39.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.202+0000 7f3453fbf640 1 -- 172.21.15.136:0/530616041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c0fffe0 msgr2=0x7f344c1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.202+0000 7f3453fbf640 1 --2- 172.21.15.136:0/530616041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c0fffe0 0x7f344c1003e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f343c009c20 tx=0x7f343c02aa90 comp rx=0 tx=0).stop 2024-09-12T02:05:39.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.202+0000 7f3453fbf640 1 -- 172.21.15.136:0/530616041 shutdown_connections 2024-09-12T02:05:39.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.202+0000 7f3453fbf640 1 --2- 172.21.15.136:0/530616041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c0fffe0 0x7f344c1003e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.202+0000 7f3453fbf640 1 -- 172.21.15.136:0/530616041 >> 172.21.15.136:0/530616041 conn(0x7f344c0fbdb0 msgr2=0x7f344c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:39.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.202+0000 7f3453fbf640 1 -- 172.21.15.136:0/530616041 shutdown_connections 2024-09-12T02:05:39.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.202+0000 7f3453fbf640 1 -- 172.21.15.136:0/530616041 wait complete. 2024-09-12T02:05:39.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f3453fbf640 1 Processor -- start 2024-09-12T02:05:39.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f3453fbf640 1 -- start start 2024-09-12T02:05:39.207 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f3453fbf640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f344c0fffe0 0x7f344c1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f3453fbf640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f344c1996e0 0x7f344c19e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f3453fbf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c199b60 0x7f344c1a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f3453fbf640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f344c1099e0 con 0x7f344c199b60 2024-09-12T02:05:39.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f3453fbf640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f344c109860 con 0x7f344c0fffe0 2024-09-12T02:05:39.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f3453fbf640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f344c109b60 con 0x7f344c1996e0 2024-09-12T02:05:39.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f345155a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f344c1996e0 0x7f344c19e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f345155a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f344c1996e0 0x7f344c19e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:43030/0 (socket says 172.21.15.136:43030) 2024-09-12T02:05:39.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f345155a640 1 -- 172.21.15.136:0/140885117 learned_addr learned my addr 172.21.15.136:0/140885117 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-12T02:05:39.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f345255c640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c199b60 0x7f344c1a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.203+0000 7f3451d5b640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f344c0fffe0 0x7f344c1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.204+0000 7f345155a640 1 -- 172.21.15.136:0/140885117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f344c0fffe0 msgr2=0x7f344c1991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.204+0000 7f345155a640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f344c0fffe0 0x7f344c1991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.204+0000 7f345155a640 1 -- 172.21.15.136:0/140885117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c199b60 msgr2=0x7f344c1a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.204+0000 7f345155a640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c199b60 0x7f344c1a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.204+0000 7f345155a640 1 -- 172.21.15.136:0/140885117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344c1a15a0 con 0x7f344c1996e0 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.204+0000 7f345255c640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c199b60 0x7f344c1a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.204+0000 7f345155a640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f344c1996e0 0x7f344c19e750 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f344000b520 tx=0x7f344000b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.204+0000 7f344affd640 1 -- 172.21.15.136:0/140885117 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440004230 con 0x7f344c1996e0 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.204+0000 7f344affd640 1 -- 172.21.15.136:0/140885117 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34400043d0 con 0x7f344c1996e0 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.204+0000 7f3453fbf640 1 -- 172.21.15.136:0/140885117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f344c1a1890 con 0x7f344c1996e0 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.204+0000 7f344affd640 1 -- 172.21.15.136:0/140885117 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440003d60 con 0x7f344c1996e0 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.204+0000 7f3453fbf640 1 -- 172.21.15.136:0/140885117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f344c1a1e50 con 0x7f344c1996e0 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.205+0000 7f344affd640 1 -- 172.21.15.136:0/140885117 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f344000e070 con 0x7f344c1996e0 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.205+0000 7f344affd640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f34340394f0 0x7f343403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.205+0000 7f344affd640 1 -- 172.21.15.136:0/140885117 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f344004cab0 con 0x7f344c1996e0 2024-09-12T02:05:39.209 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.205+0000 7f3453fbf640 1 -- 172.21.15.136:0/140885117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f344c1927a0 con 0x7f344c1996e0 2024-09-12T02:05:39.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.206+0000 7f3451d5b640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f34340394f0 0x7f343403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:39.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.206+0000 7f3451d5b640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f34340394f0 0x7f343403b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f343c000f80 tx=0x7f343c03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:39.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.211+0000 7f344affd640 1 -- 172.21.15.136:0/140885117 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3440014020 con 0x7f344c1996e0 2024-09-12T02:05:39.362 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.362 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.362 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.362 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.362 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.362 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.363 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.363 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:05:39.363 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:05:39.363 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:05:39.363 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:39.363 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: Reconfiguring daemon mon.a on smithi110 2024-09-12T02:05:39.363 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:39.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.387+0000 7f3453fbf640 1 -- 172.21.15.136:0/140885117 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi110=x;smithi115=y;smithi136=z", "target": ["mon-mgr", ""]}) -- 0x7f344c062780 con 0x7f34340394f0 2024-09-12T02:05:39.394 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.393+0000 7f344affd640 1 -- 172.21.15.136:0/140885117 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f344c062780 con 0x7f34340394f0 2024-09-12T02:05:39.394 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled mgr update... 2024-09-12T02:05:39.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.396+0000 7f3453fbf640 1 -- 172.21.15.136:0/140885117 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f34340394f0 msgr2=0x7f343403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.396+0000 7f3453fbf640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f34340394f0 0x7f343403b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f343c000f80 tx=0x7f343c03a040 comp rx=0 tx=0).stop 2024-09-12T02:05:39.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.396+0000 7f3453fbf640 1 -- 172.21.15.136:0/140885117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f344c1996e0 msgr2=0x7f344c19e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:39.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.396+0000 7f3453fbf640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f344c1996e0 0x7f344c19e750 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f344000b520 tx=0x7f344000b9e0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.396+0000 7f3453fbf640 1 -- 172.21.15.136:0/140885117 shutdown_connections 2024-09-12T02:05:39.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.396+0000 7f3453fbf640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f34340394f0 0x7f343403b9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.396+0000 7f3453fbf640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f344c199b60 0x7f344c1a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.397 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.396+0000 7f3453fbf640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f344c1996e0 0x7f344c19e750 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.396+0000 7f3453fbf640 1 --2- 172.21.15.136:0/140885117 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f344c0fffe0 0x7f344c1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:39.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.396+0000 7f3453fbf640 1 -- 172.21.15.136:0/140885117 >> 172.21.15.136:0/140885117 conn(0x7f344c0fbdb0 msgr2=0x7f344c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:39.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.396+0000 7f3453fbf640 1 -- 172.21.15.136:0/140885117 shutdown_connections 2024-09-12T02:05:39.398 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:05:39.396+0000 7f3453fbf640 1 -- 172.21.15.136:0/140885117 wait complete. 2024-09-12T02:05:39.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:39.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: Reconfiguring mon.a (unknown last config time)... 2024-09-12T02:05:39.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:05:39.546 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:05:39.546 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:39.546 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: Reconfiguring daemon mon.a on smithi110 2024-09-12T02:05:39.546 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:39 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:05:39.686 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:05:39 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:05:39.360+0000 7fc677000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T02:05:40.047 DEBUG:teuthology.orchestra.run.smithi115:mgr.y> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.y.service 2024-09-12T02:05:40.050 DEBUG:teuthology.orchestra.run.smithi136:mgr.z> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.z.service 2024-09-12T02:05:40.052 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T02:05:40.052 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:05:40.052 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:05:40.087 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:05:40.088 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-09-12T02:05:40.164 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:05:40.164 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:05:40.164 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-12T02:05:40.164 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:05:40.164 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:05:40.164 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-12 02:04:58.925782237 +0000 2024-09-12T02:05:40.164 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-12 02:00:16.602964818 +0000 2024-09-12T02:05:40.164 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-12 02:00:16.602964818 +0000 2024-09-12T02:05:40.164 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-12 02:00:16.602964818 +0000 2024-09-12T02:05:40.165 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:05:40.268 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-12T02:05:40.268 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-12T02:05:40.268 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000174075 s, 2.9 MB/s 2024-09-12T02:05:40.272 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:05:40.310 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-09-12T02:05:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:05:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:05:40.387 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-09-12T02:05:40.387 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:05:40.387 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:05:40.387 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-12 02:04:58.971781456 +0000 2024-09-12T02:05:40.387 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-12 02:00:17.083956328 +0000 2024-09-12T02:05:40.387 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-12 02:00:17.083956328 +0000 2024-09-12T02:05:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-12 02:00:17.083956328 +0000 2024-09-12T02:05:40.388 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:05:40.480 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-12T02:05:40.480 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-12T02:05:40.481 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000197297 s, 2.6 MB/s 2024-09-12T02:05:40.483 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:05:40.520 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-09-12T02:05:40.550 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:40 smithi110 ceph-mon[30548]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:40.550 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:40 smithi110 ceph-mon[30548]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi110=x;smithi115=y;smithi136=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:40.550 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:40 smithi110 ceph-mon[30548]: Saving service mgr spec with placement smithi110=x;smithi115=y;smithi136=z;count:3 2024-09-12T02:05:40.550 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:40.551 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:40.551 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:40.551 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:05:40.551 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:05:40.551 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:40.586 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:05:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:05:40.587 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-09-12T02:05:40.587 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:05:40.587 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:05:40.587 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-12 02:04:59.017780675 +0000 2024-09-12T02:05:40.587 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-12 02:00:17.537948314 +0000 2024-09-12T02:05:40.587 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-12 02:00:17.537948314 +0000 2024-09-12T02:05:40.587 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-12 02:00:17.537948314 +0000 2024-09-12T02:05:40.587 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:05:40.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:40 smithi136 ceph-mon[35814]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:40.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:40 smithi136 ceph-mon[35814]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi110=x;smithi115=y;smithi136=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:40.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:40 smithi136 ceph-mon[35814]: Saving service mgr spec with placement smithi110=x;smithi115=y;smithi136=z;count:3 2024-09-12T02:05:40.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:40.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:40.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:40.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:05:40.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:05:40.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:40.682 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-12T02:05:40.683 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-12T02:05:40.683 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000166269 s, 3.1 MB/s 2024-09-12T02:05:40.685 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:05:40.722 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-09-12T02:05:40.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:40 smithi115 ceph-mon[35351]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:40.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:40 smithi115 ceph-mon[35351]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi110=x;smithi115=y;smithi136=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:40.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:40 smithi115 ceph-mon[35351]: Saving service mgr spec with placement smithi110=x;smithi115=y;smithi136=z;count:3 2024-09-12T02:05:40.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:40.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:40.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:40.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:05:40.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:05:40.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:40.798 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:05:40.798 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:05:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-12T02:05:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:05:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:05:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-12 02:04:59.061779928 +0000 2024-09-12T02:05:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-12 02:00:17.993940265 +0000 2024-09-12T02:05:40.798 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-12 02:00:17.993940265 +0000 2024-09-12T02:05:40.798 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-09-12 02:00:17.993940265 +0000 2024-09-12T02:05:40.799 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:05:40.891 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-12T02:05:40.891 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-12T02:05:40.891 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000178723 s, 2.9 MB/s 2024-09-12T02:05:40.894 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:05:40.930 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-09-12T02:05:40.930 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:05:40.950 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:05:40.950 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-09-12T02:05:41.009 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:05:41.009 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:05:41.009 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-12T02:05:41.009 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:05:41.009 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:05:41.009 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-12 02:05:29.816980477 +0000 2024-09-12T02:05:41.009 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-12 01:59:45.040607157 +0000 2024-09-12T02:05:41.009 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-12 01:59:45.040607157 +0000 2024-09-12T02:05:41.009 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-12 01:59:45.040607157 +0000 2024-09-12T02:05:41.010 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:05:41.075 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-12T02:05:41.075 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-12T02:05:41.076 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000317926 s, 1.6 MB/s 2024-09-12T02:05:41.077 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:05:41.136 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-09-12T02:05:41.192 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:05:41.192 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:05:41.192 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T02:05:41.192 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:05:41.192 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:05:41.193 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-12 02:05:29.817980457 +0000 2024-09-12T02:05:41.193 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-12 01:59:45.360600651 +0000 2024-09-12T02:05:41.193 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-12 01:59:45.360600651 +0000 2024-09-12T02:05:41.193 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-12 01:59:45.360600651 +0000 2024-09-12T02:05:41.193 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:05:41.257 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-12T02:05:41.257 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-12T02:05:41.257 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000207788 s, 2.5 MB/s 2024-09-12T02:05:41.258 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:05:41.316 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-09-12T02:05:41.372 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:05:41.372 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:05:41.372 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-12T02:05:41.372 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:05:41.373 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:05:41.373 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-12 02:05:29.817980457 +0000 2024-09-12T02:05:41.373 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-12 01:59:45.670594349 +0000 2024-09-12T02:05:41.373 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-12 01:59:45.670594349 +0000 2024-09-12T02:05:41.373 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-12 01:59:45.670594349 +0000 2024-09-12T02:05:41.373 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:05:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-12T02:05:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-12T02:05:41.437 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000194091 s, 2.6 MB/s 2024-09-12T02:05:41.438 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:05:41.496 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-09-12T02:05:41.551 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:05:41.551 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:05:41.551 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T02:05:41.551 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:05:41.551 INFO:teuthology.orchestra.run.smithi115.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:05:41.552 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-09-12 02:05:29.817980457 +0000 2024-09-12T02:05:41.552 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-09-12 01:59:45.999587661 +0000 2024-09-12T02:05:41.552 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-09-12 01:59:45.999587661 +0000 2024-09-12T02:05:41.552 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: 2024-09-12 01:59:45.999587661 +0000 2024-09-12T02:05:41.552 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:05:41.615 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-09-12T02:05:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-09-12T02:05:41.616 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000184423 s, 2.8 MB/s 2024-09-12T02:05:41.617 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:05:41.636 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:41 smithi110 ceph-mon[30548]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:05:41.636 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:41 smithi110 ceph-mon[30548]: Reconfiguring daemon mgr.x on smithi110 2024-09-12T02:05:41.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:41 smithi136 ceph-mon[35814]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:05:41.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:41 smithi136 ceph-mon[35814]: Reconfiguring daemon mgr.x on smithi110 2024-09-12T02:05:41.673 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-09-12T02:05:41.673 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T02:05:41.693 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T02:05:41.693 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-09-12T02:05:41.752 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T02:05:41.752 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:05:41.752 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-12T02:05:41.752 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:05:41.752 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:05:41.752 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-12 02:05:20.779264316 +0000 2024-09-12T02:05:41.752 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-12 01:59:45.088605846 +0000 2024-09-12T02:05:41.752 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-12 01:59:45.088605846 +0000 2024-09-12T02:05:41.752 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-12 01:59:45.088605846 +0000 2024-09-12T02:05:41.753 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T02:05:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:41 smithi115 ceph-mon[35351]: Reconfiguring mgr.x (unknown last config time)... 2024-09-12T02:05:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:41 smithi115 ceph-mon[35351]: Reconfiguring daemon mgr.x on smithi110 2024-09-12T02:05:41.820 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-12T02:05:41.820 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-12T02:05:41.820 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000234272 s, 2.2 MB/s 2024-09-12T02:05:41.822 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T02:05:41.880 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-09-12T02:05:41.938 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T02:05:41.938 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:05:41.938 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T02:05:41.938 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:05:41.938 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:05:41.938 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-12 02:05:20.779264316 +0000 2024-09-12T02:05:41.938 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-12 01:59:45.415598332 +0000 2024-09-12T02:05:41.938 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-12 01:59:45.415598332 +0000 2024-09-12T02:05:41.938 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-12 01:59:45.415598332 +0000 2024-09-12T02:05:41.939 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T02:05:42.004 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-12T02:05:42.004 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-12T02:05:42.004 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.00024121 s, 2.1 MB/s 2024-09-12T02:05:42.005 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T02:05:42.064 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-09-12T02:05:42.122 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T02:05:42.122 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:05:42.122 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-12T02:05:42.122 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:05:42.122 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:05:42.122 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-12 02:05:20.779264316 +0000 2024-09-12T02:05:42.122 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-12 01:59:45.746590727 +0000 2024-09-12T02:05:42.122 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-12 01:59:45.746590727 +0000 2024-09-12T02:05:42.123 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-12 01:59:45.746590727 +0000 2024-09-12T02:05:42.123 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T02:05:42.188 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-12T02:05:42.188 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-12T02:05:42.188 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000307127 s, 1.7 MB/s 2024-09-12T02:05:42.190 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T02:05:42.248 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-09-12T02:05:42.304 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T02:05:42.305 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T02:05:42.305 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-12T02:05:42.305 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T02:05:42.305 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T02:05:42.305 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-09-12 02:05:20.780264294 +0000 2024-09-12T02:05:42.305 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-09-12 01:59:46.076583145 +0000 2024-09-12T02:05:42.305 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-09-12 01:59:46.076583145 +0000 2024-09-12T02:05:42.305 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-09-12 01:59:46.076583145 +0000 2024-09-12T02:05:42.305 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T02:05:42.370 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-09-12T02:05:42.370 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-09-12T02:05:42.370 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000292612 s, 1.7 MB/s 2024-09-12T02:05:42.371 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T02:05:42.429 INFO:tasks.cephadm:Deploying osd.0 on smithi110 with /dev/vg_nvme/lv_4... 2024-09-12T02:05:42.429 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:05:42.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:42 smithi136 ceph-mon[35814]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:42.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:42.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:42.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:05:42.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:05:42.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:42 smithi110 ceph-mon[30548]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:05:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:05:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:42.786 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:42.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:42 smithi115 ceph-mon[35351]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:42.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:42.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:42.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:05:42.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:05:42.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:43.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:43 smithi136 ceph-mon[35814]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:05:43.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:43 smithi136 ceph-mon[35814]: Reconfiguring daemon mon.b on smithi115 2024-09-12T02:05:43.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:43 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:43.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:43 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:43.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:43 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:05:43.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:43 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:05:43.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:43 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:43.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:43 smithi110 ceph-mon[30548]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:05:43.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:43 smithi110 ceph-mon[30548]: Reconfiguring daemon mon.b on smithi115 2024-09-12T02:05:43.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:43 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:43.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:43 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:43.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:43 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:05:43.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:43 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:05:43.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:43 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:43.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:43 smithi115 ceph-mon[35351]: Reconfiguring mon.b (monmap changed)... 2024-09-12T02:05:43.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:43 smithi115 ceph-mon[35351]: Reconfiguring daemon mon.b on smithi115 2024-09-12T02:05:43.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:43 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:43.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:43 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:43.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:43 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T02:05:43.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:43 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T02:05:43.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:43 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:44.621 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:05:44.621 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: Reconfiguring daemon mon.c on smithi136 2024-09-12T02:05:44.621 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:44.621 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:44.621 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:44.621 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:44.622 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:44.622 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:44.622 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:44.622 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:05:44.622 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:05:44.622 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:05:44.622 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:05:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: Reconfiguring daemon mon.c on smithi136 2024-09-12T02:05:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:05:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:05:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:05:44.660 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:44.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: Reconfiguring mon.c (monmap changed)... 2024-09-12T02:05:44.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: Reconfiguring daemon mon.c on smithi136 2024-09-12T02:05:44.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:05:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:05:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:05:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:45.681 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:45 smithi136 ceph-mon[35814]: Deploying daemon mgr.z on smithi136 2024-09-12T02:05:45.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:45 smithi110 ceph-mon[30548]: Deploying daemon mgr.z on smithi136 2024-09-12T02:05:45.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:45 smithi115 ceph-mon[35351]: Deploying daemon mgr.z on smithi136 2024-09-12T02:05:45.858 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:05:45.890 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_4 2024-09-12T02:05:46.246 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:05:46.639 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:46 smithi136 ceph-mon[35814]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:46.639 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:46 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:46.580+0000 7fecca19f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:05:46.639 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:46 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:46.639+0000 7fecca19f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:05:46.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:46 smithi110 ceph-mon[30548]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:46.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:46 smithi115 ceph-mon[35351]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:46.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.848+0000 7f5a13200640 1 -- 172.21.15.110:0/3569151090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a0c1037c0 msgr2=0x7f5a0c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.848+0000 7f5a13200640 1 --2- 172.21.15.110:0/3569151090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a0c1037c0 0x7f5a0c10a050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5a04009900 tx=0x7f5a0402a400 comp rx=0 tx=0).stop 2024-09-12T02:05:46.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.849+0000 7f5a13200640 1 -- 172.21.15.110:0/3569151090 shutdown_connections 2024-09-12T02:05:46.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.849+0000 7f5a13200640 1 --2- 172.21.15.110:0/3569151090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a0c1037c0 0x7f5a0c10a050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.849+0000 7f5a13200640 1 --2- 172.21.15.110:0/3569151090 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a0c102e00 0x7f5a0c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.849+0000 7f5a13200640 1 --2- 172.21.15.110:0/3569151090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a0c101c00 0x7f5a0c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.849+0000 7f5a13200640 1 -- 172.21.15.110:0/3569151090 >> 172.21.15.110:0/3569151090 conn(0x7f5a0c0fd390 msgr2=0x7f5a0c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:05:46.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.849+0000 7f5a13200640 1 -- 172.21.15.110:0/3569151090 shutdown_connections 2024-09-12T02:05:46.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.849+0000 7f5a13200640 1 -- 172.21.15.110:0/3569151090 wait complete. 2024-09-12T02:05:46.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a13200640 1 Processor -- start 2024-09-12T02:05:46.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a13200640 1 -- start start 2024-09-12T02:05:46.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a13200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a0c101c00 0x7f5a0c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a13200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a0c102e00 0x7f5a0c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a13200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a0c1037c0 0x7f5a0c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a13200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c10d8d0 con 0x7f5a0c1037c0 2024-09-12T02:05:46.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a13200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c10d750 con 0x7f5a0c101c00 2024-09-12T02:05:46.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a13200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c10da50 con 0x7f5a0c102e00 2024-09-12T02:05:46.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a0be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a0c101c00 0x7f5a0c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a0be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a0c101c00 0x7f5a0c075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:35206/0 (socket says 172.21.15.110:35206) 2024-09-12T02:05:46.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a0be00640 1 -- 172.21.15.110:0/2170129923 learned_addr learned my addr 172.21.15.110:0/2170129923 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:05:46.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a03400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a0c102e00 0x7f5a0c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.850+0000 7f5a11200640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a0c1037c0 0x7f5a0c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.851+0000 7f5a0be00640 1 -- 172.21.15.110:0/2170129923 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a0c102e00 msgr2=0x7f5a0c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.851+0000 7f5a0be00640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a0c102e00 0x7f5a0c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.851+0000 7f5a0be00640 1 -- 172.21.15.110:0/2170129923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a0c1037c0 msgr2=0x7f5a0c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:05:46.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.851+0000 7f5a0be00640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a0c1037c0 0x7f5a0c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:05:46.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.851+0000 7f5a0be00640 1 -- 172.21.15.110:0/2170129923 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0c0753e0 con 0x7f5a0c101c00 2024-09-12T02:05:46.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.851+0000 7f5a11200640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a0c1037c0 0x7f5a0c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:05:46.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.851+0000 7f5a0be00640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a0c101c00 0x7f5a0c075f90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00eb70 tx=0x7f59fc00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:46.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.851+0000 7f5a09600640 1 -- 172.21.15.110:0/2170129923 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59fc003b70 con 0x7f5a0c101c00 2024-09-12T02:05:46.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.851+0000 7f5a09600640 1 -- 172.21.15.110:0/2170129923 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59fc00ee70 con 0x7f5a0c101c00 2024-09-12T02:05:46.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.851+0000 7f5a13200640 1 -- 172.21.15.110:0/2170129923 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0c1a1fd0 con 0x7f5a0c101c00 2024-09-12T02:05:46.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.851+0000 7f5a09600640 1 -- 172.21.15.110:0/2170129923 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59fc010830 con 0x7f5a0c101c00 2024-09-12T02:05:46.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.852+0000 7f5a13200640 1 -- 172.21.15.110:0/2170129923 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a0c1a2430 con 0x7f5a0c101c00 2024-09-12T02:05:46.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.852+0000 7f5a09600640 1 -- 172.21.15.110:0/2170129923 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f59fc004020 con 0x7f5a0c101c00 2024-09-12T02:05:46.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.852+0000 7f5a13200640 1 -- 172.21.15.110:0/2170129923 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a0c108fb0 con 0x7f5a0c101c00 2024-09-12T02:05:46.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.853+0000 7f5a09600640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f59f0039290 0x7f59f003b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:05:46.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.853+0000 7f5a09600640 1 -- 172.21.15.110:0/2170129923 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f59fc04cb30 con 0x7f5a0c101c00 2024-09-12T02:05:46.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.853+0000 7f5a03400640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f59f0039290 0x7f59f003b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:05:46.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.854+0000 7f5a03400640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f59f0039290 0x7f59f003b750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c075d10 tx=0x7f59f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:05:46.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:46.858+0000 7f5a09600640 1 -- 172.21.15.110:0/2170129923 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f59fc021ce0 con 0x7f5a0c101c00 2024-09-12T02:05:46.908 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:46 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:46.786+0000 7fecca19f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:05:46.908 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:46 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:46.851+0000 7fecca19f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:05:47.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:47.046+0000 7f5a13200640 1 -- 172.21.15.110:0/2170129923 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5a0c062630 con 0x7f59f0039290 2024-09-12T02:05:47.408 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:46 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:46.996+0000 7fecca19f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:05:47.408 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:47.132+0000 7fecca19f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:05:47.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:47 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:47 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:47 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:47 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:05:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:47 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:05:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:47 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:05:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:47 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:47 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:05:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:47 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:05:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:47 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:47.873 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:47 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:47.874 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:47 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:47.874 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:47 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:47.874 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:47 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:05:47.874 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:47 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:05:47.874 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:47 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:05:47.874 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:47 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:47.874 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:47 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:05:47.874 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:47 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:05:47.874 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:47 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:47.908 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:47.442+0000 7fecca19f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:05:47.908 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:47.502+0000 7fecca19f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:05:47.908 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:47.688+0000 7fecca19f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:05:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T02:05:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T02:05:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T02:05:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:05:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:05:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:47 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:48.544 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:48 smithi115 systemd[1]: Starting Ceph mgr.y for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:05:48.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:48 smithi110 ceph-mon[30548]: Deploying daemon mgr.y on smithi115 2024-09-12T02:05:48.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:48 smithi110 ceph-mon[30548]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:48.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:48 smithi110 ceph-mon[30548]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:48.856 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:48 smithi115 ceph-mon[35351]: Deploying daemon mgr.y on smithi115 2024-09-12T02:05:48.856 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:48 smithi115 ceph-mon[35351]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:48.856 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:48 smithi115 ceph-mon[35351]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:48.856 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:48 smithi115 podman[36701]: 2024-09-12 02:05:48.552500523 +0000 UTC m=+0.103550600 container create 838d5753ee4ac93febd3e15202cfc4b0ba8d071bf0b6d88fe53c50ff64b944dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T02:05:48.856 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:48 smithi115 podman[36701]: 2024-09-12 02:05:48.464904191 +0000 UTC m=+0.015954283 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:05:48.856 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:48 smithi115 podman[36701]: 2024-09-12 02:05:48.729663403 +0000 UTC m=+0.280713481 container init 838d5753ee4ac93febd3e15202cfc4b0ba8d071bf0b6d88fe53c50ff64b944dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T02:05:48.856 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:48 smithi115 podman[36701]: 2024-09-12 02:05:48.733123274 +0000 UTC m=+0.284173356 container start 838d5753ee4ac93febd3e15202cfc4b0ba8d071bf0b6d88fe53c50ff64b944dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T02:05:48.857 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:48 smithi115 ceph-mgr[36720]: -- 172.21.15.115:0/1975058457 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56343c7550e0 con 0x56343c733400 2024-09-12T02:05:48.857 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:48 smithi115 bash[36701]: 838d5753ee4ac93febd3e15202cfc4b0ba8d071bf0b6d88fe53c50ff64b944dd 2024-09-12T02:05:48.857 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:48 smithi115 systemd[1]: Started Ceph mgr.y for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:05:48.873 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:48 smithi136 ceph-mon[35814]: Deploying daemon mgr.y on smithi115 2024-09-12T02:05:48.873 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:48 smithi136 ceph-mon[35814]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:05:48.873 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:48 smithi136 ceph-mon[35814]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:48.873 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:48 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:48.556+0000 7fecca19f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:05:48.873 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:48 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:48.623+0000 7fecca19f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:05:49.137 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:48 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:48.855+0000 7fa13c3ef040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:05:49.137 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:48 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:48.913+0000 7fa13c3ef040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:05:49.137 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:49.068+0000 7fa13c3ef040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:05:49.138 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:49.137+0000 7fa13c3ef040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:05:49.447 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:49.294+0000 7fa13c3ef040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:05:49.447 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:49.447+0000 7fa13c3ef040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:05:49.711 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:49 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:49.441+0000 7fecca19f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:05:49.711 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:49 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:49.560+0000 7fecca19f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:05:49.711 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:49 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:49.710+0000 7fecca19f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:05:49.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:49.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:49 smithi110 ceph-mon[30548]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:50.008 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:49 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:49.776+0000 7fecca19f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:05:50.008 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:49 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:49.939+0000 7fecca19f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:05:50.008 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:50.008+0000 7fecca19f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:05:50.009 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:50.009 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:50.009 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:50.009 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:50.009 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:50.009 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:49 smithi136 ceph-mon[35814]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:50.027 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:49.772+0000 7fa13c3ef040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:05:50.027 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:49.833+0000 7fa13c3ef040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:05:50.027 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:50.027 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:50.028 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:50.028 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:50.028 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:50.028 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:49 smithi115 ceph-mon[35351]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:50.294 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:50 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:50.027+0000 7fa13c3ef040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:05:50.317 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:50.069+0000 7fecca19f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:05:50.317 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:50.253+0000 7fecca19f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:05:50.317 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:50.317+0000 7fecca19f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:05:50.586 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:50.386+0000 7fecca19f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:05:50.586 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:50.469+0000 7fecca19f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:05:50.586 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:50.528+0000 7fecca19f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:05:50.586 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:50.585+0000 7fecca19f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:05:51.294 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:50 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:50.915+0000 7fa13c3ef040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:05:51.294 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:50 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:50.983+0000 7fa13c3ef040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:05:51.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1107264757' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a36656f3-7a9c-4a0d-a44e-95a4791d8f54"}]: dispatch 2024-09-12T02:05:51.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1107264757' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a36656f3-7a9c-4a0d-a44e-95a4791d8f54"}]': finished 2024-09-12T02:05:51.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:05:51.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:05:51.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:51.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:51.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:51.296 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.296 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3608635256' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:05:51.368 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.452 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.452 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1107264757' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a36656f3-7a9c-4a0d-a44e-95a4791d8f54"}]: dispatch 2024-09-12T02:05:51.452 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1107264757' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a36656f3-7a9c-4a0d-a44e-95a4791d8f54"}]': finished 2024-09-12T02:05:51.452 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:05:51.452 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:05:51.452 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.452 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.452 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:51.452 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:51.452 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.452 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:51.453 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.453 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3608635256' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:05:51.453 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.453 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.453 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1107264757' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a36656f3-7a9c-4a0d-a44e-95a4791d8f54"}]: dispatch 2024-09-12T02:05:51.453 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1107264757' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a36656f3-7a9c-4a0d-a44e-95a4791d8f54"}]': finished 2024-09-12T02:05:51.454 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: osdmap e5: 1 total, 0 up, 1 in 2024-09-12T02:05:51.454 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:05:51.454 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.454 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.454 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:51.454 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:51.454 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.454 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:05:51.454 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:51.454 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:51 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3608635256' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:05:51.658 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:05:51 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:05:51.368+0000 7fecca19f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:05:51.963 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:51.704+0000 7fa13c3ef040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:05:51.963 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:51.819+0000 7fa13c3ef040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:05:51.963 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:51.962+0000 7fa13c3ef040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:05:52.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:52.081+0000 7f5a09600640 1 -- 172.21.15.110:0/2170129923 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 14) ==== 92061+0+0 (secure 0 0 0) 0x7f59fc004310 con 0x7f5a0c101c00 2024-09-12T02:05:52.242 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:52.024+0000 7fa13c3ef040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:05:52.242 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:52.174+0000 7fa13c3ef040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:05:52.242 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:52.242+0000 7fa13c3ef040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:05:52.243 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:52.243 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:52.243 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:52.243 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-mon[35351]: Standby manager daemon z started 2024-09-12T02:05:52.243 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.136:0/1258811446' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:05:52.243 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.136:0/1258811446' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:05:52.243 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-mon[35351]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:52.243 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.136:0/1258811446' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:05:52.243 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.136:0/1258811446' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:05:52.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:52.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:52.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:52.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:52 smithi136 ceph-mon[35814]: Standby manager daemon z started 2024-09-12T02:05:52.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:52 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.136:0/1258811446' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:05:52.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:52 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.136:0/1258811446' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:05:52.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:52 smithi136 ceph-mon[35814]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:52.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:52 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.136:0/1258811446' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:05:52.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:52 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.136:0/1258811446' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:05:52.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:52.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:05:52.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:05:52.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:52 smithi110 ceph-mon[30548]: Standby manager daemon z started 2024-09-12T02:05:52.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:52 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.136:0/1258811446' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:05:52.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:52 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.136:0/1258811446' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:05:52.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:52 smithi110 ceph-mon[30548]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:52.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:52 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.136:0/1258811446' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:05:52.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:52 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.136:0/1258811446' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:05:52.525 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:52.302+0000 7fa13c3ef040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:05:52.525 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:52.460+0000 7fa13c3ef040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:05:52.525 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:52.525+0000 7fa13c3ef040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:05:52.791 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:52.590+0000 7fa13c3ef040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:05:52.791 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:52.672+0000 7fa13c3ef040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:05:52.791 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:52.732+0000 7fa13c3ef040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:05:52.791 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:52.791+0000 7fa13c3ef040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:05:53.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:53 smithi136 ceph-mon[35814]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-12T02:05:53.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:53 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:05:53.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:53 smithi110 ceph-mon[30548]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-12T02:05:53.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:53 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:05:53.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:53 smithi115 ceph-mon[35351]: mgrmap e14: x(active, since 66s), standbys: z 2024-09-12T02:05:53.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:53 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:05:54.044 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:05:53 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:05:53.578+0000 7fa13c3ef040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:05:54.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:05:54.091+0000 7f5a09600640 1 -- 172.21.15.110:0/2170129923 <== mon.2 v2:172.21.15.115:3300/0 8 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f59fc0203a0 con 0x7f5a0c101c00 2024-09-12T02:05:54.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:54 smithi136 ceph-mon[35814]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:54.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:54 smithi136 ceph-mon[35814]: Standby manager daemon y started 2024-09-12T02:05:54.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:54 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.115:0/3100647780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:05:54.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:54 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.115:0/3100647780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:05:54.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:54 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.115:0/3100647780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:05:54.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:54 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.115:0/3100647780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:05:54.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:54 smithi110 ceph-mon[30548]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:54.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:54 smithi110 ceph-mon[30548]: Standby manager daemon y started 2024-09-12T02:05:54.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:54 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.115:0/3100647780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:05:54.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:54 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.115:0/3100647780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:05:54.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:54 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.115:0/3100647780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:05:54.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:54 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.115:0/3100647780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:05:54.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:54 smithi115 ceph-mon[35351]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:54.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:54 smithi115 ceph-mon[35351]: Standby manager daemon y started 2024-09-12T02:05:54.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:54 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.115:0/3100647780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:05:54.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:54 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.115:0/3100647780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:05:54.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:54 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.115:0/3100647780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:05:54.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:54 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.115:0/3100647780' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:05:55.352 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:55 smithi110 ceph-mon[30548]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-12T02:05:55.353 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:55 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:05:55.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:55 smithi136 ceph-mon[35814]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-12T02:05:55.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:55 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:05:55.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:55 smithi115 ceph-mon[35351]: mgrmap e15: x(active, since 68s), standbys: z, y 2024-09-12T02:05:55.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:55 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:05:56.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:56 smithi136 ceph-mon[35814]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:56.424 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:56 smithi110 ceph-mon[30548]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:56.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:56 smithi115 ceph-mon[35351]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:58.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:58 smithi110 ceph-mon[30548]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:58.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:58 smithi115 ceph-mon[35351]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:58.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:58 smithi136 ceph-mon[35814]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:05:59.685 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:05:59.685 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:05:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:59.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:05:59.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:05:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:05:59.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T02:05:59.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:05:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:00.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:00 smithi110 ceph-mon[30548]: Deploying daemon osd.0 on smithi110 2024-09-12T02:06:00.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:00 smithi110 ceph-mon[30548]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:00.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:00 smithi115 ceph-mon[35351]: Deploying daemon osd.0 on smithi110 2024-09-12T02:06:00.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:00 smithi115 ceph-mon[35351]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:00 smithi136 ceph-mon[35814]: Deploying daemon osd.0 on smithi110 2024-09-12T02:06:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:00 smithi136 ceph-mon[35814]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:02.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:02 smithi110 ceph-mon[30548]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:02.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:02 smithi115 ceph-mon[35351]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:02.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:02 smithi136 ceph-mon[35814]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:04.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:04 smithi115 ceph-mon[35351]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:04.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:04 smithi136 ceph-mon[35814]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:04.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:04 smithi110 ceph-mon[30548]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:06.711 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:06 smithi110 ceph-mon[30548]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:06.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:06 smithi115 ceph-mon[35351]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:06 smithi136 ceph-mon[35814]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:07.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:07 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:07.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:07 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:07.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:07 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:07.770 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:07 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:07.770 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:07 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:07.770 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:07 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:07.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:07 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:07.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:07 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:07.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:07 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:08.598 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:08 smithi110 ceph-mon[30548]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:08.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:08 smithi115 ceph-mon[35351]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:08.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:08 smithi136 ceph-mon[35814]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:10.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:10 smithi115 ceph-mon[35351]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:10.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:10.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:10.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:10.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:10.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:10 smithi136 ceph-mon[35814]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:10.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:10.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:10.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:10.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:10 smithi110 ceph-mon[30548]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:11.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.836+0000 7f5a09600640 1 -- 172.21.15.110:0/2170129923 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5a0c062630 con 0x7f59f0039290 2024-09-12T02:06:11.838 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 0 on host 'smithi110' 2024-09-12T02:06:11.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.839+0000 7f5a13200640 1 -- 172.21.15.110:0/2170129923 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f59f0039290 msgr2=0x7f59f003b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.839+0000 7f5a13200640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f59f0039290 0x7f59f003b750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c075d10 tx=0x7f59f4005f90 comp rx=0 tx=0).stop 2024-09-12T02:06:11.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.839+0000 7f5a13200640 1 -- 172.21.15.110:0/2170129923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a0c101c00 msgr2=0x7f5a0c075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:11.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.839+0000 7f5a13200640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a0c101c00 0x7f5a0c075f90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00eb70 tx=0x7f59fc00c6a0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.839+0000 7f5a13200640 1 -- 172.21.15.110:0/2170129923 shutdown_connections 2024-09-12T02:06:11.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.839+0000 7f5a13200640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f59f0039290 0x7f59f003b750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.839+0000 7f5a13200640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a0c1037c0 0x7f5a0c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.839+0000 7f5a13200640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a0c102e00 0x7f5a0c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.839+0000 7f5a13200640 1 --2- 172.21.15.110:0/2170129923 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5a0c101c00 0x7f5a0c075f90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:11.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.839+0000 7f5a13200640 1 -- 172.21.15.110:0/2170129923 >> 172.21.15.110:0/2170129923 conn(0x7f5a0c0fd390 msgr2=0x7f5a0c106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:11.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.840+0000 7f5a13200640 1 -- 172.21.15.110:0/2170129923 shutdown_connections 2024-09-12T02:06:11.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:06:11.840+0000 7f5a13200640 1 -- 172.21.15.110:0/2170129923 wait complete. 2024-09-12T02:06:12.554 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:12 smithi110 ceph-mon[30548]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:12.554 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:12.555 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:12.555 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:12.596 DEBUG:teuthology.orchestra.run.smithi110:osd.0> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T02:06:12.600 INFO:tasks.cephadm:Deploying osd.1 on smithi115 with /dev/vg_nvme/lv_4... 2024-09-12T02:06:12.600 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:06:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:12 smithi115 ceph-mon[35351]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:12 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:12 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:12 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:12.851 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:06:12.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:12 smithi136 ceph-mon[35814]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:12.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:12 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:12.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:12 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:12.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:12 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:13.108 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:06:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0[44570]: 2024-09-12T02:06:12.895+0000 7f6e24030640 -1 osd.0 0 log_to_monitors true 2024-09-12T02:06:13.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:13 smithi115 ceph-mon[35351]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:06:13.895 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:13 smithi110 ceph-mon[30548]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:06:13.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:13 smithi136 ceph-mon[35814]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T02:06:14.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:14 smithi110 ceph-mon[30548]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:14.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:14 smithi110 ceph-mon[30548]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:06:14.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:14 smithi110 ceph-mon[30548]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:06:14.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:14 smithi110 ceph-mon[30548]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:06:14.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:14 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:14.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:14 smithi115 ceph-mon[35351]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:14.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:14 smithi115 ceph-mon[35351]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:06:14.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:14 smithi115 ceph-mon[35351]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:06:14.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:14 smithi115 ceph-mon[35351]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:06:14.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:14 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:14 smithi136 ceph-mon[35814]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:14 smithi136 ceph-mon[35814]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T02:06:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:14 smithi136 ceph-mon[35814]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T02:06:14.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:14 smithi136 ceph-mon[35814]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:06:14.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:14 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:15.153 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:06:15.178 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_4 2024-09-12T02:06:15.428 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:06:15.436 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:06:15 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0[44570]: 2024-09-12T02:06:15.054+0000 7f6e1f200640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T02:06:15.436 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:06:15 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0[44570]: 2024-09-12T02:06:15.075+0000 7f6e14800640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:06:15.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:15 smithi115 ceph-mon[35351]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-12T02:06:15.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:15 smithi115 ceph-mon[35351]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:06:15.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:15 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:15.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:15 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:15.708 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:15 smithi115 ceph-mon[35351]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' 2024-09-12T02:06:15.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.896+0000 7f6a7288e640 1 -- 172.21.15.115:0/1056758799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a6c102690 msgr2=0x7f6a6c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:15.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.896+0000 7f6a7288e640 1 --2- 172.21.15.115:0/1056758799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a6c102690 0x7f6a6c108f20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009ca0 tx=0x7f6a6402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:06:15.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.896+0000 7f6a7288e640 1 -- 172.21.15.115:0/1056758799 shutdown_connections 2024-09-12T02:06:15.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.896+0000 7f6a7288e640 1 --2- 172.21.15.115:0/1056758799 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a6c102690 0x7f6a6c108f20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:15.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.896+0000 7f6a7288e640 1 --2- 172.21.15.115:0/1056758799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a6c101cd0 0x7f6a6c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:15.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.896+0000 7f6a7288e640 1 --2- 172.21.15.115:0/1056758799 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a6c100ad0 0x7f6a6c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:15.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.896+0000 7f6a7288e640 1 -- 172.21.15.115:0/1056758799 >> 172.21.15.115:0/1056758799 conn(0x7f6a6c0fc280 msgr2=0x7f6a6c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:15.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.896+0000 7f6a7288e640 1 -- 172.21.15.115:0/1056758799 shutdown_connections 2024-09-12T02:06:15.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.896+0000 7f6a7288e640 1 -- 172.21.15.115:0/1056758799 wait complete. 2024-09-12T02:06:15.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.896+0000 7f6a7288e640 1 Processor -- start 2024-09-12T02:06:15.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.896+0000 7f6a7288e640 1 -- start start 2024-09-12T02:06:15.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a7288e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a6c100ad0 0x7f6a6c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:15.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a7288e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a6c101cd0 0x7f6a6c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:15.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a7288e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a6c102690 0x7f6a6c19f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:15.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a7288e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c10c7d0 con 0x7f6a6c101cd0 2024-09-12T02:06:15.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a7288e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c10c650 con 0x7f6a6c102690 2024-09-12T02:06:15.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a7288e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c10c950 con 0x7f6a6c100ad0 2024-09-12T02:06:15.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a70e2b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a6c102690 0x7f6a6c19f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:15.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a70e2b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a6c102690 0x7f6a6c19f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:39678/0 (socket says 172.21.15.115:39678) 2024-09-12T02:06:15.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a70e2b640 1 -- 172.21.15.115:0/3294272976 learned_addr learned my addr 172.21.15.115:0/3294272976 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-12T02:06:15.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a6b7fe640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a6c101cd0 0x7f6a6c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:15.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a6bfff640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a6c100ad0 0x7f6a6c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:15.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a70e2b640 1 -- 172.21.15.115:0/3294272976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a6c100ad0 msgr2=0x7f6a6c06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:15.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a70e2b640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a6c100ad0 0x7f6a6c06ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:15.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a70e2b640 1 -- 172.21.15.115:0/3294272976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a6c101cd0 msgr2=0x7f6a6c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:15.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a70e2b640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a6c101cd0 0x7f6a6c19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:15.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a70e2b640 1 -- 172.21.15.115:0/3294272976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c19fb50 con 0x7f6a6c102690 2024-09-12T02:06:15.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.897+0000 7f6a6b7fe640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a6c101cd0 0x7f6a6c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:06:15.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.898+0000 7f6a70e2b640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a6c102690 0x7f6a6c19f290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a64005e30 tx=0x7f6a64031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:15.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.898+0000 7f6a697fa640 1 -- 172.21.15.115:0/3294272976 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64003c30 con 0x7f6a6c102690 2024-09-12T02:06:15.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.898+0000 7f6a7288e640 1 -- 172.21.15.115:0/3294272976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c19fde0 con 0x7f6a6c102690 2024-09-12T02:06:15.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.898+0000 7f6a697fa640 1 -- 172.21.15.115:0/3294272976 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a64003dd0 con 0x7f6a6c102690 2024-09-12T02:06:15.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.898+0000 7f6a697fa640 1 -- 172.21.15.115:0/3294272976 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6402fde0 con 0x7f6a6c102690 2024-09-12T02:06:15.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.898+0000 7f6a7288e640 1 -- 172.21.15.115:0/3294272976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c1a0360 con 0x7f6a6c102690 2024-09-12T02:06:15.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.899+0000 7f6a7288e640 1 -- 172.21.15.115:0/3294272976 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a6c107ea0 con 0x7f6a6c102690 2024-09-12T02:06:15.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.900+0000 7f6a697fa640 1 -- 172.21.15.115:0/3294272976 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f6a64004050 con 0x7f6a6c102690 2024-09-12T02:06:15.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.901+0000 7f6a697fa640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f6a540a2b70 0x7f6a540a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:15.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.901+0000 7f6a697fa640 1 -- 172.21.15.115:0/3294272976 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f6a640ee960 con 0x7f6a6c102690 2024-09-12T02:06:15.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.901+0000 7f6a6bfff640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f6a540a2b70 0x7f6a540a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:15.902 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.902+0000 7f6a6bfff640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f6a540a2b70 0x7f6a540a5030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c005fd0 tx=0x7f6a5c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:15.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:15.905+0000 7f6a697fa640 1 -- 172.21.15.115:0/3294272976 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a640bd4d0 con 0x7f6a6c102690 2024-09-12T02:06:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:15 smithi136 ceph-mon[35814]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-12T02:06:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:15 smithi136 ceph-mon[35814]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:06:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:15 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:15 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:15 smithi136 ceph-mon[35814]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' 2024-09-12T02:06:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:15 smithi110 ceph-mon[30548]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-12T02:06:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:15 smithi110 ceph-mon[30548]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T02:06:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:15 smithi110 ceph-mon[30548]: from='osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640]' entity='osd.0' 2024-09-12T02:06:16.084 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:16.084+0000 7f6a7288e640 1 -- 172.21.15.115:0/3294272976 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6a6c062630 con 0x7f6a540a2b70 2024-09-12T02:06:16.617 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:16 smithi110 ceph-mon[30548]: purged_snaps scrub starts 2024-09-12T02:06:16.617 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:16 smithi110 ceph-mon[30548]: purged_snaps scrub ok 2024-09-12T02:06:16.618 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:16 smithi110 ceph-mon[30548]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:16.618 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:16 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:16.618 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:16 smithi110 ceph-mon[30548]: osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640] boot 2024-09-12T02:06:16.618 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:16 smithi110 ceph-mon[30548]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:06:16.618 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:16 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:16.618 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:16 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:06:16.618 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:16 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:06:16.618 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:16 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:16.722 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:16 smithi115 ceph-mon[35351]: purged_snaps scrub starts 2024-09-12T02:06:16.722 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:16 smithi115 ceph-mon[35351]: purged_snaps scrub ok 2024-09-12T02:06:16.722 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:16 smithi115 ceph-mon[35351]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:16.723 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:16 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:16.723 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:16 smithi115 ceph-mon[35351]: osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640] boot 2024-09-12T02:06:16.723 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:16 smithi115 ceph-mon[35351]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:06:16.723 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:16 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:16.723 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:16 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:06:16.723 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:16 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:06:16.723 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:16 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:16.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:16 smithi136 ceph-mon[35814]: purged_snaps scrub starts 2024-09-12T02:06:16.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:16 smithi136 ceph-mon[35814]: purged_snaps scrub ok 2024-09-12T02:06:16.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:16 smithi136 ceph-mon[35814]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T02:06:16.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:16 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:16.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:16 smithi136 ceph-mon[35814]: osd.0 [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640] boot 2024-09-12T02:06:16.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:16 smithi136 ceph-mon[35814]: osdmap e8: 1 total, 1 up, 1 in 2024-09-12T02:06:16.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:16 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:06:16.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:16 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:06:16.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:16 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:06:16.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:16 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:17.726 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:17 smithi115 ceph-mon[35351]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:17.726 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:17 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:17.726 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:17 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:17.726 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:17 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:06:17.726 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:17 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:17.726 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:17 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:17.726 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:17 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:17.726 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:17 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:17.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:17 smithi136 ceph-mon[35814]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:17.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:17 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:17.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:17 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:17.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:17 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:06:17.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:17 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:17.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:17 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:17.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:17 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:17.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:17 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:17 smithi110 ceph-mon[30548]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:06:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:17.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:17.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:17 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:18.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:18 smithi115 ceph-mon[35351]: Detected new or changed devices on smithi110 2024-09-12T02:06:18.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:18 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi110 to 17089M 2024-09-12T02:06:18.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:18 smithi115 ceph-mon[35351]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:18.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:18 smithi115 ceph-mon[35351]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:06:18.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:18 smithi115 ceph-mon[35351]: from='client.? 172.21.15.115:0/673437109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9b02030-b19e-481a-9b91-4f7cb561b6b4"}]: dispatch 2024-09-12T02:06:18.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:18 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9b02030-b19e-481a-9b91-4f7cb561b6b4"}]: dispatch 2024-09-12T02:06:18.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:18 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9b02030-b19e-481a-9b91-4f7cb561b6b4"}]': finished 2024-09-12T02:06:18.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:18 smithi115 ceph-mon[35351]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:06:18.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:18 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:18.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:18 smithi136 ceph-mon[35814]: Detected new or changed devices on smithi110 2024-09-12T02:06:18.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:18 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi110 to 17089M 2024-09-12T02:06:18.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:18 smithi136 ceph-mon[35814]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:18.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:18 smithi136 ceph-mon[35814]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:06:18.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:18 smithi136 ceph-mon[35814]: from='client.? 172.21.15.115:0/673437109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9b02030-b19e-481a-9b91-4f7cb561b6b4"}]: dispatch 2024-09-12T02:06:18.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:18 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9b02030-b19e-481a-9b91-4f7cb561b6b4"}]: dispatch 2024-09-12T02:06:18.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:18 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9b02030-b19e-481a-9b91-4f7cb561b6b4"}]': finished 2024-09-12T02:06:18.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:18 smithi136 ceph-mon[35814]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:06:18.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:18 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:18.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:18 smithi110 ceph-mon[30548]: Detected new or changed devices on smithi110 2024-09-12T02:06:18.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:18 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi110 to 17089M 2024-09-12T02:06:18.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:18 smithi110 ceph-mon[30548]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:18.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:18 smithi110 ceph-mon[30548]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T02:06:18.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:18 smithi110 ceph-mon[30548]: from='client.? 172.21.15.115:0/673437109' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9b02030-b19e-481a-9b91-4f7cb561b6b4"}]: dispatch 2024-09-12T02:06:18.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:18 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e9b02030-b19e-481a-9b91-4f7cb561b6b4"}]: dispatch 2024-09-12T02:06:18.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:18 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e9b02030-b19e-481a-9b91-4f7cb561b6b4"}]': finished 2024-09-12T02:06:18.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:18 smithi110 ceph-mon[30548]: osdmap e10: 2 total, 1 up, 2 in 2024-09-12T02:06:18.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:18 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:19.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:19 smithi110 ceph-mon[30548]: from='client.? 172.21.15.115:0/2970335197' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:06:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:19 smithi115 ceph-mon[35351]: from='client.? 172.21.15.115:0/2970335197' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:06:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:19 smithi136 ceph-mon[35814]: from='client.? 172.21.15.115:0/2970335197' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:06:20.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:20 smithi115 ceph-mon[35351]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:20.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:20 smithi136 ceph-mon[35814]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:20 smithi110 ceph-mon[30548]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:22.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:22 smithi115 ceph-mon[35351]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:22.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:22 smithi136 ceph-mon[35814]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:22.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:22 smithi110 ceph-mon[30548]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:24.742 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:24 smithi115 ceph-mon[35351]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:24.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:24 smithi136 ceph-mon[35814]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:24.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:24 smithi110 ceph-mon[30548]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:26.661 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:26 smithi115 ceph-mon[35351]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:26.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:26 smithi136 ceph-mon[35814]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:26.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:26 smithi110 ceph-mon[30548]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:27 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:06:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:27 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:27.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:27 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:06:27.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:27 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:27 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T02:06:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:27 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:28.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:28 smithi115 ceph-mon[35351]: Deploying daemon osd.1 on smithi115 2024-09-12T02:06:28.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:28 smithi115 ceph-mon[35351]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:28.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:28 smithi136 ceph-mon[35814]: Deploying daemon osd.1 on smithi115 2024-09-12T02:06:28.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:28 smithi136 ceph-mon[35814]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:28.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:28 smithi110 ceph-mon[30548]: Deploying daemon osd.1 on smithi115 2024-09-12T02:06:28.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:28 smithi110 ceph-mon[30548]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:30.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:30 smithi115 ceph-mon[35351]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:30.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:30 smithi136 ceph-mon[35814]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:30.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:30 smithi110 ceph-mon[30548]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:32.623 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:32 smithi115 ceph-mon[35351]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:32.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:32 smithi136 ceph-mon[35814]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:32.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:32 smithi110 ceph-mon[30548]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:33.635 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:33 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:33.635 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:33 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:33.635 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:33 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:33.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:33 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:33.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:33 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:33.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:33 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:33.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:33 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:33.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:33 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:33.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:33 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:34.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:34 smithi115 ceph-mon[35351]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:34.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:34 smithi136 ceph-mon[35814]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:34.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:34 smithi110 ceph-mon[30548]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:36.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:36.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:36.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:36.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:36.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:36.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:36 smithi115 ceph-mon[35351]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:36.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:36.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:36.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:36.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:36.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:36.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:36 smithi136 ceph-mon[35814]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:36.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:36.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:36.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:36.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:36.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:36.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:36 smithi110 ceph-mon[30548]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:36.880 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 1 on host 'smithi115' 2024-09-12T02:06:36.880 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.879+0000 7f6a697fa640 1 -- 172.21.15.115:0/3294272976 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6a6c062630 con 0x7f6a540a2b70 2024-09-12T02:06:36.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.882+0000 7f6a7288e640 1 -- 172.21.15.115:0/3294272976 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f6a540a2b70 msgr2=0x7f6a540a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:36.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.882+0000 7f6a7288e640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f6a540a2b70 0x7f6a540a5030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c005fd0 tx=0x7f6a5c005850 comp rx=0 tx=0).stop 2024-09-12T02:06:36.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.882+0000 7f6a7288e640 1 -- 172.21.15.115:0/3294272976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a6c102690 msgr2=0x7f6a6c19f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:36.882 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.882+0000 7f6a7288e640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a6c102690 0x7f6a6c19f290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a64005e30 tx=0x7f6a64031ee0 comp rx=0 tx=0).stop 2024-09-12T02:06:36.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.882+0000 7f6a7288e640 1 -- 172.21.15.115:0/3294272976 shutdown_connections 2024-09-12T02:06:36.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.882+0000 7f6a7288e640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f6a540a2b70 0x7f6a540a5030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:36.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.882+0000 7f6a7288e640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6a6c102690 0x7f6a6c19f290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:36.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.882+0000 7f6a7288e640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6a6c101cd0 0x7f6a6c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:36.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.882+0000 7f6a7288e640 1 --2- 172.21.15.115:0/3294272976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a6c100ad0 0x7f6a6c06ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:36.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.882+0000 7f6a7288e640 1 -- 172.21.15.115:0/3294272976 >> 172.21.15.115:0/3294272976 conn(0x7f6a6c0fc280 msgr2=0x7f6a6c105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:36.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.882+0000 7f6a7288e640 1 -- 172.21.15.115:0/3294272976 shutdown_connections 2024-09-12T02:06:36.883 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:06:36.882+0000 7f6a7288e640 1 -- 172.21.15.115:0/3294272976 wait complete. 2024-09-12T02:06:37.433 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:37.433 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:37.433 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:37.466 DEBUG:teuthology.orchestra.run.smithi115:osd.1> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T02:06:37.468 INFO:tasks.cephadm:Deploying osd.2 on smithi136 with /dev/vg_nvme/lv_4... 2024-09-12T02:06:37.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T02:06:37.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:37 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:37.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:37 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:37.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:37 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:37.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:37 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:37.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:37 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:37.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:37 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:37.720 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:06:38.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:38 smithi136 ceph-mon[35814]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:38.580 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:38 smithi115 ceph-mon[35351]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:38.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:38 smithi110 ceph-mon[30548]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:39.369 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:39 smithi136 ceph-mon[35814]: from='osd.1 [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:06:39.369 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:39 smithi136 ceph-mon[35814]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:06:39.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:39 smithi110 ceph-mon[30548]: from='osd.1 [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:06:39.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:39 smithi110 ceph-mon[30548]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:06:39.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:39 smithi115 ceph-mon[35351]: from='osd.1 [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:06:39.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:39 smithi115 ceph-mon[35351]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T02:06:39.545 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:06:39 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1[39817]: 2024-09-12T02:06:39.184+0000 7f93aa31f640 -1 osd.1 0 log_to_monitors true 2024-09-12T02:06:39.924 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:06:39.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_4 2024-09-12T02:06:40.188 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:06:40.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:06:40.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:06:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: from='osd.1 [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:06:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:06:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:06:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:40.575 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:06:40.575 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:06:40.575 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:40.575 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: from='osd.1 [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:06:40.575 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:06:40.575 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:40.575 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:40.576 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:40.576 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:06:40.576 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:40.576 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:40.576 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:40.576 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:40.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.600+0000 7f107fb05640 1 -- 172.21.15.136:0/1928797432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10781037c0 msgr2=0x7f107810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.600+0000 7f107fb05640 1 --2- 172.21.15.136:0/1928797432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10781037c0 0x7f107810a050 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1070009ca0 tx=0x7f107002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.600+0000 7f107fb05640 1 -- 172.21.15.136:0/1928797432 shutdown_connections 2024-09-12T02:06:40.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.600+0000 7f107fb05640 1 --2- 172.21.15.136:0/1928797432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10781037c0 0x7f107810a050 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.600+0000 7f107fb05640 1 --2- 172.21.15.136:0/1928797432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1078102e00 0x7f1078103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.600+0000 7f107fb05640 1 --2- 172.21.15.136:0/1928797432 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1078101c00 0x7f1078102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.602 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.600+0000 7f107fb05640 1 -- 172.21.15.136:0/1928797432 >> 172.21.15.136:0/1928797432 conn(0x7f10780fd390 msgr2=0x7f10780ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.600+0000 7f107fb05640 1 -- 172.21.15.136:0/1928797432 shutdown_connections 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.600+0000 7f107fb05640 1 -- 172.21.15.136:0/1928797432 wait complete. 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107fb05640 1 Processor -- start 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107fb05640 1 -- start start 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107fb05640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1078101c00 0x7f1078197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107fb05640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1078102e00 0x7f10781983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107fb05640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10781037c0 0x7f107819f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107fb05640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f107810d900 con 0x7f10781037c0 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107fb05640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f107810d780 con 0x7f1078101c00 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107fb05640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f107810da80 con 0x7f1078102e00 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107d0a0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1078102e00 0x7f10781983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107d0a0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1078102e00 0x7f10781983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:46992/0 (socket says 172.21.15.136:46992) 2024-09-12T02:06:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107d0a0640 1 -- 172.21.15.136:0/1548835771 learned_addr learned my addr 172.21.15.136:0/1548835771 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107d8a1640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1078101c00 0x7f1078197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107e0a2640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10781037c0 0x7f107819f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107d0a0640 1 -- 172.21.15.136:0/1548835771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1078101c00 msgr2=0x7f1078197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107d0a0640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1078101c00 0x7f1078197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107d0a0640 1 -- 172.21.15.136:0/1548835771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10781037c0 msgr2=0x7f107819f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107d0a0640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10781037c0 0x7f107819f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107d0a0640 1 -- 172.21.15.136:0/1548835771 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107819fa90 con 0x7f1078102e00 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107e0a2640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10781037c0 0x7f107819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.601+0000 7f107d0a0640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1078102e00 0x7f10781983a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f107400c920 tx=0x7f107400cd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.602+0000 7f106affd640 1 -- 172.21.15.136:0/1548835771 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074007bb0 con 0x7f1078102e00 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.602+0000 7f107fb05640 1 -- 172.21.15.136:0/1548835771 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f107819fd80 con 0x7f1078102e00 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.602+0000 7f106affd640 1 -- 172.21.15.136:0/1548835771 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1074007d50 con 0x7f1078102e00 2024-09-12T02:06:40.604 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.602+0000 7f106affd640 1 -- 172.21.15.136:0/1548835771 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074018780 con 0x7f1078102e00 2024-09-12T02:06:40.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.602+0000 7f107fb05640 1 -- 172.21.15.136:0/1548835771 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10781a02c0 con 0x7f1078102e00 2024-09-12T02:06:40.605 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.603+0000 7f107fb05640 1 -- 172.21.15.136:0/1548835771 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1078108ed0 con 0x7f1078102e00 2024-09-12T02:06:40.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.604+0000 7f106affd640 1 -- 172.21.15.136:0/1548835771 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f107400f450 con 0x7f1078102e00 2024-09-12T02:06:40.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.604+0000 7f106affd640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f10640a2b20 0x7f10640a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:06:40.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.605+0000 7f106affd640 1 -- 172.21.15.136:0/1548835771 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f10740cd770 con 0x7f1078102e00 2024-09-12T02:06:40.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.605+0000 7f107d8a1640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f10640a2b20 0x7f10640a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:06:40.606 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.605+0000 7f107d8a1640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f10640a2b20 0x7f10640a4fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1078102c60 tx=0x7f106c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:06:40.609 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.609+0000 7f106affd640 1 -- 172.21.15.136:0/1548835771 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1074014030 con 0x7f1078102e00 2024-09-12T02:06:40.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T02:06:40.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T02:06:40.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:40.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: from='osd.1 [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:06:40.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:06:40.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:40.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:40.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:40.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:06:40.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:40.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:40.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:06:40.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:40.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:06:40.782+0000 7f107fb05640 1 -- 172.21.15.136:0/1548835771 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1078062630 con 0x7f10640a2b20 2024-09-12T02:06:41.294 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1[39817]: 2024-09-12T02:06:40.975+0000 7f93a62a2640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T02:06:41.294 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:06:40 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1[39817]: 2024-09-12T02:06:40.979+0000 7f939e0c2640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:06:41.470 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:41 smithi136 ceph-mon[35814]: Detected new or changed devices on smithi115 2024-09-12T02:06:41.470 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:41 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi115 to 17088M 2024-09-12T02:06:41.470 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:41 smithi136 ceph-mon[35814]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-12T02:06:41.471 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:41 smithi136 ceph-mon[35814]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:06:41.471 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:41.471 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:41.471 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:06:41.471 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:06:41.471 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:41.471 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:41 smithi136 ceph-mon[35814]: from='osd.1 ' entity='osd.1' 2024-09-12T02:06:41.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:41 smithi110 ceph-mon[30548]: Detected new or changed devices on smithi115 2024-09-12T02:06:41.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:41 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi115 to 17088M 2024-09-12T02:06:41.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:41 smithi110 ceph-mon[30548]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-12T02:06:41.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:41 smithi110 ceph-mon[30548]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:06:41.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:41.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:41.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:06:41.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:06:41.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:41.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:41 smithi110 ceph-mon[30548]: from='osd.1 ' entity='osd.1' 2024-09-12T02:06:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:41 smithi115 ceph-mon[35351]: Detected new or changed devices on smithi115 2024-09-12T02:06:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:41 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi115 to 17088M 2024-09-12T02:06:41.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:41 smithi115 ceph-mon[35351]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-12T02:06:41.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:41 smithi115 ceph-mon[35351]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T02:06:41.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:41.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:41.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:06:41.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:06:41.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:41.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:41 smithi115 ceph-mon[35351]: from='osd.1 ' entity='osd.1' 2024-09-12T02:06:42.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:42 smithi136 ceph-mon[35814]: purged_snaps scrub starts 2024-09-12T02:06:42.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:42 smithi136 ceph-mon[35814]: purged_snaps scrub ok 2024-09-12T02:06:42.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:42 smithi136 ceph-mon[35814]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:42.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:42.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:42 smithi136 ceph-mon[35814]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:42.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:42 smithi136 ceph-mon[35814]: osd.1 [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070] boot 2024-09-12T02:06:42.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:42 smithi136 ceph-mon[35814]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:06:42.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:42 smithi110 ceph-mon[30548]: purged_snaps scrub starts 2024-09-12T02:06:42.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:42 smithi110 ceph-mon[30548]: purged_snaps scrub ok 2024-09-12T02:06:42.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:42 smithi110 ceph-mon[30548]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:42.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:42.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:42 smithi110 ceph-mon[30548]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:42.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:42 smithi110 ceph-mon[30548]: osd.1 [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070] boot 2024-09-12T02:06:42.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:42 smithi110 ceph-mon[30548]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:06:42.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:42.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:42 smithi115 ceph-mon[35351]: purged_snaps scrub starts 2024-09-12T02:06:42.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:42 smithi115 ceph-mon[35351]: purged_snaps scrub ok 2024-09-12T02:06:42.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:42 smithi115 ceph-mon[35351]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:06:42.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:42.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:42 smithi115 ceph-mon[35351]: pgmap v60: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-12T02:06:42.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:42 smithi115 ceph-mon[35351]: osd.1 [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070] boot 2024-09-12T02:06:42.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:42 smithi115 ceph-mon[35351]: osdmap e13: 2 total, 2 up, 2 in 2024-09-12T02:06:42.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:06:44.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:43 smithi115 ceph-mon[35351]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T02:06:44.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:43 smithi115 ceph-mon[35351]: from='client.? 172.21.15.136:0/2970080924' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5383e300-6d1a-419d-ac6c-a918c7541c7a"}]: dispatch 2024-09-12T02:06:44.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:43 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5383e300-6d1a-419d-ac6c-a918c7541c7a"}]: dispatch 2024-09-12T02:06:44.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:43 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5383e300-6d1a-419d-ac6c-a918c7541c7a"}]': finished 2024-09-12T02:06:44.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:43 smithi115 ceph-mon[35351]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:06:44.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:43 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:06:44.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:43 smithi115 ceph-mon[35351]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:44.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:43 smithi115 ceph-mon[35351]: from='client.? 172.21.15.136:0/3072281018' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:06:44.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:43 smithi136 ceph-mon[35814]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T02:06:44.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:43 smithi136 ceph-mon[35814]: from='client.? 172.21.15.136:0/2970080924' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5383e300-6d1a-419d-ac6c-a918c7541c7a"}]: dispatch 2024-09-12T02:06:44.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:43 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5383e300-6d1a-419d-ac6c-a918c7541c7a"}]: dispatch 2024-09-12T02:06:44.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:43 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5383e300-6d1a-419d-ac6c-a918c7541c7a"}]': finished 2024-09-12T02:06:44.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:43 smithi136 ceph-mon[35814]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:06:44.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:43 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:06:44.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:43 smithi136 ceph-mon[35814]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:44.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:43 smithi136 ceph-mon[35814]: from='client.? 172.21.15.136:0/3072281018' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:06:44.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:43 smithi110 ceph-mon[30548]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T02:06:44.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:43 smithi110 ceph-mon[30548]: from='client.? 172.21.15.136:0/2970080924' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5383e300-6d1a-419d-ac6c-a918c7541c7a"}]: dispatch 2024-09-12T02:06:44.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:43 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5383e300-6d1a-419d-ac6c-a918c7541c7a"}]: dispatch 2024-09-12T02:06:44.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:43 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5383e300-6d1a-419d-ac6c-a918c7541c7a"}]': finished 2024-09-12T02:06:44.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:43 smithi110 ceph-mon[30548]: osdmap e15: 3 total, 2 up, 3 in 2024-09-12T02:06:44.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:43 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:06:44.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:43 smithi110 ceph-mon[30548]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:44.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:43 smithi110 ceph-mon[30548]: from='client.? 172.21.15.136:0/3072281018' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:06:46.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:46 smithi110 ceph-mon[30548]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:46.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:46 smithi115 ceph-mon[35351]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:46.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:46 smithi136 ceph-mon[35814]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:48.782 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:48 smithi136 ceph-mon[35814]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:48 smithi115 ceph-mon[35351]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:48.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:48 smithi110 ceph-mon[30548]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:50.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:50 smithi136 ceph-mon[35814]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:50.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:50 smithi115 ceph-mon[35351]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:50.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:50 smithi110 ceph-mon[30548]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:51.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:06:51.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:06:51.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:51.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T02:06:51.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:06:52.709 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:52 smithi136 ceph-mon[35814]: Deploying daemon osd.2 on smithi136 2024-09-12T02:06:52.709 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:52 smithi136 ceph-mon[35814]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:52.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:52 smithi115 ceph-mon[35351]: Deploying daemon osd.2 on smithi136 2024-09-12T02:06:52.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:52 smithi115 ceph-mon[35351]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:52 smithi110 ceph-mon[30548]: Deploying daemon osd.2 on smithi136 2024-09-12T02:06:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:52 smithi110 ceph-mon[30548]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:54.706 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:54 smithi136 ceph-mon[35814]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:54.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:54 smithi115 ceph-mon[35351]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:54.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:54 smithi110 ceph-mon[30548]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:56.783 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:56 smithi136 ceph-mon[35814]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:56.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:56 smithi115 ceph-mon[35351]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:56.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:56 smithi110 ceph-mon[30548]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:58.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:58 smithi136 ceph-mon[35814]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:58.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:58.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:58.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:06:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:58.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:58 smithi115 ceph-mon[35351]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:06:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:58 smithi110 ceph-mon[30548]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:06:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:06:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:06:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:06:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:00.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:00 smithi115 ceph-mon[35351]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:07:00.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:00 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:00.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:00 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:00 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:00 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:00 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:00 smithi136 ceph-mon[35814]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:07:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:00 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:00 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:00 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:00 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:00 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:00.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:00 smithi110 ceph-mon[30548]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:07:00.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:00 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:00.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:00 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:00.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:00 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:00.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:00 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:00.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:00 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:01.210 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.208+0000 7f106affd640 1 -- 172.21.15.136:0/1548835771 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1078062630 con 0x7f10640a2b20 2024-09-12T02:07:01.210 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 2 on host 'smithi136' 2024-09-12T02:07:01.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.211+0000 7f107fb05640 1 -- 172.21.15.136:0/1548835771 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f10640a2b20 msgr2=0x7f10640a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:01.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.211+0000 7f107fb05640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f10640a2b20 0x7f10640a4fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1078102c60 tx=0x7f106c009110 comp rx=0 tx=0).stop 2024-09-12T02:07:01.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.211+0000 7f107fb05640 1 -- 172.21.15.136:0/1548835771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1078102e00 msgr2=0x7f10781983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:01.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.211+0000 7f107fb05640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1078102e00 0x7f10781983a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f107400c920 tx=0x7f107400cd20 comp rx=0 tx=0).stop 2024-09-12T02:07:01.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.211+0000 7f107fb05640 1 -- 172.21.15.136:0/1548835771 shutdown_connections 2024-09-12T02:07:01.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.211+0000 7f107fb05640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f10640a2b20 0x7f10640a4fe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.211+0000 7f107fb05640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10781037c0 0x7f107819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.212 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.211+0000 7f107fb05640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1078102e00 0x7f10781983a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.211+0000 7f107fb05640 1 --2- 172.21.15.136:0/1548835771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1078101c00 0x7f1078197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:01.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.211+0000 7f107fb05640 1 -- 172.21.15.136:0/1548835771 >> 172.21.15.136:0/1548835771 conn(0x7f10780fd390 msgr2=0x7f10781060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:01.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.211+0000 7f107fb05640 1 -- 172.21.15.136:0/1548835771 shutdown_connections 2024-09-12T02:07:01.213 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:07:01.211+0000 7f107fb05640 1 -- 172.21.15.136:0/1548835771 wait complete. 2024-09-12T02:07:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:01.815 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:01.815 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:01.815 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:01.844 DEBUG:teuthology.orchestra.run.smithi136:osd.2> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T02:07:01.846 INFO:tasks.cephadm:Deploying osd.3 on smithi110 with /dev/vg_nvme/lv_3... 2024-09-12T02:07:01.846 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:07:01.901 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:01.901 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:01.901 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:02.214 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:02.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:02 smithi110 ceph-mon[30548]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:07:02.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:02 smithi115 ceph-mon[35351]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:07:02.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:02 smithi136 ceph-mon[35814]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:07:03.273 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:07:03 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2[40802]: 2024-09-12T02:07:03.168+0000 7f4fa5d83640 -1 osd.2 0 log_to_monitors true 2024-09-12T02:07:03.599 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:03 smithi110 ceph-mon[30548]: from='osd.2 [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:07:03.599 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:03 smithi110 ceph-mon[30548]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:07:03.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:03 smithi136 ceph-mon[35814]: from='osd.2 [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:07:03.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:03 smithi136 ceph-mon[35814]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:07:03.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:03 smithi115 ceph-mon[35351]: from='osd.2 [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:07:03.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:03 smithi115 ceph-mon[35351]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T02:07:04.596 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:07:04 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2[40802]: 2024-09-12T02:07:04.479+0000 7f4fa1d06640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T02:07:04.597 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:07:04 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2[40802]: 2024-09-12T02:07:04.483+0000 7f4f9db2e640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:07:04.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:04 smithi136 ceph-mon[35814]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:07:04.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:04 smithi136 ceph-mon[35814]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:07:04.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:04 smithi136 ceph-mon[35814]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:07:04.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:04 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:07:04.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:04 smithi136 ceph-mon[35814]: from='osd.2 [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:07:04.598 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:04 smithi136 ceph-mon[35814]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:07:04.752 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:04 smithi110 ceph-mon[30548]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:07:04.753 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:04 smithi110 ceph-mon[30548]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:07:04.753 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:04 smithi110 ceph-mon[30548]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:07:04.753 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:04 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:07:04.753 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:04 smithi110 ceph-mon[30548]: from='osd.2 [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:07:04.753 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:04 smithi110 ceph-mon[30548]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:07:04.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:04 smithi115 ceph-mon[35351]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:07:04.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:04 smithi115 ceph-mon[35351]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T02:07:04.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:04 smithi115 ceph-mon[35351]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T02:07:04.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:04 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:07:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:04 smithi115 ceph-mon[35351]: from='osd.2 [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:07:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:04 smithi115 ceph-mon[35351]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:07:05.581 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:07:05.612 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_3 2024-09-12T02:07:05.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:05 smithi115 ceph-mon[35351]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-12T02:07:05.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:05 smithi115 ceph-mon[35351]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T02:07:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:05 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:07:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:05 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:07:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:05 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:05 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:05 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:05 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:05 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:05 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:05 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:05.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:05 smithi136 ceph-mon[35814]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-12T02:07:05.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:05 smithi136 ceph-mon[35814]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T02:07:05.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:05 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:07:05.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:05 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:07:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:05 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:05 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:05 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:05 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:05 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:05 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:05 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:05.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:05 smithi110 ceph-mon[30548]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-12T02:07:05.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:05 smithi110 ceph-mon[30548]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T02:07:05.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:07:05.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:07:05.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:05.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:05.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:05.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:05.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:05.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:05.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:05 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:05.971 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:07:06.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.459+0000 7f3730400640 1 -- 172.21.15.110:0/1797704024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3728077df0 msgr2=0x7f3728078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.459+0000 7f3730400640 1 --2- 172.21.15.110:0/1797704024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3728077df0 0x7f3728078250 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3714009900 tx=0x7f371402a410 comp rx=0 tx=0).stop 2024-09-12T02:07:06.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.459+0000 7f3730400640 1 -- 172.21.15.110:0/1797704024 shutdown_connections 2024-09-12T02:07:06.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.459+0000 7f3730400640 1 --2- 172.21.15.110:0/1797704024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3728078790 0x7f3728079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.459+0000 7f3730400640 1 --2- 172.21.15.110:0/1797704024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3728077df0 0x7f3728078250 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.459+0000 7f3730400640 1 --2- 172.21.15.110:0/1797704024 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3728076ba0 0x7f3728076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.459+0000 7f3730400640 1 -- 172.21.15.110:0/1797704024 >> 172.21.15.110:0/1797704024 conn(0x7f37280ff5b0 msgr2=0x7f37281019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:06.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.459+0000 7f3730400640 1 -- 172.21.15.110:0/1797704024 shutdown_connections 2024-09-12T02:07:06.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.459+0000 7f3730400640 1 -- 172.21.15.110:0/1797704024 wait complete. 2024-09-12T02:07:06.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.460+0000 7f3730400640 1 Processor -- start 2024-09-12T02:07:06.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.461+0000 7f3730400640 1 -- start start 2024-09-12T02:07:06.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.461+0000 7f3730400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3728076ba0 0x7f372819e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.461+0000 7f3730400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3728077df0 0x7f372819ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.461+0000 7f3730400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3728078790 0x7f37281a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.461+0000 7f3730400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3728113f10 con 0x7f3728077df0 2024-09-12T02:07:06.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.461+0000 7f3730400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3728113d90 con 0x7f3728076ba0 2024-09-12T02:07:06.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.461+0000 7f3730400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3728114090 con 0x7f3728078790 2024-09-12T02:07:06.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.461+0000 7f372e400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3728078790 0x7f37281a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.461+0000 7f372d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3728077df0 0x7f372819ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.461+0000 7f372e400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3728078790 0x7f37281a5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:48928/0 (socket says 172.21.15.110:48928) 2024-09-12T02:07:06.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.461+0000 7f372e400640 1 -- 172.21.15.110:0/1524229195 learned_addr learned my addr 172.21.15.110:0/1524229195 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:07:06.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.461+0000 7f372da00640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3728076ba0 0x7f372819e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.462+0000 7f372e400640 1 -- 172.21.15.110:0/1524229195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3728076ba0 msgr2=0x7f372819e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.462+0000 7f372e400640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3728076ba0 0x7f372819e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.462+0000 7f372e400640 1 -- 172.21.15.110:0/1524229195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3728077df0 msgr2=0x7f372819ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:06.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.462+0000 7f372e400640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3728077df0 0x7f372819ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:06.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.462+0000 7f372e400640 1 -- 172.21.15.110:0/1524229195 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37281a6100 con 0x7f3728078790 2024-09-12T02:07:06.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.462+0000 7f372e400640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3728078790 0x7f37281a5a90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f372000eb10 tx=0x7f372000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.462+0000 7f3726000640 1 -- 172.21.15.110:0/1524229195 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720004b20 con 0x7f3728078790 2024-09-12T02:07:06.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.462+0000 7f3726000640 1 -- 172.21.15.110:0/1524229195 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3720004cc0 con 0x7f3728078790 2024-09-12T02:07:06.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.462+0000 7f3730400640 1 -- 172.21.15.110:0/1524229195 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37281a63f0 con 0x7f3728078790 2024-09-12T02:07:06.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.462+0000 7f3726000640 1 -- 172.21.15.110:0/1524229195 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720010760 con 0x7f3728078790 2024-09-12T02:07:06.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.462+0000 7f3730400640 1 -- 172.21.15.110:0/1524229195 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37281a6950 con 0x7f3728078790 2024-09-12T02:07:06.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.464+0000 7f3730400640 1 -- 172.21.15.110:0/1524229195 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3728110780 con 0x7f3728078790 2024-09-12T02:07:06.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.465+0000 7f3726000640 1 -- 172.21.15.110:0/1524229195 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f3720005020 con 0x7f3728078790 2024-09-12T02:07:06.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.467+0000 7f3726000640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f37100a2ba0 0x7f37100a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:06.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.467+0000 7f3726000640 1 -- 172.21.15.110:0/1524229195 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f37200cdf20 con 0x7f3728078790 2024-09-12T02:07:06.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.467+0000 7f372da00640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f37100a2ba0 0x7f37100a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:06.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.467+0000 7f372da00640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f37100a2ba0 0x7f37100a5060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f371c005d00 tx=0x7f371c005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:06.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.471+0000 7f3726000640 1 -- 172.21.15.110:0/1524229195 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f372009c410 con 0x7f3728078790 2024-09-12T02:07:06.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:06.657+0000 7f3730400640 1 -- 172.21.15.110:0/1524229195 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3728062630 con 0x7f37100a2ba0 2024-09-12T02:07:06.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:06 smithi115 ceph-mon[35351]: purged_snaps scrub starts 2024-09-12T02:07:06.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:06 smithi115 ceph-mon[35351]: purged_snaps scrub ok 2024-09-12T02:07:06.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:06 smithi115 ceph-mon[35351]: Detected new or changed devices on smithi136 2024-09-12T02:07:06.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:06 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi136 to 17088M 2024-09-12T02:07:06.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:06 smithi115 ceph-mon[35351]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:07:06.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:06 smithi115 ceph-mon[35351]: osd.2 [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192] boot 2024-09-12T02:07:06.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:06 smithi115 ceph-mon[35351]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:07:06.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:06 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:07:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:06 smithi136 ceph-mon[35814]: purged_snaps scrub starts 2024-09-12T02:07:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:06 smithi136 ceph-mon[35814]: purged_snaps scrub ok 2024-09-12T02:07:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:06 smithi136 ceph-mon[35814]: Detected new or changed devices on smithi136 2024-09-12T02:07:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:06 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi136 to 17088M 2024-09-12T02:07:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:06 smithi136 ceph-mon[35814]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:07:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:06 smithi136 ceph-mon[35814]: osd.2 [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192] boot 2024-09-12T02:07:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:06 smithi136 ceph-mon[35814]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:07:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:06 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:07:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:06 smithi110 ceph-mon[30548]: purged_snaps scrub starts 2024-09-12T02:07:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:06 smithi110 ceph-mon[30548]: purged_snaps scrub ok 2024-09-12T02:07:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:06 smithi110 ceph-mon[30548]: Detected new or changed devices on smithi136 2024-09-12T02:07:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:06 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi136 to 17088M 2024-09-12T02:07:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:06 smithi110 ceph-mon[30548]: pgmap v77: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-12T02:07:06.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:06 smithi110 ceph-mon[30548]: osd.2 [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192] boot 2024-09-12T02:07:06.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:06 smithi110 ceph-mon[30548]: osdmap e18: 3 total, 3 up, 3 in 2024-09-12T02:07:06.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:06 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:07:08.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:07 smithi136 ceph-mon[35814]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:07:08.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:07 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:07:08.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:07 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:07:08.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:07 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:08.223 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:07 smithi110 ceph-mon[30548]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:07:08.223 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:07 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:07:08.223 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:07 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:07:08.223 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:07 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:08.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:07 smithi115 ceph-mon[35351]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T02:07:08.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:07 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:07:08.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:07 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:07:08.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:07 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:09.122 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:08 smithi110 ceph-mon[30548]: from='client.24190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:07:09.123 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:08 smithi110 ceph-mon[30548]: pgmap v80: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:09.123 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:07:09.123 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:07:09.123 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:08 smithi110 ceph-mon[30548]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T02:07:09.123 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:07:09.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:08 smithi115 ceph-mon[35351]: from='client.24190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:07:09.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:08 smithi115 ceph-mon[35351]: pgmap v80: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:09.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:08 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:07:09.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:08 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:07:09.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:08 smithi115 ceph-mon[35351]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T02:07:09.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:08 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:07:09.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:08 smithi136 ceph-mon[35814]: from='client.24190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:07:09.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:08 smithi136 ceph-mon[35814]: pgmap v80: 0 pgs: ; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:09.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:08 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:07:09.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:08 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-12T02:07:09.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:08 smithi136 ceph-mon[35814]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T02:07:09.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:08 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:07:09.936 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:07:09 smithi110 sudo[49236]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:07:09.936 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:07:09 smithi110 sudo[49236]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:07:09.936 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:07:09 smithi110 sudo[49236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:07:09.937 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:07:09 smithi110 sudo[49236]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:07:10.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:10.013+0000 7f3726000640 1 -- 172.21.15.110:0/1524229195 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3720098380 con 0x7f3728078790 2024-09-12T02:07:10.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:07:10.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:10 smithi115 ceph-mon[35351]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T02:07:10.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:10 smithi115 ceph-mon[35351]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:10.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:10 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1387602636' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f22237a9-ac1e-47a9-8092-d54dbf752521"}]: dispatch 2024-09-12T02:07:10.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:10 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1387602636' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f22237a9-ac1e-47a9-8092-d54dbf752521"}]': finished 2024-09-12T02:07:10.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:10 smithi115 ceph-mon[35351]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:07:10.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:10.304 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:07:10 smithi110 sudo[49267]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:07:10.304 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:07:10 smithi110 sudo[49267]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:07:10.304 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:07:10 smithi110 sudo[49267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:07:10.304 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:07:10 smithi110 sudo[49267]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:07:10.304 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:07:10.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:10 smithi110 ceph-mon[30548]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T02:07:10.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:10 smithi110 ceph-mon[30548]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:10.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:10 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1387602636' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f22237a9-ac1e-47a9-8092-d54dbf752521"}]: dispatch 2024-09-12T02:07:10.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:10 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1387602636' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f22237a9-ac1e-47a9-8092-d54dbf752521"}]': finished 2024-09-12T02:07:10.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:10 smithi110 ceph-mon[30548]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:07:10.305 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:10.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:07:10.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:10 smithi136 ceph-mon[35814]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T02:07:10.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:10 smithi136 ceph-mon[35814]: pgmap v83: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:10.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:10 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1387602636' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f22237a9-ac1e-47a9-8092-d54dbf752521"}]: dispatch 2024-09-12T02:07:10.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:10 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1387602636' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f22237a9-ac1e-47a9-8092-d54dbf752521"}]': finished 2024-09-12T02:07:10.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:10 smithi136 ceph-mon[35814]: osdmap e22: 4 total, 3 up, 4 in 2024-09-12T02:07:10.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:10.741 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:07:10 smithi115 sudo[43678]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:07:10.741 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:07:10 smithi115 sudo[43678]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:07:10.741 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:07:10 smithi115 sudo[43678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:07:10.741 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:07:10 smithi115 sudo[43678]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:07:11.011 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:07:10 smithi115 sudo[43681]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:07:11.011 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:07:10 smithi115 sudo[43681]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:07:11.011 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:07:10 smithi115 sudo[43681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:07:11.011 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:07:10 smithi115 sudo[43681]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:07:11.270 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:11 smithi136 ceph-mon[35814]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:07:11.270 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:11.271 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:11 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/883561485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:07:11.271 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:11.271 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:07:11 smithi136 sudo[44420]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:07:11.271 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:07:11 smithi136 sudo[44420]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:07:11.271 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:07:11 smithi136 sudo[44420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:07:11.271 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:07:11 smithi136 sudo[44420]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:07:11.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:11 smithi115 ceph-mon[35351]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:07:11.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:11.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:11 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/883561485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:07:11.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:11.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:11 smithi110 ceph-mon[30548]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-12T02:07:11.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:11.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:11 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/883561485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:07:11.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:11.658 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:07:11 smithi136 sudo[44423]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:07:11.658 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:07:11 smithi136 sudo[44423]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:07:11.659 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:07:11 smithi136 sudo[44423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:07:11.659 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:07:11 smithi136 sudo[44423]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:07:12.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:11 smithi110 sudo[49527]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:07:12.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:11 smithi110 sudo[49527]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:07:12.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:11 smithi110 sudo[49527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:07:12.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:11 smithi110 sudo[49527]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:07:12.651 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:12 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:12.651 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:12 smithi136 ceph-mon[35814]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:07:12.651 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:12 smithi136 sudo[44426]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:07:12.652 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:12 smithi136 sudo[44426]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:07:12.652 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:12 smithi136 sudo[44426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:07:12.652 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:12 smithi136 sudo[44426]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:07:12.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:12 smithi110 sudo[49717]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:07:12.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:12 smithi110 sudo[49717]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:07:12.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:12 smithi110 sudo[49717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:07:12.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:12 smithi110 sudo[49717]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:07:12.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:12.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:12 smithi110 ceph-mon[30548]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:07:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:12 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:12 smithi115 ceph-mon[35351]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:07:12.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:12 smithi136 sudo[44429]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:07:12.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:12 smithi136 sudo[44429]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:07:12.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:12 smithi136 sudo[44429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:07:12.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:12 smithi136 sudo[44429]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:07:13.395 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 sudo[43684]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T02:07:13.395 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 sudo[43684]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:07:13.395 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 sudo[43684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:07:13.396 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 sudo[43684]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:07:13.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:07:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:07:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:07:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:07:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:07:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:07:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:07:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:07:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:07:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:07:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:07:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:13 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:07:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:07:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:07:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:07:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:07:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:07:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:07:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:07:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:07:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:07:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:07:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:07:13.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:13 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:07:13.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 sudo[43687]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T02:07:13.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 sudo[43687]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T02:07:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 sudo[43687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T02:07:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 sudo[43687]: pam_unix(sudo:session): session closed for user root 2024-09-12T02:07:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:07:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:07:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:07:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:07:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:07:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:07:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:07:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:07:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:07:13.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:07:13.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:07:13.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:13 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:07:14.586 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:14 smithi110 ceph-mon[30548]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:07:14.586 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:14 smithi110 ceph-mon[30548]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:14.587 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:14 smithi110 ceph-mon[30548]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:07:14.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:14 smithi136 ceph-mon[35814]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:07:14.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:14 smithi136 ceph-mon[35814]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:14.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:14 smithi136 ceph-mon[35814]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:07:14.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:14 smithi115 ceph-mon[35351]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T02:07:14.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:14 smithi115 ceph-mon[35351]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:14.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:14 smithi115 ceph-mon[35351]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T02:07:16.664 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:16 smithi110 ceph-mon[30548]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:16.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:16 smithi115 ceph-mon[35351]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:16.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:16 smithi136 ceph-mon[35814]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:18.577 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:18 smithi110 ceph-mon[30548]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-12T02:07:18.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:18 smithi115 ceph-mon[35351]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-12T02:07:18.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:18 smithi136 ceph-mon[35814]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-12T02:07:19.513 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:19 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:07:19.513 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:19 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:19.513 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:19 smithi110 ceph-mon[30548]: Deploying daemon osd.3 on smithi110 2024-09-12T02:07:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:19 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:07:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:19 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:19.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:19 smithi115 ceph-mon[35351]: Deploying daemon osd.3 on smithi110 2024-09-12T02:07:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:19 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T02:07:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:19 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:19.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:19 smithi136 ceph-mon[35814]: Deploying daemon osd.3 on smithi110 2024-09-12T02:07:20.680 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:20 smithi110 ceph-mon[30548]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-12T02:07:20.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:20 smithi115 ceph-mon[35351]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-12T02:07:20.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:20 smithi136 ceph-mon[35814]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-12T02:07:22.667 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:22 smithi110 ceph-mon[30548]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-12T02:07:22.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:22 smithi115 ceph-mon[35351]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-12T02:07:22.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:22 smithi136 ceph-mon[35814]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-12T02:07:24.675 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:24 smithi110 ceph-mon[30548]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T02:07:24.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:24 smithi115 ceph-mon[35351]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T02:07:24.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:24 smithi136 ceph-mon[35814]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-12T02:07:26.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:26 smithi110 ceph-mon[30548]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T02:07:26.711 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:26 smithi136 ceph-mon[35814]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T02:07:26.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:26 smithi115 ceph-mon[35351]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T02:07:27.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:27 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:27.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:27 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:27.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:27 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:27.730 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:27 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:27.730 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:27 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:27.730 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:27 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:27 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:27 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:27 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:28.848 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:28 smithi110 ceph-mon[30548]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T02:07:28.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:28 smithi136 ceph-mon[35814]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T02:07:29.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:28 smithi115 ceph-mon[35351]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-12T02:07:30.899 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:30 smithi110 ceph-mon[30548]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:30.899 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:30 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:30.899 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:30 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:30.899 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:30 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:30.899 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:30 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:30.899 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:30 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:30 smithi136 ceph-mon[35814]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:30 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:30 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:30 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:30 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:30 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:30.915 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:30 smithi115 ceph-mon[35351]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:30.915 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:30 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:30.915 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:30 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:30.915 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:30 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:30.915 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:30 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:30.915 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:30 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:31.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.266+0000 7f3726000640 1 -- 172.21.15.110:0/1524229195 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3728062630 con 0x7f37100a2ba0 2024-09-12T02:07:31.267 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 3 on host 'smithi110' 2024-09-12T02:07:31.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.269+0000 7f3730400640 1 -- 172.21.15.110:0/1524229195 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f37100a2ba0 msgr2=0x7f37100a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:31.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.269+0000 7f3730400640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f37100a2ba0 0x7f37100a5060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f371c005d00 tx=0x7f371c005c50 comp rx=0 tx=0).stop 2024-09-12T02:07:31.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.269+0000 7f3730400640 1 -- 172.21.15.110:0/1524229195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3728078790 msgr2=0x7f37281a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:31.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.269+0000 7f3730400640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3728078790 0x7f37281a5a90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f372000eb10 tx=0x7f372000c2d0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.269+0000 7f3730400640 1 -- 172.21.15.110:0/1524229195 shutdown_connections 2024-09-12T02:07:31.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.269+0000 7f3730400640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f37100a2ba0 0x7f37100a5060 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.269+0000 7f3730400640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3728078790 0x7f37281a5a90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.269+0000 7f3730400640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3728077df0 0x7f372819ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.269+0000 7f3730400640 1 --2- 172.21.15.110:0/1524229195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3728076ba0 0x7f372819e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:31.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.269+0000 7f3730400640 1 -- 172.21.15.110:0/1524229195 >> 172.21.15.110:0/1524229195 conn(0x7f37280ff5b0 msgr2=0x7f3728101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:31.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.269+0000 7f3730400640 1 -- 172.21.15.110:0/1524229195 shutdown_connections 2024-09-12T02:07:31.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:07:31.269+0000 7f3730400640 1 -- 172.21.15.110:0/1524229195 wait complete. 2024-09-12T02:07:31.828 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:31 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:31.828 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:31 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:31.828 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:31 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:31.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:31 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:31.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:31 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:31.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:31 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:32.014 DEBUG:teuthology.orchestra.run.smithi110:osd.3> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T02:07:32.019 INFO:tasks.cephadm:Deploying osd.4 on smithi115 with /dev/vg_nvme/lv_3... 2024-09-12T02:07:32.019 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:07:32.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:31 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:32.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:31 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:32.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:31 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:32.292 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:07:32.664 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:32 smithi115 ceph-mon[35351]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:32.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:32 smithi136 ceph-mon[35814]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:32.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:32 smithi110 ceph-mon[30548]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:32.936 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:07:32 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3[51310]: 2024-09-12T02:07:32.672+0000 7f50dd21b640 -1 osd.3 0 log_to_monitors true 2024-09-12T02:07:33.727 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:33 smithi110 ceph-mon[30548]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:07:33.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:33 smithi115 ceph-mon[35351]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:07:33.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:33 smithi136 ceph-mon[35814]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T02:07:34.613 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:07:34.638 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_3 2024-09-12T02:07:34.701 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:34 smithi115 ceph-mon[35351]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:34.702 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:34 smithi115 ceph-mon[35351]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:07:34.702 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:34 smithi115 ceph-mon[35351]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:07:34.702 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:34 smithi115 ceph-mon[35351]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:07:34.702 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:34 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:34.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:34 smithi136 ceph-mon[35814]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:34.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:34 smithi136 ceph-mon[35814]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:07:34.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:34 smithi136 ceph-mon[35814]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:07:34.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:34 smithi136 ceph-mon[35814]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:07:34.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:34 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:34.918 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:07:34.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:34 smithi110 ceph-mon[30548]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:34.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:34 smithi110 ceph-mon[30548]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T02:07:34.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:34 smithi110 ceph-mon[30548]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T02:07:34.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:34 smithi110 ceph-mon[30548]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:07:34.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:34 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:35.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.356+0000 7fc669ce9640 1 -- 172.21.15.115:0/1280117336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6641037c0 msgr2=0x7fc66410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.356+0000 7fc669ce9640 1 --2- 172.21.15.115:0/1280117336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6641037c0 0x7fc66410a050 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009ca0 tx=0x7fc65c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.356+0000 7fc669ce9640 1 -- 172.21.15.115:0/1280117336 shutdown_connections 2024-09-12T02:07:35.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.356+0000 7fc669ce9640 1 --2- 172.21.15.115:0/1280117336 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6641037c0 0x7fc66410a050 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.356+0000 7fc669ce9640 1 --2- 172.21.15.115:0/1280117336 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc664102e00 0x7fc664103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.356+0000 7fc669ce9640 1 --2- 172.21.15.115:0/1280117336 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc664101c00 0x7fc664102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.356+0000 7fc669ce9640 1 -- 172.21.15.115:0/1280117336 >> 172.21.15.115:0/1280117336 conn(0x7fc6640fd390 msgr2=0x7fc6640ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:35.391 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.356+0000 7fc669ce9640 1 -- 172.21.15.115:0/1280117336 shutdown_connections 2024-09-12T02:07:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.356+0000 7fc669ce9640 1 -- 172.21.15.115:0/1280117336 wait complete. 2024-09-12T02:07:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc669ce9640 1 Processor -- start 2024-09-12T02:07:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc669ce9640 1 -- start start 2024-09-12T02:07:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc669ce9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc664101c00 0x7fc664197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc669ce9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc664102e00 0x7fc6641983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc669ce9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6641037c0 0x7fc66419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc669ce9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc66410d880 con 0x7fc6641037c0 2024-09-12T02:07:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc669ce9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc66410d700 con 0x7fc664101c00 2024-09-12T02:07:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc669ce9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc66410da00 con 0x7fc664102e00 2024-09-12T02:07:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc6637fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc664101c00 0x7fc664197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc6637fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc664101c00 0x7fc664197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:54568/0 (socket says 172.21.15.115:54568) 2024-09-12T02:07:35.392 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc6637fe640 1 -- 172.21.15.115:0/3397524596 learned_addr learned my addr 172.21.15.115:0/3397524596 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc65bfff640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc664102e00 0x7fc6641983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc663fff640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6641037c0 0x7fc66419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc6637fe640 1 -- 172.21.15.115:0/3397524596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc664102e00 msgr2=0x7fc6641983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc6637fe640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc664102e00 0x7fc6641983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc6637fe640 1 -- 172.21.15.115:0/3397524596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6641037c0 msgr2=0x7fc66419f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc6637fe640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6641037c0 0x7fc66419f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc6637fe640 1 -- 172.21.15.115:0/3397524596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66419fae0 con 0x7fc664101c00 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc65bfff640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc664102e00 0x7fc6641983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.357+0000 7fc6637fe640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc664101c00 0x7fc664197eb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc65400d950 tx=0x7fc65400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.358+0000 7fc6617fa640 1 -- 172.21.15.115:0/3397524596 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654017070 con 0x7fc664101c00 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.358+0000 7fc6617fa640 1 -- 172.21.15.115:0/3397524596 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc654009c30 con 0x7fc664101c00 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.358+0000 7fc669ce9640 1 -- 172.21.15.115:0/3397524596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66419fdd0 con 0x7fc664101c00 2024-09-12T02:07:35.393 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.358+0000 7fc6617fa640 1 -- 172.21.15.115:0/3397524596 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65400f600 con 0x7fc664101c00 2024-09-12T02:07:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.358+0000 7fc669ce9640 1 -- 172.21.15.115:0/3397524596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6641a01d0 con 0x7fc664101c00 2024-09-12T02:07:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.359+0000 7fc669ce9640 1 -- 172.21.15.115:0/3397524596 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc664109000 con 0x7fc664101c00 2024-09-12T02:07:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.360+0000 7fc6617fa640 1 -- 172.21.15.115:0/3397524596 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fc65401a070 con 0x7fc664101c00 2024-09-12T02:07:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.360+0000 7fc6617fa640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc6500a2bb0 0x7fc6500a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:07:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.361+0000 7fc6617fa640 1 -- 172.21.15.115:0/3397524596 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3422+0+0 (secure 0 0 0) 0x7fc6540cd750 con 0x7fc664101c00 2024-09-12T02:07:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.361+0000 7fc65bfff640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc6500a2bb0 0x7fc6500a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:07:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.361+0000 7fc65bfff640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc6500a2bb0 0x7fc6500a5070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0058c0 tx=0x7fc64c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:07:35.394 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.364+0000 7fc6617fa640 1 -- 172.21.15.115:0/3397524596 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc65409b9d0 con 0x7fc664101c00 2024-09-12T02:07:35.512 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:07:35 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3[51310]: 2024-09-12T02:07:35.251+0000 7f50d8800640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T02:07:35.512 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:07:35 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3[51310]: 2024-09-12T02:07:35.269+0000 7f50cde00640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:07:35.541 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:35.541+0000 7fc669ce9640 1 -- 172.21.15.115:0/3397524596 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc664062630 con 0x7fc6500a2bb0 2024-09-12T02:07:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:35 smithi115 ceph-mon[35351]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-12T02:07:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:35 smithi115 ceph-mon[35351]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T02:07:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:35 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:35.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:35 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:35.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:35 smithi115 ceph-mon[35351]: osdmap e25: 4 total, 3 up, 4 in 2024-09-12T02:07:35.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:35 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:35.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:35 smithi115 ceph-mon[35351]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' 2024-09-12T02:07:35.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:35 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:07:35.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:35 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:07:35.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:35 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:35.853 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:35 smithi110 ceph-mon[30548]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-12T02:07:35.853 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:35 smithi110 ceph-mon[30548]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T02:07:35.853 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:35.853 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:35.854 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:35 smithi110 ceph-mon[30548]: osdmap e25: 4 total, 3 up, 4 in 2024-09-12T02:07:35.854 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:35.854 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:35 smithi110 ceph-mon[30548]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' 2024-09-12T02:07:35.854 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:07:35.854 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:07:35.854 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:35.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:35 smithi136 ceph-mon[35814]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-12T02:07:35.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:35 smithi136 ceph-mon[35814]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T02:07:35.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:35.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:35 smithi136 ceph-mon[35814]: osdmap e25: 4 total, 3 up, 4 in 2024-09-12T02:07:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:35 smithi136 ceph-mon[35814]: from='osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925]' entity='osd.3' 2024-09-12T02:07:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:07:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:07:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:36.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: purged_snaps scrub starts 2024-09-12T02:07:36.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: purged_snaps scrub ok 2024-09-12T02:07:36.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:36.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:07:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925] boot 2024-09-12T02:07:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:07:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:36 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:36.930 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: purged_snaps scrub starts 2024-09-12T02:07:36.931 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: purged_snaps scrub ok 2024-09-12T02:07:36.931 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:36.931 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:07:36.931 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:36.931 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:36.931 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:36.931 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:36.932 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:36.932 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:36.932 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:36.932 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:36.932 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:36.932 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925] boot 2024-09-12T02:07:36.932 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:07:36.932 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:36 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:36.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: purged_snaps scrub starts 2024-09-12T02:07:36.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: purged_snaps scrub ok 2024-09-12T02:07:36.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-12T02:07:36.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:07:36.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: osd.3 [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925] boot 2024-09-12T02:07:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T02:07:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:36 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:07:37.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:37 smithi136 ceph-mon[35814]: Detected new or changed devices on smithi110 2024-09-12T02:07:37.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:37 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi110 to 8544M 2024-09-12T02:07:37.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:37 smithi136 ceph-mon[35814]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T02:07:37.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:37 smithi110 ceph-mon[30548]: Detected new or changed devices on smithi110 2024-09-12T02:07:37.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:37 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi110 to 8544M 2024-09-12T02:07:37.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:37 smithi110 ceph-mon[30548]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T02:07:38.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:37 smithi115 ceph-mon[35351]: Detected new or changed devices on smithi110 2024-09-12T02:07:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:37 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi110 to 8544M 2024-09-12T02:07:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:37 smithi115 ceph-mon[35351]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T02:07:38.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:38 smithi115 ceph-mon[35351]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:38.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:38 smithi115 ceph-mon[35351]: from='client.? 172.21.15.115:0/2010372220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e70c0a05-336f-4ace-8f41-682059272b1a"}]: dispatch 2024-09-12T02:07:38.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:38 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e70c0a05-336f-4ace-8f41-682059272b1a"}]: dispatch 2024-09-12T02:07:38.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:38 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e70c0a05-336f-4ace-8f41-682059272b1a"}]': finished 2024-09-12T02:07:38.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:38 smithi115 ceph-mon[35351]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T02:07:38.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:38 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:07:38.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:38 smithi115 ceph-mon[35351]: from='client.? 172.21.15.115:0/2367696296' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:07:38.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:38 smithi136 ceph-mon[35814]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:38.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:38 smithi136 ceph-mon[35814]: from='client.? 172.21.15.115:0/2010372220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e70c0a05-336f-4ace-8f41-682059272b1a"}]: dispatch 2024-09-12T02:07:38.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:38 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e70c0a05-336f-4ace-8f41-682059272b1a"}]: dispatch 2024-09-12T02:07:38.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:38 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e70c0a05-336f-4ace-8f41-682059272b1a"}]': finished 2024-09-12T02:07:38.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:38 smithi136 ceph-mon[35814]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T02:07:38.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:38 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:07:38.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:38 smithi136 ceph-mon[35814]: from='client.? 172.21.15.115:0/2367696296' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:07:38.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:38 smithi110 ceph-mon[30548]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:38.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:38 smithi110 ceph-mon[30548]: from='client.? 172.21.15.115:0/2010372220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e70c0a05-336f-4ace-8f41-682059272b1a"}]: dispatch 2024-09-12T02:07:38.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:38 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e70c0a05-336f-4ace-8f41-682059272b1a"}]: dispatch 2024-09-12T02:07:38.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:38 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e70c0a05-336f-4ace-8f41-682059272b1a"}]': finished 2024-09-12T02:07:38.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:38 smithi110 ceph-mon[30548]: osdmap e28: 5 total, 4 up, 5 in 2024-09-12T02:07:38.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:38 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:07:38.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:38 smithi110 ceph-mon[30548]: from='client.? 172.21.15.115:0/2367696296' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:07:40.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:39 smithi136 ceph-mon[35814]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T02:07:40.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:39 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:07:40.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:39 smithi136 ceph-mon[35814]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:40.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:39 smithi110 ceph-mon[30548]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T02:07:40.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:39 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:07:40.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:39 smithi110 ceph-mon[30548]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:40.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:39 smithi115 ceph-mon[35351]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T02:07:40.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:39 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:07:40.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:39 smithi115 ceph-mon[35351]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:41.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:40 smithi136 ceph-mon[35814]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:07:41.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:07:41.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:40 smithi110 ceph-mon[30548]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:07:41.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:07:41.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:40 smithi115 ceph-mon[35351]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T02:07:41.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:07:42.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:41 smithi110 ceph-mon[30548]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:42.201 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:41 smithi115 ceph-mon[35351]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:42.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:41 smithi136 ceph-mon[35814]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:44.645 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:44 smithi115 ceph-mon[35351]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:07:44.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:44 smithi136 ceph-mon[35814]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:07:44.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:44 smithi110 ceph-mon[30548]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:07:46.604 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:46 smithi115 ceph-mon[35351]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-12T02:07:46.605 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:07:46.605 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:46.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:46 smithi136 ceph-mon[35814]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-12T02:07:46.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:07:46.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:46 smithi110 ceph-mon[30548]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-12T02:07:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T02:07:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:47.619 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:47 smithi115 ceph-mon[35351]: Deploying daemon osd.4 on smithi115 2024-09-12T02:07:47.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:47 smithi110 ceph-mon[30548]: Deploying daemon osd.4 on smithi115 2024-09-12T02:07:47.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:47 smithi136 ceph-mon[35814]: Deploying daemon osd.4 on smithi115 2024-09-12T02:07:48.615 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:48 smithi115 ceph-mon[35351]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-12T02:07:48.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:48 smithi136 ceph-mon[35814]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-12T02:07:48.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:48 smithi110 ceph-mon[30548]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-12T02:07:50.741 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:50 smithi115 ceph-mon[35351]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:07:50.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:50 smithi136 ceph-mon[35814]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:07:50.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:50 smithi110 ceph-mon[30548]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:07:52.788 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:52 smithi115 ceph-mon[35351]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T02:07:52.788 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:52.788 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:52.788 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:52 smithi136 ceph-mon[35814]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T02:07:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:52.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:52 smithi110 ceph-mon[30548]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-12T02:07:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:54.718 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:54 smithi115 ceph-mon[35351]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:07:54.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:54 smithi136 ceph-mon[35814]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:07:54.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:54 smithi110 ceph-mon[30548]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:07:55.816 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.816+0000 7fc6617fa640 1 -- 172.21.15.115:0/3397524596 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc664062630 con 0x7fc6500a2bb0 2024-09-12T02:07:55.816 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 4 on host 'smithi115' 2024-09-12T02:07:55.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.818+0000 7fc669ce9640 1 -- 172.21.15.115:0/3397524596 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc6500a2bb0 msgr2=0x7fc6500a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:55.818 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.818+0000 7fc669ce9640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc6500a2bb0 0x7fc6500a5070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0058c0 tx=0x7fc64c005850 comp rx=0 tx=0).stop 2024-09-12T02:07:55.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.818+0000 7fc669ce9640 1 -- 172.21.15.115:0/3397524596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc664101c00 msgr2=0x7fc664197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:07:55.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.818+0000 7fc669ce9640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc664101c00 0x7fc664197eb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc65400d950 tx=0x7fc65400de10 comp rx=0 tx=0).stop 2024-09-12T02:07:55.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.818+0000 7fc669ce9640 1 -- 172.21.15.115:0/3397524596 shutdown_connections 2024-09-12T02:07:55.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.818+0000 7fc669ce9640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc6500a2bb0 0x7fc6500a5070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.818+0000 7fc669ce9640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6641037c0 0x7fc66419f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.818+0000 7fc669ce9640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc664102e00 0x7fc6641983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.818+0000 7fc669ce9640 1 --2- 172.21.15.115:0/3397524596 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc664101c00 0x7fc664197eb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:07:55.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.818+0000 7fc669ce9640 1 -- 172.21.15.115:0/3397524596 >> 172.21.15.115:0/3397524596 conn(0x7fc6640fd390 msgr2=0x7fc6641061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:07:55.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.818+0000 7fc669ce9640 1 -- 172.21.15.115:0/3397524596 shutdown_connections 2024-09-12T02:07:55.819 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:07:55.818+0000 7fc669ce9640 1 -- 172.21.15.115:0/3397524596 wait complete. 2024-09-12T02:07:56.523 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.523 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.523 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:56.523 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:56.523 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.523 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:56 smithi115 ceph-mon[35351]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:56.524 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:56.524 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.524 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:56.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:56.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:56 smithi136 ceph-mon[35814]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:56.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:56.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:56.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:56.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:56 smithi110 ceph-mon[30548]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:56.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:07:56.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:56.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:57.784 DEBUG:teuthology.orchestra.run.smithi115:osd.4> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T02:07:57.826 INFO:tasks.cephadm:Deploying osd.5 on smithi136 with /dev/vg_nvme/lv_3... 2024-09-12T02:07:57.827 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T02:07:58.079 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:07:58.270 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:07:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4[46435]: 2024-09-12T02:07:58.149+0000 7fbb3544b640 -1 osd.4 0 log_to_monitors true 2024-09-12T02:07:58.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:58 smithi115 ceph-mon[35351]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:58.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:58 smithi115 ceph-mon[35351]: from='osd.4 [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:07:58.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:58 smithi115 ceph-mon[35351]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:07:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:58 smithi136 ceph-mon[35814]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:58 smithi136 ceph-mon[35814]: from='osd.4 [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:07:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:58 smithi136 ceph-mon[35814]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:07:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:58 smithi110 ceph-mon[30548]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:07:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:58 smithi110 ceph-mon[30548]: from='osd.4 [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:07:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:58 smithi110 ceph-mon[30548]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T02:07:59.676 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:07:59.676 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='osd.4 [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:07:59.676 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T02:07:59.676 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:07:59.676 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:07:59.676 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:59.676 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:59.676 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:59.677 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:59.677 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:59.677 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:59.677 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:59.677 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:59.677 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:07:59 smithi136 ceph-mon[35814]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-12T02:07:59.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:07:59.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='osd.4 [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:07:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T02:07:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:07:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:07:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:07:59 smithi115 ceph-mon[35351]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-12T02:07:59.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T02:07:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='osd.4 [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:07:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T02:07:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:07:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:07:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:07:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:07:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:07:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:07:59.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:07:59 smithi110 ceph-mon[30548]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-12T02:08:00.455 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:08:00 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4[46435]: 2024-09-12T02:08:00.137+0000 7fbb313ce640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T02:08:00.455 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:08:00 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4[46435]: 2024-09-12T02:08:00.142+0000 7fbb291ee640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:08:00.457 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:08:00.483 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:00 smithi136 ceph-mon[35814]: Detected new or changed devices on smithi115 2024-09-12T02:08:00.483 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:00 smithi136 ceph-mon[35814]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:08:00.483 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:00 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi115 to 8544M 2024-09-12T02:08:00.483 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:00 smithi136 ceph-mon[35814]: osdmap e32: 5 total, 4 up, 5 in 2024-09-12T02:08:00.483 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:00 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:08:00.483 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:00 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:08:00.483 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:00 smithi136 ceph-mon[35814]: from='osd.4 ' entity='osd.4' 2024-09-12T02:08:00.484 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_3 2024-09-12T02:08:00.735 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:08:00.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:00 smithi115 ceph-mon[35351]: Detected new or changed devices on smithi115 2024-09-12T02:08:00.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:00 smithi115 ceph-mon[35351]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:08:00.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:00 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi115 to 8544M 2024-09-12T02:08:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:00 smithi115 ceph-mon[35351]: osdmap e32: 5 total, 4 up, 5 in 2024-09-12T02:08:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:00 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:08:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:00 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:08:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:00 smithi115 ceph-mon[35351]: from='osd.4 ' entity='osd.4' 2024-09-12T02:08:00.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:00 smithi110 ceph-mon[30548]: Detected new or changed devices on smithi115 2024-09-12T02:08:00.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:00 smithi110 ceph-mon[30548]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:08:00.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:00 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi115 to 8544M 2024-09-12T02:08:00.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:00 smithi110 ceph-mon[30548]: osdmap e32: 5 total, 4 up, 5 in 2024-09-12T02:08:00.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:00 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:08:00.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:00 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:08:00.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:00 smithi110 ceph-mon[30548]: from='osd.4 ' entity='osd.4' 2024-09-12T02:08:01.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.194+0000 7fa8001a1640 1 -- 172.21.15.136:0/1264809227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7f8102e00 msgr2=0x7fa7f8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.194+0000 7fa8001a1640 1 --2- 172.21.15.136:0/1264809227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7f8102e00 0x7fa7f8103280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009900 tx=0x7fa7e802a410 comp rx=0 tx=0).stop 2024-09-12T02:08:01.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.194+0000 7fa8001a1640 1 -- 172.21.15.136:0/1264809227 shutdown_connections 2024-09-12T02:08:01.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.194+0000 7fa8001a1640 1 --2- 172.21.15.136:0/1264809227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7f81037c0 0x7fa7f810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.194+0000 7fa8001a1640 1 --2- 172.21.15.136:0/1264809227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7f8102e00 0x7fa7f8103280 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.194+0000 7fa8001a1640 1 --2- 172.21.15.136:0/1264809227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8101c00 0x7fa7f8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.194+0000 7fa8001a1640 1 -- 172.21.15.136:0/1264809227 >> 172.21.15.136:0/1264809227 conn(0x7fa7f80fd390 msgr2=0x7fa7f80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:01.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.194+0000 7fa8001a1640 1 -- 172.21.15.136:0/1264809227 shutdown_connections 2024-09-12T02:08:01.235 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.194+0000 7fa8001a1640 1 -- 172.21.15.136:0/1264809227 wait complete. 2024-09-12T02:08:01.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.194+0000 7fa8001a1640 1 Processor -- start 2024-09-12T02:08:01.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.194+0000 7fa8001a1640 1 -- start start 2024-09-12T02:08:01.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa8001a1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7f8101c00 0x7fa7f8197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa8001a1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8102e00 0x7fa7f81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa8001a1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7f81037c0 0x7fa7f819f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa8001a1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f810d860 con 0x7fa7f8102e00 2024-09-12T02:08:01.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa8001a1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f810d6e0 con 0x7fa7f8101c00 2024-09-12T02:08:01.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa8001a1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f810d9e0 con 0x7fa7f81037c0 2024-09-12T02:08:01.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fe73e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7f81037c0 0x7fa7f819f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fe73e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7f81037c0 0x7fa7f819f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:55514/0 (socket says 172.21.15.136:55514) 2024-09-12T02:08:01.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fe73e640 1 -- 172.21.15.136:0/2562696744 learned_addr learned my addr 172.21.15.136:0/2562696744 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-12T02:08:01.236 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fdf3d640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7f8101c00 0x7fa7f8197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fd73c640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8102e00 0x7fa7f81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fe73e640 1 -- 172.21.15.136:0/2562696744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7f8101c00 msgr2=0x7fa7f8197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fe73e640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7f8101c00 0x7fa7f8197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fe73e640 1 -- 172.21.15.136:0/2562696744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8102e00 msgr2=0x7fa7f81983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:01.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fe73e640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8102e00 0x7fa7f81983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:01.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fe73e640 1 -- 172.21.15.136:0/2562696744 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f819fa90 con 0x7fa7f81037c0 2024-09-12T02:08:01.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fdf3d640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7f8101c00 0x7fa7f8197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:08:01.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fd73c640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8102e00 0x7fa7f81983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:08:01.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7fe73e640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7f81037c0 0x7fa7f819f420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000cce0 tx=0x7fa7f000a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:01.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa7eeffd640 1 -- 172.21.15.136:0/2562696744 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000f450 con 0x7fa7f81037c0 2024-09-12T02:08:01.237 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.195+0000 7fa8001a1640 1 -- 172.21.15.136:0/2562696744 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f819fd80 con 0x7fa7f81037c0 2024-09-12T02:08:01.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.196+0000 7fa7eeffd640 1 -- 172.21.15.136:0/2562696744 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7f000fad0 con 0x7fa7f81037c0 2024-09-12T02:08:01.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.196+0000 7fa7eeffd640 1 -- 172.21.15.136:0/2562696744 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0018c10 con 0x7fa7f81037c0 2024-09-12T02:08:01.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.196+0000 7fa8001a1640 1 -- 172.21.15.136:0/2562696744 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f81a0210 con 0x7fa7f81037c0 2024-09-12T02:08:01.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.197+0000 7fa8001a1640 1 -- 172.21.15.136:0/2562696744 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f8108fb0 con 0x7fa7f81037c0 2024-09-12T02:08:01.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.198+0000 7fa7eeffd640 1 -- 172.21.15.136:0/2562696744 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa7f000f5f0 con 0x7fa7f81037c0 2024-09-12T02:08:01.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.198+0000 7fa7eeffd640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa7e40a2bb0 0x7fa7e40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:01.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.199+0000 7fa7eeffd640 1 -- 172.21.15.136:0/2562696744 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7fa7f00ce780 con 0x7fa7f81037c0 2024-09-12T02:08:01.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.199+0000 7fa7fdf3d640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa7e40a2bb0 0x7fa7e40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:01.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.199+0000 7fa7fdf3d640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa7e40a2bb0 0x7fa7e40a5070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8102c60 tx=0x7fa7f400a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:01.238 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.202+0000 7fa7eeffd640 1 -- 172.21.15.136:0/2562696744 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa7f0014030 con 0x7fa7f81037c0 2024-09-12T02:08:01.384 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:01.384+0000 7fa8001a1640 1 -- 172.21.15.136:0/2562696744 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa7f8062630 con 0x7fa7e40a2bb0 2024-09-12T02:08:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:01 smithi136 ceph-mon[35814]: purged_snaps scrub starts 2024-09-12T02:08:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:01 smithi136 ceph-mon[35814]: purged_snaps scrub ok 2024-09-12T02:08:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:08:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:01 smithi136 ceph-mon[35814]: osd.4 [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119] boot 2024-09-12T02:08:01.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:01 smithi136 ceph-mon[35814]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T02:08:01.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:08:01.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:08:01.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:08:01.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:01 smithi115 ceph-mon[35351]: purged_snaps scrub starts 2024-09-12T02:08:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:01 smithi115 ceph-mon[35351]: purged_snaps scrub ok 2024-09-12T02:08:01.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:08:01.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:01 smithi115 ceph-mon[35351]: osd.4 [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119] boot 2024-09-12T02:08:01.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:01 smithi115 ceph-mon[35351]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T02:08:01.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:08:01.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:08:01.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:08:01.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:01 smithi110 ceph-mon[30548]: purged_snaps scrub starts 2024-09-12T02:08:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:01 smithi110 ceph-mon[30548]: purged_snaps scrub ok 2024-09-12T02:08:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:08:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:01 smithi110 ceph-mon[30548]: osd.4 [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119] boot 2024-09-12T02:08:01.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:01 smithi110 ceph-mon[30548]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T02:08:01.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:08:01.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:08:01.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:08:01.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:02.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:02 smithi115 ceph-mon[35351]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:08:02.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:02 smithi115 ceph-mon[35351]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:08:02.806 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:02 smithi136 ceph-mon[35814]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:08:02.806 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:02 smithi136 ceph-mon[35814]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:08:02.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:02 smithi110 ceph-mon[30548]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:08:02.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:02 smithi110 ceph-mon[30548]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-12T02:08:04.379 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:04 smithi136 ceph-mon[35814]: osdmap e34: 5 total, 5 up, 5 in 2024-09-12T02:08:04.379 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:04 smithi136 ceph-mon[35814]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:04.379 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:04 smithi136 ceph-mon[35814]: from='client.? 172.21.15.136:0/915012045' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca"}]: dispatch 2024-09-12T02:08:04.379 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:04 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca"}]: dispatch 2024-09-12T02:08:04.379 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:04 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca"}]': finished 2024-09-12T02:08:04.379 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:04 smithi136 ceph-mon[35814]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:08:04.379 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:04 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:04.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:04 smithi110 ceph-mon[30548]: osdmap e34: 5 total, 5 up, 5 in 2024-09-12T02:08:04.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:04 smithi110 ceph-mon[30548]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:04.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:04 smithi110 ceph-mon[30548]: from='client.? 172.21.15.136:0/915012045' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca"}]: dispatch 2024-09-12T02:08:04.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:04 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca"}]: dispatch 2024-09-12T02:08:04.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:04 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca"}]': finished 2024-09-12T02:08:04.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:04 smithi110 ceph-mon[30548]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:08:04.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:04 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:04 smithi115 ceph-mon[35351]: osdmap e34: 5 total, 5 up, 5 in 2024-09-12T02:08:04.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:04 smithi115 ceph-mon[35351]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:04.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:04 smithi115 ceph-mon[35351]: from='client.? 172.21.15.136:0/915012045' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca"}]: dispatch 2024-09-12T02:08:04.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:04 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca"}]: dispatch 2024-09-12T02:08:04.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:04 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca"}]': finished 2024-09-12T02:08:04.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:04 smithi115 ceph-mon[35351]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T02:08:04.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:04 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:05.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:05 smithi136 ceph-mon[35814]: from='client.? 172.21.15.136:0/2268226150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:08:05.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:05 smithi110 ceph-mon[30548]: from='client.? 172.21.15.136:0/2268226150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:08:05.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:05 smithi115 ceph-mon[35351]: from='client.? 172.21.15.136:0/2268226150' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:08:06.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:06 smithi110 ceph-mon[30548]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:06.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:06 smithi115 ceph-mon[35351]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:06.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:06 smithi136 ceph-mon[35814]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:08.746 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:08 smithi115 ceph-mon[35351]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:08.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:08 smithi136 ceph-mon[35814]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:08 smithi110 ceph-mon[30548]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:10.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:10 smithi136 ceph-mon[35814]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:10.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:10 smithi115 ceph-mon[35351]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:10 smithi110 ceph-mon[30548]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:12.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:12 smithi136 ceph-mon[35814]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:12.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:12 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:08:12.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:12 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:12 smithi115 ceph-mon[35351]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:12 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:08:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:12 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:12 smithi110 ceph-mon[30548]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T02:08:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:13.644 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:13 smithi136 ceph-mon[35814]: Deploying daemon osd.5 on smithi136 2024-09-12T02:08:13.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:13 smithi115 ceph-mon[35351]: Deploying daemon osd.5 on smithi136 2024-09-12T02:08:13.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:13 smithi110 ceph-mon[30548]: Deploying daemon osd.5 on smithi136 2024-09-12T02:08:14.585 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:14 smithi136 ceph-mon[35814]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:14.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:14 smithi115 ceph-mon[35351]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:14.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:14 smithi110 ceph-mon[30548]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:16.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:16 smithi115 ceph-mon[35351]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:16.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:16 smithi136 ceph-mon[35814]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:16.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:16 smithi110 ceph-mon[30548]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:18.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:18 smithi136 ceph-mon[35814]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:18.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:18 smithi115 ceph-mon[35351]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:18.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:18 smithi110 ceph-mon[30548]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:19.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:19 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:19.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:19 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:19.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:19 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:19 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:19 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:19 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:19.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:19 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:19.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:19 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:19.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:19 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:20.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:20 smithi115 ceph-mon[35351]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:20.893 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:20 smithi136 ceph-mon[35814]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:20 smithi110 ceph-mon[30548]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:22.476 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:22 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:22.476 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:22 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:22.476 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:22 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:22.476 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:22 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:22.476 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:22 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:22.476 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:22 smithi136 ceph-mon[35814]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:22.516 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.516+0000 7fa7eeffd640 1 -- 172.21.15.136:0/2562696744 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa7f8062630 con 0x7fa7e40a2bb0 2024-09-12T02:08:22.516 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 5 on host 'smithi136' 2024-09-12T02:08:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.518+0000 7fa8001a1640 1 -- 172.21.15.136:0/2562696744 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa7e40a2bb0 msgr2=0x7fa7e40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.518+0000 7fa8001a1640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa7e40a2bb0 0x7fa7e40a5070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8102c60 tx=0x7fa7f400a560 comp rx=0 tx=0).stop 2024-09-12T02:08:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.519+0000 7fa8001a1640 1 -- 172.21.15.136:0/2562696744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7f81037c0 msgr2=0x7fa7f819f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.519+0000 7fa8001a1640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7f81037c0 0x7fa7f819f420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000cce0 tx=0x7fa7f000a620 comp rx=0 tx=0).stop 2024-09-12T02:08:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.519+0000 7fa8001a1640 1 -- 172.21.15.136:0/2562696744 shutdown_connections 2024-09-12T02:08:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.519+0000 7fa8001a1640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa7e40a2bb0 0x7fa7e40a5070 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.519+0000 7fa8001a1640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7f81037c0 0x7fa7f819f420 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.519+0000 7fa8001a1640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7f8102e00 0x7fa7f81983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:22.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.519+0000 7fa8001a1640 1 --2- 172.21.15.136:0/2562696744 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa7f8101c00 0x7fa7f8197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:22.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.519+0000 7fa8001a1640 1 -- 172.21.15.136:0/2562696744 >> 172.21.15.136:0/2562696744 conn(0x7fa7f80fd390 msgr2=0x7fa7f8106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:22.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.519+0000 7fa8001a1640 1 -- 172.21.15.136:0/2562696744 shutdown_connections 2024-09-12T02:08:22.520 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:08:22.519+0000 7fa8001a1640 1 -- 172.21.15.136:0/2562696744 wait complete. 2024-09-12T02:08:22.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:22 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:22.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:22 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:22.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:22 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:22.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:22 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:22.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:22 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:22.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:22 smithi115 ceph-mon[35351]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:22.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:22 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:22.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:22 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:22.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:22 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:22.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:22 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:22.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:22 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:22.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:22 smithi110 ceph-mon[30548]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:23.165 DEBUG:teuthology.orchestra.run.smithi136:osd.5> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T02:08:23.168 INFO:tasks.cephadm:Deploying osd.6 on smithi110 with /dev/vg_nvme/lv_2... 2024-09-12T02:08:23.168 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:08:23.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:23.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:23.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:23.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:23.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:23.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:23.548 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:08:23.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:23.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:23.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:24.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:24 smithi110 ceph-mon[30548]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:24.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:24 smithi115 ceph-mon[35351]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:24.583 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:24 smithi136 ceph-mon[35814]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:24.836 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:08:24 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:08:24.582+0000 7f794e9d4640 -1 osd.5 0 log_to_monitors true 2024-09-12T02:08:25.403 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:25 smithi110 ceph-mon[30548]: from='osd.5 [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:08:25.403 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:25 smithi110 ceph-mon[30548]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:08:25.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:25 smithi115 ceph-mon[35351]: from='osd.5 [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:08:25.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:25 smithi115 ceph-mon[35351]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:08:25.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:25 smithi136 ceph-mon[35814]: from='osd.5 [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:08:25.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:25 smithi136 ceph-mon[35814]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T02:08:26.408 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:08:26.262+0000 7f794a957640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T02:08:26.408 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:08:26.270+0000 7f794677f640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:08:26.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:08:26.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T02:08:26.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:26.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: from='osd.5 [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:08:26.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:08:26.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:26.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:26.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:26.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:26.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:26.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:26.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:26.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:26.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:26.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:08:26.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T02:08:26.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:26.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: from='osd.5 [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:08:26.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:08:26.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:26.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:26.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:26.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:26.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:26.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:26.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:26.546 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:26.546 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:26.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T02:08:26.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T02:08:26.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:26.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: from='osd.5 [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:08:26.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:08:26.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 159 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:26.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:26.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:26.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:26.668 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:26.669 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:26.669 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:26.669 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:26.669 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:08:26.820 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_2 2024-09-12T02:08:27.213 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:08:27.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:27 smithi115 ceph-mon[35351]: Detected new or changed devices on smithi136 2024-09-12T02:08:27.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:27 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi136 to 8544M 2024-09-12T02:08:27.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:27 smithi115 ceph-mon[35351]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-12T02:08:27.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:27 smithi115 ceph-mon[35351]: osdmap e37: 6 total, 5 up, 6 in 2024-09-12T02:08:27.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:27 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:27.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:27 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:27.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:27 smithi110 ceph-mon[30548]: Detected new or changed devices on smithi136 2024-09-12T02:08:27.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:27 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi136 to 8544M 2024-09-12T02:08:27.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:27 smithi110 ceph-mon[30548]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-12T02:08:27.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:27 smithi110 ceph-mon[30548]: osdmap e37: 6 total, 5 up, 6 in 2024-09-12T02:08:27.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:27 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:27.545 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:27 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:27.559 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:27 smithi136 ceph-mon[35814]: Detected new or changed devices on smithi136 2024-09-12T02:08:27.559 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:27 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi136 to 8544M 2024-09-12T02:08:27.559 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:27 smithi136 ceph-mon[35814]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-12T02:08:27.559 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:27 smithi136 ceph-mon[35814]: osdmap e37: 6 total, 5 up, 6 in 2024-09-12T02:08:27.559 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:27 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:27.559 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:27 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:27.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.775+0000 7f3852e00640 1 -- 172.21.15.110:0/455246933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f384c105920 msgr2=0x7f384c10c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:27.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.775+0000 7f3852e00640 1 --2- 172.21.15.110:0/455246933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f384c105920 0x7f384c10c240 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3844009ca0 tx=0x7f384402a8b0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.776+0000 7f3852e00640 1 -- 172.21.15.110:0/455246933 shutdown_connections 2024-09-12T02:08:27.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.776+0000 7f3852e00640 1 --2- 172.21.15.110:0/455246933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f384c105920 0x7f384c10c240 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.776+0000 7f3852e00640 1 --2- 172.21.15.110:0/455246933 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f384c104f60 0x7f384c1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.776+0000 7f3852e00640 1 --2- 172.21.15.110:0/455246933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f384c103e00 0x7f384c104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.776+0000 7f3852e00640 1 -- 172.21.15.110:0/455246933 >> 172.21.15.110:0/455246933 conn(0x7f384c0ff5b0 msgr2=0x7f384c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:27.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.776+0000 7f3852e00640 1 -- 172.21.15.110:0/455246933 shutdown_connections 2024-09-12T02:08:27.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.776+0000 7f3852e00640 1 -- 172.21.15.110:0/455246933 wait complete. 2024-09-12T02:08:27.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.776+0000 7f3852e00640 1 Processor -- start 2024-09-12T02:08:27.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f3852e00640 1 -- start start 2024-09-12T02:08:27.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f3852e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f384c103e00 0x7f384c19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f3852e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f384c104f60 0x7f384c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f3852e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f384c105920 0x7f384c1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f3852e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f384c10fab0 con 0x7f384c104f60 2024-09-12T02:08:27.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f3852e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f384c10f930 con 0x7f384c103e00 2024-09-12T02:08:27.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f3852e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f384c10fc30 con 0x7f384c105920 2024-09-12T02:08:27.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f384be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f384c103e00 0x7f384c19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f3850e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f384c105920 0x7f384c1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f3850e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f384c105920 0x7f384c1a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:37994/0 (socket says 172.21.15.110:37994) 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f384be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f384c103e00 0x7f384c19a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:59530/0 (socket says 172.21.15.110:59530) 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f3850e00640 1 -- 172.21.15.110:0/2069184647 learned_addr learned my addr 172.21.15.110:0/2069184647 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.777+0000 7f384b400640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f384c104f60 0x7f384c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.778+0000 7f384be00640 1 -- 172.21.15.110:0/2069184647 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f384c105920 msgr2=0x7f384c1a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.778+0000 7f384be00640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f384c105920 0x7f384c1a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.778+0000 7f384be00640 1 -- 172.21.15.110:0/2069184647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f384c104f60 msgr2=0x7f384c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.778+0000 7f384be00640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f384c104f60 0x7f384c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.778+0000 7f384be00640 1 -- 172.21.15.110:0/2069184647 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384c1a1c80 con 0x7f384c103e00 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.778+0000 7f3850e00640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f384c105920 0x7f384c1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.778+0000 7f384be00640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f384c103e00 0x7f384c19a050 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f383c00e9f0 tx=0x7f383c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.778+0000 7f3848c00640 1 -- 172.21.15.110:0/2069184647 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c00ccc0 con 0x7f384c103e00 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.778+0000 7f3852e00640 1 -- 172.21.15.110:0/2069184647 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384c1a1f70 con 0x7f384c103e00 2024-09-12T02:08:27.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.778+0000 7f3848c00640 1 -- 172.21.15.110:0/2069184647 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f383c010910 con 0x7f384c103e00 2024-09-12T02:08:27.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.778+0000 7f3848c00640 1 -- 172.21.15.110:0/2069184647 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c018960 con 0x7f384c103e00 2024-09-12T02:08:27.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.778+0000 7f3852e00640 1 -- 172.21.15.110:0/2069184647 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f384c1a23d0 con 0x7f384c103e00 2024-09-12T02:08:27.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.779+0000 7f3852e00640 1 -- 172.21.15.110:0/2069184647 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f384c10b140 con 0x7f384c103e00 2024-09-12T02:08:27.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.781+0000 7f3848c00640 1 -- 172.21.15.110:0/2069184647 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f383c010ac0 con 0x7f384c103e00 2024-09-12T02:08:27.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.782+0000 7f3848c00640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f38300a2bb0 0x7f38300a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:27.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.783+0000 7f3848c00640 1 -- 172.21.15.110:0/2069184647 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4566+0+0 (secure 0 0 0) 0x7f383c0ce960 con 0x7f384c103e00 2024-09-12T02:08:27.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.783+0000 7f384b400640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f38300a2bb0 0x7f38300a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:27.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.783+0000 7f384b400640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f38300a2bb0 0x7f38300a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f384c19b570 tx=0x7f3838005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:27.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.785+0000 7f3848c00640 1 -- 172.21.15.110:0/2069184647 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f383c09c070 con 0x7f384c103e00 2024-09-12T02:08:27.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:27.972+0000 7f3852e00640 1 -- 172.21.15.110:0/2069184647 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f384c062630 con 0x7f38300a2bb0 2024-09-12T02:08:28.515 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:28 smithi136 ceph-mon[35814]: purged_snaps scrub starts 2024-09-12T02:08:28.515 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:28 smithi136 ceph-mon[35814]: purged_snaps scrub ok 2024-09-12T02:08:28.515 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:28 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:28.516 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:28 smithi136 ceph-mon[35814]: osd.5 [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265] boot 2024-09-12T02:08:28.516 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:28 smithi136 ceph-mon[35814]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:08:28.516 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:28 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:28.516 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:28 smithi136 ceph-mon[35814]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:28.516 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:28 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:08:28.516 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:28 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:08:28.516 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:28 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:28.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:28 smithi115 ceph-mon[35351]: purged_snaps scrub starts 2024-09-12T02:08:28.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:28 smithi115 ceph-mon[35351]: purged_snaps scrub ok 2024-09-12T02:08:28.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:28 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:28.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:28 smithi115 ceph-mon[35351]: osd.5 [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265] boot 2024-09-12T02:08:28.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:28 smithi115 ceph-mon[35351]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:08:28.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:28 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:28.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:28 smithi115 ceph-mon[35351]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:28.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:28 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:08:28.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:28 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:08:28.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:28 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:28.556 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:28 smithi110 ceph-mon[30548]: purged_snaps scrub starts 2024-09-12T02:08:28.556 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:28 smithi110 ceph-mon[30548]: purged_snaps scrub ok 2024-09-12T02:08:28.556 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:28 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:28.556 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:28 smithi110 ceph-mon[30548]: osd.5 [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265] boot 2024-09-12T02:08:28.556 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:28 smithi110 ceph-mon[30548]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T02:08:28.556 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:28 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:08:28.556 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:28 smithi110 ceph-mon[30548]: pgmap v139: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 447 GiB / 447 GiB avail 2024-09-12T02:08:28.556 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:28 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:08:28.556 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:28 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:08:28.556 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:28 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:29.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:29 smithi115 ceph-mon[35351]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:08:29.719 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:29 smithi115 ceph-mon[35351]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:08:29.720 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:29 smithi136 ceph-mon[35814]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:08:29.720 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:29 smithi136 ceph-mon[35814]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:08:29.720 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:29 smithi110 ceph-mon[30548]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:08:29.720 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:29 smithi110 ceph-mon[30548]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T02:08:30.382 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:30 smithi110 ceph-mon[30548]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T02:08:30.382 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:30 smithi110 ceph-mon[30548]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:30.382 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:30 smithi110 ceph-mon[30548]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:30 smithi115 ceph-mon[35351]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:30 smithi115 ceph-mon[35351]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:30.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:30 smithi115 ceph-mon[35351]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T02:08:30.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:30 smithi136 ceph-mon[35814]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T02:08:30.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:30 smithi136 ceph-mon[35814]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:30.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:30 smithi136 ceph-mon[35814]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T02:08:32.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:32 smithi110 ceph-mon[30548]: osdmap e42: 6 total, 6 up, 6 in 2024-09-12T02:08:32.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:32 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1884828891' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e5987bb-997f-4503-9b12-f6de1c456e69"}]: dispatch 2024-09-12T02:08:32.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:32 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1884828891' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e5987bb-997f-4503-9b12-f6de1c456e69"}]': finished 2024-09-12T02:08:32.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:32 smithi110 ceph-mon[30548]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T02:08:32.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:32 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:32.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:32 smithi110 ceph-mon[30548]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:32.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:32 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/297692748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:08:32.424 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:32 smithi136 ceph-mon[35814]: osdmap e42: 6 total, 6 up, 6 in 2024-09-12T02:08:32.424 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:32 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1884828891' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e5987bb-997f-4503-9b12-f6de1c456e69"}]: dispatch 2024-09-12T02:08:32.424 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:32 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1884828891' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e5987bb-997f-4503-9b12-f6de1c456e69"}]': finished 2024-09-12T02:08:32.424 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:32 smithi136 ceph-mon[35814]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T02:08:32.424 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:32 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:32.424 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:32 smithi136 ceph-mon[35814]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:32.424 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:32 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/297692748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:08:32.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:32 smithi115 ceph-mon[35351]: osdmap e42: 6 total, 6 up, 6 in 2024-09-12T02:08:32.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:32 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1884828891' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2e5987bb-997f-4503-9b12-f6de1c456e69"}]: dispatch 2024-09-12T02:08:32.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:32 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1884828891' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2e5987bb-997f-4503-9b12-f6de1c456e69"}]': finished 2024-09-12T02:08:32.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:32 smithi115 ceph-mon[35351]: osdmap e43: 7 total, 6 up, 7 in 2024-09-12T02:08:32.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:32 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:32.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:32 smithi115 ceph-mon[35351]: pgmap v146: 1 pgs: 1 remapped+peering; 577 KiB data, 186 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:32.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:32 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/297692748' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:08:34.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:34 smithi115 ceph-mon[35351]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-12T02:08:34.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:34 smithi136 ceph-mon[35814]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-12T02:08:34.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:34 smithi110 ceph-mon[30548]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-12T02:08:36.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:36 smithi115 ceph-mon[35351]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:08:36.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:36 smithi136 ceph-mon[35814]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:08:36.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:36 smithi110 ceph-mon[30548]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:08:38.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:38 smithi115 ceph-mon[35351]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-12T02:08:38.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:38 smithi136 ceph-mon[35814]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-12T02:08:38.929 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:38 smithi110 ceph-mon[30548]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-12T02:08:40.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:40 smithi115 ceph-mon[35351]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-12T02:08:40.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:40 smithi136 ceph-mon[35814]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-12T02:08:40.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:40 smithi110 ceph-mon[30548]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-12T02:08:41.583 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:08:41.583 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:08:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:41.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-12T02:08:41.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:42.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:42 smithi115 ceph-mon[35351]: Deploying daemon osd.6 on smithi110 2024-09-12T02:08:42.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:42 smithi115 ceph-mon[35351]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-12T02:08:42.836 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:42 smithi110 ceph-mon[30548]: Deploying daemon osd.6 on smithi110 2024-09-12T02:08:42.836 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:42 smithi110 ceph-mon[30548]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-12T02:08:42.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:42 smithi136 ceph-mon[35814]: Deploying daemon osd.6 on smithi110 2024-09-12T02:08:42.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:42 smithi136 ceph-mon[35814]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-12T02:08:44.609 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:44 smithi110 ceph-mon[30548]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:08:44.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:44 smithi115 ceph-mon[35351]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:08:44.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:44 smithi136 ceph-mon[35814]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:08:46.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:46 smithi115 ceph-mon[35351]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:46.849 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:46 smithi110 ceph-mon[30548]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:46.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:46 smithi136 ceph-mon[35814]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:48 smithi115 ceph-mon[35351]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:48 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:48 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:48 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:48.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:48 smithi136 ceph-mon[35814]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:48.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:48 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:48.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:48 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:48.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:48 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:48.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:48 smithi110 ceph-mon[30548]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:48.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:48.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:48.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:50.551 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:50 smithi110 ceph-mon[30548]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:50.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:50 smithi115 ceph-mon[35351]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:50.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:50 smithi136 ceph-mon[35814]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:52.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:52 smithi115 ceph-mon[35351]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:52.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:52.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:52.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:52.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:52.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:52 smithi136 ceph-mon[35814]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:52.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:52.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:52 smithi110 ceph-mon[30548]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:52.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:52.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:52.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:53.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.037+0000 7f3848c00640 1 -- 172.21.15.110:0/2069184647 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f384c062630 con 0x7f38300a2bb0 2024-09-12T02:08:53.039 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 6 on host 'smithi110' 2024-09-12T02:08:53.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.040+0000 7f3852e00640 1 -- 172.21.15.110:0/2069184647 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f38300a2bb0 msgr2=0x7f38300a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:53.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.040+0000 7f3852e00640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f38300a2bb0 0x7f38300a5070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f384c19b570 tx=0x7f3838005f90 comp rx=0 tx=0).stop 2024-09-12T02:08:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.040+0000 7f3852e00640 1 -- 172.21.15.110:0/2069184647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f384c103e00 msgr2=0x7f384c19a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.040+0000 7f3852e00640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f384c103e00 0x7f384c19a050 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f383c00e9f0 tx=0x7f383c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:08:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.040+0000 7f3852e00640 1 -- 172.21.15.110:0/2069184647 shutdown_connections 2024-09-12T02:08:53.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.040+0000 7f3852e00640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f38300a2bb0 0x7f38300a5070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.040+0000 7f3852e00640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f384c105920 0x7f384c1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.040+0000 7f3852e00640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f384c104f60 0x7f384c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.040+0000 7f3852e00640 1 --2- 172.21.15.110:0/2069184647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f384c103e00 0x7f384c19a050 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.040+0000 7f3852e00640 1 -- 172.21.15.110:0/2069184647 >> 172.21.15.110:0/2069184647 conn(0x7f384c0ff5b0 msgr2=0x7f384c108310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.041+0000 7f3852e00640 1 -- 172.21.15.110:0/2069184647 shutdown_connections 2024-09-12T02:08:53.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:08:53.041+0000 7f3852e00640 1 -- 172.21.15.110:0/2069184647 wait complete. 2024-09-12T02:08:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:53 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:53 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:53.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:53 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:53.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:53 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:53.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:53 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:53.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:53 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:53.825 DEBUG:teuthology.orchestra.run.smithi110:osd.6> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.6.service 2024-09-12T02:08:53.830 INFO:tasks.cephadm:Deploying osd.7 on smithi115 with /dev/vg_nvme/lv_2... 2024-09-12T02:08:53.830 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:08:53.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:53 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:08:53.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:53 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:53.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:53 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:54.087 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:08:54.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:54 smithi110 ceph-mon[30548]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:54.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:54 smithi110 ceph-mon[30548]: from='osd.6 [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:08:54.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:54 smithi110 ceph-mon[30548]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:08:54.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:54 smithi115 ceph-mon[35351]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:54.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:54 smithi115 ceph-mon[35351]: from='osd.6 [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:08:54.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:54 smithi115 ceph-mon[35351]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:08:54.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:54 smithi136 ceph-mon[35814]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:54.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:54 smithi136 ceph-mon[35814]: from='osd.6 [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:08:54.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:54 smithi136 ceph-mon[35814]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-12T02:08:55.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:55 smithi115 ceph-mon[35351]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:08:55.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:55 smithi115 ceph-mon[35351]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T02:08:55.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:55 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:55.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:55 smithi115 ceph-mon[35351]: from='osd.6 [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:08:55.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:55 smithi115 ceph-mon[35351]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:08:55.804 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:55 smithi110 ceph-mon[30548]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:08:55.805 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:55 smithi110 ceph-mon[30548]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T02:08:55.805 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:55 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:55.805 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:55 smithi110 ceph-mon[30548]: from='osd.6 [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:08:55.805 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:55 smithi110 ceph-mon[30548]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:08:55.805 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:08:55 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:08:55.503+0000 7f306de00640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T02:08:55.805 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:08:55 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:08:55.533+0000 7f3068e00640 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:08:55.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:55 smithi136 ceph-mon[35814]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-12T02:08:55.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:55 smithi136 ceph-mon[35814]: osdmap e44: 7 total, 6 up, 7 in 2024-09-12T02:08:55.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:55 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:55.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:55 smithi136 ceph-mon[35814]: from='osd.6 [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:08:55.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:55 smithi136 ceph-mon[35814]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:08:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:56 smithi110 ceph-mon[30548]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:56 smithi110 ceph-mon[30548]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-12T02:08:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:56 smithi110 ceph-mon[30548]: osdmap e45: 7 total, 6 up, 7 in 2024-09-12T02:08:56.790 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:56.791 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:56.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:56 smithi115 ceph-mon[35351]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:56.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:56 smithi115 ceph-mon[35351]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-12T02:08:56.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:56 smithi115 ceph-mon[35351]: osdmap e45: 7 total, 6 up, 7 in 2024-09-12T02:08:56.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:56.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:56.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:56 smithi136 ceph-mon[35814]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:56.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:56 smithi136 ceph-mon[35814]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-12T02:08:56.812 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:56 smithi136 ceph-mon[35814]: osdmap e45: 7 total, 6 up, 7 in 2024-09-12T02:08:56.812 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:56.812 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:56.848 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:08:56.874 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_2 2024-09-12T02:08:57.130 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:08:57.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.656+0000 7f7301979640 1 -- 172.21.15.115:0/4067590930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72fc104fd0 msgr2=0x7f72fc1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:57.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.656+0000 7f7301979640 1 --2- 172.21.15.115:0/4067590930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72fc104fd0 0x7f72fc1073c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009900 tx=0x7f72f002a410 comp rx=0 tx=0).stop 2024-09-12T02:08:57.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.656+0000 7f7301979640 1 -- 172.21.15.115:0/4067590930 shutdown_connections 2024-09-12T02:08:57.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.656+0000 7f7301979640 1 --2- 172.21.15.115:0/4067590930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72fc107900 0x7f72fc109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:57.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.656+0000 7f7301979640 1 --2- 172.21.15.115:0/4067590930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72fc104fd0 0x7f72fc1073c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:57.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.656+0000 7f7301979640 1 --2- 172.21.15.115:0/4067590930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72fc1026a0 0x7f72fc104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:57.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.656+0000 7f7301979640 1 -- 172.21.15.115:0/4067590930 >> 172.21.15.115:0/4067590930 conn(0x7f72fc0fc2a0 msgr2=0x7f72fc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:08:57.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.656+0000 7f7301979640 1 -- 172.21.15.115:0/4067590930 shutdown_connections 2024-09-12T02:08:57.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.656+0000 7f7301979640 1 -- 172.21.15.115:0/4067590930 wait complete. 2024-09-12T02:08:57.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f7301979640 1 Processor -- start 2024-09-12T02:08:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f7301979640 1 -- start start 2024-09-12T02:08:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f7301979640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72fc1026a0 0x7f72fc197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f7301979640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72fc104fd0 0x7f72fc1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f7301979640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72fc107900 0x7f72fc19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f7301979640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc10d8f0 con 0x7f72fc107900 2024-09-12T02:08:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f7301979640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc10d770 con 0x7f72fc1026a0 2024-09-12T02:08:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f7301979640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc10da70 con 0x7f72fc104fd0 2024-09-12T02:08:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f72faffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72fc1026a0 0x7f72fc197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f72faffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72fc1026a0 0x7f72fc197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52334/0 (socket says 172.21.15.115:52334) 2024-09-12T02:08:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f72faffd640 1 -- 172.21.15.115:0/2476007813 learned_addr learned my addr 172.21.15.115:0/2476007813 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-12T02:08:57.684 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f72fb7fe640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72fc107900 0x7f72fc19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:57.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f72fa7fc640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72fc104fd0 0x7f72fc1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:57.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f72faffd640 1 -- 172.21.15.115:0/2476007813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72fc104fd0 msgr2=0x7f72fc1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:57.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f72faffd640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72fc104fd0 0x7f72fc1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:57.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f72faffd640 1 -- 172.21.15.115:0/2476007813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72fc107900 msgr2=0x7f72fc19f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:08:57.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f72faffd640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72fc107900 0x7f72fc19f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:08:57.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f72faffd640 1 -- 172.21.15.115:0/2476007813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72fc19fbd0 con 0x7f72fc1026a0 2024-09-12T02:08:57.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f72fb7fe640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72fc107900 0x7f72fc19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:08:57.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.657+0000 7f72faffd640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72fc1026a0 0x7f72fc197fa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00d950 tx=0x7f72ec00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:57.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.658+0000 7f7300977640 1 -- 172.21.15.115:0/2476007813 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec017070 con 0x7f72fc1026a0 2024-09-12T02:08:57.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.658+0000 7f7301979640 1 -- 172.21.15.115:0/2476007813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72fc19fec0 con 0x7f72fc1026a0 2024-09-12T02:08:57.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.658+0000 7f7300977640 1 -- 172.21.15.115:0/2476007813 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72ec009c30 con 0x7f72fc1026a0 2024-09-12T02:08:57.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.658+0000 7f7301979640 1 -- 172.21.15.115:0/2476007813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72fc1a03a0 con 0x7f72fc1026a0 2024-09-12T02:08:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.658+0000 7f7300977640 1 -- 172.21.15.115:0/2476007813 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec00f6b0 con 0x7f72fc1026a0 2024-09-12T02:08:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.659+0000 7f7301979640 1 -- 172.21.15.115:0/2476007813 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72fc0fdd90 con 0x7f72fc1026a0 2024-09-12T02:08:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.660+0000 7f7300977640 1 -- 172.21.15.115:0/2476007813 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f72ec0109d0 con 0x7f72fc1026a0 2024-09-12T02:08:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.660+0000 7f7300977640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f72e40a2bb0 0x7f72e40a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:08:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.661+0000 7f7300977640 1 -- 172.21.15.115:0/2476007813 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f72ec0ce370 con 0x7f72fc1026a0 2024-09-12T02:08:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.661+0000 7f72fa7fc640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f72e40a2bb0 0x7f72e40a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:08:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.661+0000 7f72fa7fc640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f72e40a2bb0 0x7f72e40a5070 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f72f0006010 tx=0x7f72f0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:08:57.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.664+0000 7f7300977640 1 -- 172.21.15.115:0/2476007813 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72ec09bfe0 con 0x7f72fc1026a0 2024-09-12T02:08:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:57 smithi115 ceph-mon[35351]: purged_snaps scrub starts 2024-09-12T02:08:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:57 smithi115 ceph-mon[35351]: purged_snaps scrub ok 2024-09-12T02:08:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:57 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:57 smithi115 ceph-mon[35351]: osd.6 [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141] boot 2024-09-12T02:08:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:57 smithi115 ceph-mon[35351]: osdmap e46: 7 total, 7 up, 7 in 2024-09-12T02:08:57.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:57 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:57.844 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:08:57.843+0000 7f7301979640 1 -- 172.21.15.115:0/2476007813 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f72fc062630 con 0x7f72e40a2bb0 2024-09-12T02:08:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:57 smithi136 ceph-mon[35814]: purged_snaps scrub starts 2024-09-12T02:08:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:57 smithi136 ceph-mon[35814]: purged_snaps scrub ok 2024-09-12T02:08:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:57 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:57.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:57 smithi136 ceph-mon[35814]: osd.6 [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141] boot 2024-09-12T02:08:57.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:57 smithi136 ceph-mon[35814]: osdmap e46: 7 total, 7 up, 7 in 2024-09-12T02:08:57.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:57 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:57 smithi110 ceph-mon[30548]: purged_snaps scrub starts 2024-09-12T02:08:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:57 smithi110 ceph-mon[30548]: purged_snaps scrub ok 2024-09-12T02:08:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:57 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:57 smithi110 ceph-mon[30548]: osd.6 [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141] boot 2024-09-12T02:08:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:57 smithi110 ceph-mon[30548]: osdmap e46: 7 total, 7 up, 7 in 2024-09-12T02:08:57.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:57 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:08:58.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: osdmap e47: 7 total, 7 up, 7 in 2024-09-12T02:08:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:58.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:08:58.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:08:58.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:58 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:58.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:58.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: osdmap e47: 7 total, 7 up, 7 in 2024-09-12T02:08:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:08:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:08:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:58 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-09-12T02:08:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: osdmap e47: 7 total, 7 up, 7 in 2024-09-12T02:08:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:58.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:58.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:58.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:58.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:08:58.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:58.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:58.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:08:58.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:08:58.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:08:58.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:08:58.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:58 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:08:59.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:59 smithi115 ceph-mon[35351]: Detected new or changed devices on smithi110 2024-09-12T02:08:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:59 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi110 to 5696M 2024-09-12T02:08:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:08:59 smithi115 ceph-mon[35351]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:08:59.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:59 smithi136 ceph-mon[35814]: Detected new or changed devices on smithi110 2024-09-12T02:08:59.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:59 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi110 to 5696M 2024-09-12T02:08:59.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:08:59 smithi136 ceph-mon[35814]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:08:59.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:59 smithi110 ceph-mon[30548]: Detected new or changed devices on smithi110 2024-09-12T02:08:59.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:59 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi110 to 5696M 2024-09-12T02:08:59.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:08:59 smithi110 ceph-mon[30548]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:00 smithi115 ceph-mon[35351]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:00 smithi115 ceph-mon[35351]: from='client.? 172.21.15.115:0/1862886510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0736750a-3ed6-4092-8e11-5951827b7810"}]: dispatch 2024-09-12T02:09:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:00 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0736750a-3ed6-4092-8e11-5951827b7810"}]: dispatch 2024-09-12T02:09:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:00 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0736750a-3ed6-4092-8e11-5951827b7810"}]': finished 2024-09-12T02:09:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:00 smithi115 ceph-mon[35351]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T02:09:00.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:00 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:00 smithi136 ceph-mon[35814]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:00 smithi136 ceph-mon[35814]: from='client.? 172.21.15.115:0/1862886510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0736750a-3ed6-4092-8e11-5951827b7810"}]: dispatch 2024-09-12T02:09:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:00 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0736750a-3ed6-4092-8e11-5951827b7810"}]: dispatch 2024-09-12T02:09:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:00 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0736750a-3ed6-4092-8e11-5951827b7810"}]': finished 2024-09-12T02:09:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:00 smithi136 ceph-mon[35814]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T02:09:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:00 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:00.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:00 smithi110 ceph-mon[30548]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:00.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:00 smithi110 ceph-mon[30548]: from='client.? 172.21.15.115:0/1862886510' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0736750a-3ed6-4092-8e11-5951827b7810"}]: dispatch 2024-09-12T02:09:00.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:00 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0736750a-3ed6-4092-8e11-5951827b7810"}]: dispatch 2024-09-12T02:09:00.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:00 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0736750a-3ed6-4092-8e11-5951827b7810"}]': finished 2024-09-12T02:09:00.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:00 smithi110 ceph-mon[30548]: osdmap e48: 8 total, 7 up, 8 in 2024-09-12T02:09:00.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:00 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:01 smithi115 ceph-mon[35351]: from='client.? 172.21.15.115:0/2339111373' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:09:01.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:01 smithi136 ceph-mon[35814]: from='client.? 172.21.15.115:0/2339111373' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:09:01.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:01 smithi110 ceph-mon[30548]: from='client.? 172.21.15.115:0/2339111373' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:09:02.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:02 smithi115 ceph-mon[35351]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:02.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:02 smithi136 ceph-mon[35814]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:02.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:02 smithi110 ceph-mon[30548]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:04.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:04 smithi115 ceph-mon[35351]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:04.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:04 smithi136 ceph-mon[35814]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:04.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:04 smithi110 ceph-mon[30548]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:06.776 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:06 smithi115 ceph-mon[35351]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:06 smithi136 ceph-mon[35814]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:06 smithi110 ceph-mon[30548]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:08.771 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:08 smithi115 ceph-mon[35351]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:08.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:08 smithi136 ceph-mon[35814]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:08 smithi110 ceph-mon[30548]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:09 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:09:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:09 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:09.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:09 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:09:09.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:09 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:09 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-12T02:09:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:09 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:10.764 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:10 smithi115 ceph-mon[35351]: Deploying daemon osd.7 on smithi115 2024-09-12T02:09:10.764 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:10 smithi115 ceph-mon[35351]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:10 smithi136 ceph-mon[35814]: Deploying daemon osd.7 on smithi115 2024-09-12T02:09:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:10 smithi136 ceph-mon[35814]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:10 smithi110 ceph-mon[30548]: Deploying daemon osd.7 on smithi115 2024-09-12T02:09:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:10 smithi110 ceph-mon[30548]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:12.606 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:12 smithi115 ceph-mon[35351]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:12.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:12 smithi136 ceph-mon[35814]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:12 smithi110 ceph-mon[30548]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:14.711 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:14 smithi115 ceph-mon[35351]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:14 smithi136 ceph-mon[35814]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:14.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:14 smithi110 ceph-mon[30548]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:15.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:15 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:15.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:15 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:15.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:15 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:15 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:15 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:15 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:15.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:15.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:16.722 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:16 smithi115 ceph-mon[35351]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:16.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:16 smithi136 ceph-mon[35814]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:16.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:16 smithi110 ceph-mon[30548]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:18.724 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:18 smithi115 ceph-mon[35351]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:18.724 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:18 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:18.724 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:18 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:18.724 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:18 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:18.724 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:18 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:18.725 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:18 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:18.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:18 smithi136 ceph-mon[35814]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:18.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:18 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:18.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:18 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:18.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:18 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:18.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:18 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:18.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:18 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:18.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:18 smithi110 ceph-mon[30548]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:18.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:18 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:18.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:18 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:18.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:18 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:18.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:18 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:18.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:18 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:19.090 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 7 on host 'smithi115' 2024-09-12T02:09:19.091 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.090+0000 7f7300977640 1 -- 172.21.15.115:0/2476007813 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f72fc062630 con 0x7f72e40a2bb0 2024-09-12T02:09:19.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.092+0000 7f7301979640 1 -- 172.21.15.115:0/2476007813 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f72e40a2bb0 msgr2=0x7f72e40a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:19.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.092+0000 7f7301979640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f72e40a2bb0 0x7f72e40a5070 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f72f0006010 tx=0x7f72f0000bc0 comp rx=0 tx=0).stop 2024-09-12T02:09:19.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.092+0000 7f7301979640 1 -- 172.21.15.115:0/2476007813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72fc1026a0 msgr2=0x7f72fc197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:19.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.092+0000 7f7301979640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72fc1026a0 0x7f72fc197fa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00d950 tx=0x7f72ec00de10 comp rx=0 tx=0).stop 2024-09-12T02:09:19.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.093+0000 7f7301979640 1 -- 172.21.15.115:0/2476007813 shutdown_connections 2024-09-12T02:09:19.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.093+0000 7f7301979640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f72e40a2bb0 0x7f72e40a5070 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:19.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.093+0000 7f7301979640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72fc107900 0x7f72fc19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:19.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.093+0000 7f7301979640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72fc104fd0 0x7f72fc1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:19.093 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.093+0000 7f7301979640 1 --2- 172.21.15.115:0/2476007813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f72fc1026a0 0x7f72fc197fa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:19.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.093+0000 7f7301979640 1 -- 172.21.15.115:0/2476007813 >> 172.21.15.115:0/2476007813 conn(0x7f72fc0fc2a0 msgr2=0x7f72fc102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:19.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.093+0000 7f7301979640 1 -- 172.21.15.115:0/2476007813 shutdown_connections 2024-09-12T02:09:19.094 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:09:19.093+0000 7f7301979640 1 -- 172.21.15.115:0/2476007813 wait complete. 2024-09-12T02:09:19.737 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:19 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:19.737 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:19 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:19.737 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:19 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:19.764 DEBUG:teuthology.orchestra.run.smithi115:osd.7> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.7.service 2024-09-12T02:09:19.766 INFO:tasks.cephadm:Deploying osd.8 on smithi136 with /dev/vg_nvme/lv_2... 2024-09-12T02:09:19.766 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T02:09:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:19 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:19 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:19 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:19.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:19 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:19.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:19 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:19.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:19 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:20.022 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:09:20.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:20 smithi136 ceph-mon[35814]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:20 smithi110 ceph-mon[30548]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:20.948 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:20 smithi115 ceph-mon[35351]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:21.247 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:09:21 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:09:21.150+0000 7f2e22011640 -1 osd.7 0 log_to_monitors true 2024-09-12T02:09:21.867 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:21 smithi136 ceph-mon[35814]: from='osd.7 [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:09:21.867 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:21 smithi136 ceph-mon[35814]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:09:21.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:21 smithi110 ceph-mon[30548]: from='osd.7 [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:09:21.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:21 smithi110 ceph-mon[30548]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:09:21.990 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:21 smithi115 ceph-mon[35351]: from='osd.7 [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:09:21.990 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:21 smithi115 ceph-mon[35351]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-12T02:09:22.581 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:09:22 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:09:22.570+0000 7f2e1df94640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T02:09:22.581 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:09:22 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:09:22.581+0000 7f2e19dbc640 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:09:22.582 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:22 smithi115 ceph-mon[35351]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:22.582 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:22 smithi115 ceph-mon[35351]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:09:22.582 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:22 smithi115 ceph-mon[35351]: osdmap e49: 8 total, 7 up, 8 in 2024-09-12T02:09:22.582 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:22 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:22.582 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:22 smithi115 ceph-mon[35351]: from='osd.7 [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:09:22.582 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:22 smithi115 ceph-mon[35351]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:09:22.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:22 smithi136 ceph-mon[35814]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:22.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:22 smithi136 ceph-mon[35814]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:09:22.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:22 smithi136 ceph-mon[35814]: osdmap e49: 8 total, 7 up, 8 in 2024-09-12T02:09:22.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:22 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:22.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:22 smithi136 ceph-mon[35814]: from='osd.7 [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:09:22.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:22 smithi136 ceph-mon[35814]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:09:22.811 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:09:22.840 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_2 2024-09-12T02:09:22.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:22 smithi110 ceph-mon[30548]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:22.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:22 smithi110 ceph-mon[30548]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-12T02:09:22.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:22 smithi110 ceph-mon[30548]: osdmap e49: 8 total, 7 up, 8 in 2024-09-12T02:09:22.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:22 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:22 smithi110 ceph-mon[30548]: from='osd.7 [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:09:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:22 smithi110 ceph-mon[30548]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:09:23.095 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:09:23.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.727+0000 7f6016109640 1 -- 172.21.15.136:0/4033054072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6010101cd0 msgr2=0x7f6010102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:23.744 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.728+0000 7f6016109640 1 --2- 172.21.15.136:0/4033054072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6010101cd0 0x7f6010102150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6004009900 tx=0x7f600402a410 comp rx=0 tx=0).stop 2024-09-12T02:09:23.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.728+0000 7f6016109640 1 -- 172.21.15.136:0/4033054072 shutdown_connections 2024-09-12T02:09:23.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.728+0000 7f6016109640 1 --2- 172.21.15.136:0/4033054072 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6010102690 0x7f6010108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:23.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.728+0000 7f6016109640 1 --2- 172.21.15.136:0/4033054072 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6010101cd0 0x7f6010102150 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:23.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.728+0000 7f6016109640 1 --2- 172.21.15.136:0/4033054072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6010100ad0 0x7f6010100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:23.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.728+0000 7f6016109640 1 -- 172.21.15.136:0/4033054072 >> 172.21.15.136:0/4033054072 conn(0x7f60100fc280 msgr2=0x7f60100fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:23.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.728+0000 7f6016109640 1 -- 172.21.15.136:0/4033054072 shutdown_connections 2024-09-12T02:09:23.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.728+0000 7f6016109640 1 -- 172.21.15.136:0/4033054072 wait complete. 2024-09-12T02:09:23.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.728+0000 7f6016109640 1 Processor -- start 2024-09-12T02:09:23.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.728+0000 7f6016109640 1 -- start start 2024-09-12T02:09:23.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.728+0000 7f6016109640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6010100ad0 0x7f6010198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:23.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f6016109640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6010101cd0 0x7f60101985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:23.745 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f6016109640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6010102690 0x7f601019f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:23.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f6016109640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f601010d960 con 0x7f6010102690 2024-09-12T02:09:23.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f6016109640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f601010d7e0 con 0x7f6010100ad0 2024-09-12T02:09:23.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f6016109640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f601010dae0 con 0x7f6010101cd0 2024-09-12T02:09:23.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600effd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6010101cd0 0x7f60101985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:23.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600effd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6010101cd0 0x7f60101985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:45722/0 (socket says 172.21.15.136:45722) 2024-09-12T02:09:23.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600effd640 1 -- 172.21.15.136:0/4182219066 learned_addr learned my addr 172.21.15.136:0/4182219066 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-12T02:09:23.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600f7fe640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6010100ad0 0x7f6010198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:23.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600effd640 1 -- 172.21.15.136:0/4182219066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6010100ad0 msgr2=0x7f6010198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:23.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600effd640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6010100ad0 0x7f6010198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:23.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600effd640 1 -- 172.21.15.136:0/4182219066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6010102690 msgr2=0x7f601019f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:23.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600effd640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6010102690 0x7f601019f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:23.746 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600effd640 1 -- 172.21.15.136:0/4182219066 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601019fcb0 con 0x7f6010101cd0 2024-09-12T02:09:23.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600effd640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6010101cd0 0x7f60101985c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6004009230 tx=0x7f6004004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:23.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600cff9640 1 -- 172.21.15.136:0/4182219066 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600403f030 con 0x7f6010101cd0 2024-09-12T02:09:23.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600cff9640 1 -- 172.21.15.136:0/4182219066 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6004003ce0 con 0x7f6010101cd0 2024-09-12T02:09:23.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f6016109640 1 -- 172.21.15.136:0/4182219066 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601019ff40 con 0x7f6010101cd0 2024-09-12T02:09:23.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f600cff9640 1 -- 172.21.15.136:0/4182219066 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6004035070 con 0x7f6010101cd0 2024-09-12T02:09:23.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.729+0000 7f6016109640 1 -- 172.21.15.136:0/4182219066 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60101a0470 con 0x7f6010101cd0 2024-09-12T02:09:23.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.730+0000 7f6016109640 1 -- 172.21.15.136:0/4182219066 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6010107f70 con 0x7f6010101cd0 2024-09-12T02:09:23.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.732+0000 7f600cff9640 1 -- 172.21.15.136:0/4182219066 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6004042030 con 0x7f6010101cd0 2024-09-12T02:09:23.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.732+0000 7f600cff9640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5ff80a2c30 0x7f5ff80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:23.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.732+0000 7f600cff9640 1 -- 172.21.15.136:0/4182219066 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5430+0+0 (secure 0 0 0) 0x7f60040eefb0 con 0x7f6010101cd0 2024-09-12T02:09:23.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.733+0000 7f600f7fe640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5ff80a2c30 0x7f5ff80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:23.747 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.733+0000 7f600f7fe640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5ff80a2c30 0x7f5ff80a50f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6010101b30 tx=0x7f6000008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:23.748 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.735+0000 7f600cff9640 1 -- 172.21.15.136:0/4182219066 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60040bca50 con 0x7f6010101cd0 2024-09-12T02:09:23.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-12T02:09:23.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: osdmap e50: 8 total, 7 up, 8 in 2024-09-12T02:09:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:23.914 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:23.915+0000 7f6016109640 1 -- 172.21.15.136:0/4182219066 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6010062630 con 0x7f5ff80a2c30 2024-09-12T02:09:23.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-12T02:09:23.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: osdmap e50: 8 total, 7 up, 8 in 2024-09-12T02:09:23.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:24.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-12T02:09:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: osdmap e50: 8 total, 7 up, 8 in 2024-09-12T02:09:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:24.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:24 smithi136 ceph-mon[35814]: purged_snaps scrub starts 2024-09-12T02:09:24.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:24 smithi136 ceph-mon[35814]: purged_snaps scrub ok 2024-09-12T02:09:24.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:24 smithi136 ceph-mon[35814]: Detected new or changed devices on smithi115 2024-09-12T02:09:24.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:24 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi115 to 5696M 2024-09-12T02:09:24.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:24 smithi136 ceph-mon[35814]: pgmap v179: 1 pgs: 1 unknown; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:24.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:24 smithi136 ceph-mon[35814]: osd.7 [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086] boot 2024-09-12T02:09:24.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:24 smithi136 ceph-mon[35814]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T02:09:24.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:24 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:24.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:24 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:09:24.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:24 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:09:24.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:24 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:24.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:24 smithi136 ceph-mon[35814]: osdmap e52: 8 total, 8 up, 8 in 2024-09-12T02:09:24.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:24 smithi110 ceph-mon[30548]: purged_snaps scrub starts 2024-09-12T02:09:24.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:24 smithi110 ceph-mon[30548]: purged_snaps scrub ok 2024-09-12T02:09:24.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:24 smithi110 ceph-mon[30548]: Detected new or changed devices on smithi115 2024-09-12T02:09:24.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:24 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi115 to 5696M 2024-09-12T02:09:24.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:24 smithi110 ceph-mon[30548]: pgmap v179: 1 pgs: 1 unknown; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:24.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:24 smithi110 ceph-mon[30548]: osd.7 [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086] boot 2024-09-12T02:09:24.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:24 smithi110 ceph-mon[30548]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T02:09:24.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:24 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:24.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:24 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:09:24.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:24 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:09:24.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:24 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:24.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:24 smithi110 ceph-mon[30548]: osdmap e52: 8 total, 8 up, 8 in 2024-09-12T02:09:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:24 smithi115 ceph-mon[35351]: purged_snaps scrub starts 2024-09-12T02:09:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:24 smithi115 ceph-mon[35351]: purged_snaps scrub ok 2024-09-12T02:09:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:24 smithi115 ceph-mon[35351]: Detected new or changed devices on smithi115 2024-09-12T02:09:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:24 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi115 to 5696M 2024-09-12T02:09:25.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:24 smithi115 ceph-mon[35351]: pgmap v179: 1 pgs: 1 unknown; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-12T02:09:25.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:24 smithi115 ceph-mon[35351]: osd.7 [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086] boot 2024-09-12T02:09:25.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:24 smithi115 ceph-mon[35351]: osdmap e51: 8 total, 8 up, 8 in 2024-09-12T02:09:25.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:24 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:09:25.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:24 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:09:25.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:24 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:09:25.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:24 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:25.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:24 smithi115 ceph-mon[35351]: osdmap e52: 8 total, 8 up, 8 in 2024-09-12T02:09:25.608 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:25 smithi136 ceph-mon[35814]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:25.609 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:25 smithi136 ceph-mon[35814]: osdmap e53: 8 total, 8 up, 8 in 2024-09-12T02:09:25.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:25 smithi110 ceph-mon[30548]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:25.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:25 smithi110 ceph-mon[30548]: osdmap e53: 8 total, 8 up, 8 in 2024-09-12T02:09:26.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:25 smithi115 ceph-mon[35351]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:26.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:25 smithi115 ceph-mon[35351]: osdmap e53: 8 total, 8 up, 8 in 2024-09-12T02:09:26.877 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:26 smithi136 ceph-mon[35814]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:26.877 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:26 smithi136 ceph-mon[35814]: from='client.? 172.21.15.136:0/1477305869' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf7a657a-cbdd-4b88-b71c-d98a74ffec5d"}]: dispatch 2024-09-12T02:09:26.878 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:26 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf7a657a-cbdd-4b88-b71c-d98a74ffec5d"}]: dispatch 2024-09-12T02:09:26.878 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:26 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf7a657a-cbdd-4b88-b71c-d98a74ffec5d"}]': finished 2024-09-12T02:09:26.878 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:26 smithi136 ceph-mon[35814]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:09:26.878 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:26.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:26 smithi110 ceph-mon[30548]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:26.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:26 smithi110 ceph-mon[30548]: from='client.? 172.21.15.136:0/1477305869' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf7a657a-cbdd-4b88-b71c-d98a74ffec5d"}]: dispatch 2024-09-12T02:09:26.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:26 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf7a657a-cbdd-4b88-b71c-d98a74ffec5d"}]: dispatch 2024-09-12T02:09:26.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:26 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf7a657a-cbdd-4b88-b71c-d98a74ffec5d"}]': finished 2024-09-12T02:09:26.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:26 smithi110 ceph-mon[30548]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:09:26.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:27.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:26 smithi115 ceph-mon[35351]: pgmap v182: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:27.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:26 smithi115 ceph-mon[35351]: from='client.? 172.21.15.136:0/1477305869' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf7a657a-cbdd-4b88-b71c-d98a74ffec5d"}]: dispatch 2024-09-12T02:09:27.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:26 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cf7a657a-cbdd-4b88-b71c-d98a74ffec5d"}]: dispatch 2024-09-12T02:09:27.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:26 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cf7a657a-cbdd-4b88-b71c-d98a74ffec5d"}]': finished 2024-09-12T02:09:27.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:26 smithi115 ceph-mon[35351]: osdmap e54: 9 total, 8 up, 9 in 2024-09-12T02:09:27.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:27.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:27 smithi136 ceph-mon[35814]: from='client.? 172.21.15.136:0/726571232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:09:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:27 smithi136 ceph-mon[35814]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T02:09:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:27 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:27 smithi110 ceph-mon[30548]: from='client.? 172.21.15.136:0/726571232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:09:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:27 smithi110 ceph-mon[30548]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T02:09:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:27 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:28.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:27 smithi115 ceph-mon[35351]: from='client.? 172.21.15.136:0/726571232' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:09:28.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:27 smithi115 ceph-mon[35351]: osdmap e55: 9 total, 8 up, 9 in 2024-09-12T02:09:28.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:27 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:28.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:28 smithi136 ceph-mon[35814]: pgmap v186: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:28.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:28 smithi136 ceph-mon[35814]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-12T02:09:28.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:28 smithi110 ceph-mon[30548]: pgmap v186: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:28.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:28 smithi110 ceph-mon[30548]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-12T02:09:28.945 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:28 smithi115 ceph-mon[35351]: pgmap v186: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:28.945 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:28 smithi115 ceph-mon[35351]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-09-12T02:09:29.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:29 smithi136 ceph-mon[35814]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-12T02:09:29.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:29 smithi136 ceph-mon[35814]: Cluster is now healthy 2024-09-12T02:09:29.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:29 smithi110 ceph-mon[30548]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-12T02:09:29.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:29 smithi110 ceph-mon[30548]: Cluster is now healthy 2024-09-12T02:09:30.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:29 smithi115 ceph-mon[35351]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-09-12T02:09:30.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:29 smithi115 ceph-mon[35351]: Cluster is now healthy 2024-09-12T02:09:30.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:30 smithi136 ceph-mon[35814]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:30.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:30 smithi110 ceph-mon[30548]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:31.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:30 smithi115 ceph-mon[35351]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:32.873 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:32 smithi136 ceph-mon[35814]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:32.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:32 smithi110 ceph-mon[30548]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:33.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:32 smithi115 ceph-mon[35351]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:34.894 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:34 smithi136 ceph-mon[35814]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:34.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:34 smithi110 ceph-mon[30548]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:35.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:34 smithi115 ceph-mon[35351]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:35.911 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:09:35.911 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:35.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:09:35.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:36.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:35 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-12T02:09:36.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:35 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:36.879 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:36 smithi136 ceph-mon[35814]: Deploying daemon osd.8 on smithi136 2024-09-12T02:09:36.879 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:36 smithi136 ceph-mon[35814]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:36.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:36 smithi110 ceph-mon[30548]: Deploying daemon osd.8 on smithi136 2024-09-12T02:09:36.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:36 smithi110 ceph-mon[30548]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:37.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:36 smithi115 ceph-mon[35351]: Deploying daemon osd.8 on smithi136 2024-09-12T02:09:37.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:36 smithi115 ceph-mon[35351]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:37.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:37 smithi136 ceph-mon[35814]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:37.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:37 smithi110 ceph-mon[30548]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:38.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:37 smithi115 ceph-mon[35351]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:40.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:40 smithi115 ceph-mon[35351]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:40.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:40 smithi136 ceph-mon[35814]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:40.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:40 smithi110 ceph-mon[30548]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:41.673 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:41.673 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:41.673 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:41.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:41.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:41.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:41.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:42.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:42 smithi115 ceph-mon[35351]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:42.836 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:42 smithi136 ceph-mon[35814]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:42.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:42 smithi110 ceph-mon[30548]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:44.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:44 smithi136 ceph-mon[35814]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:44.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:44 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:44.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.776+0000 7f600cff9640 1 -- 172.21.15.136:0/4182219066 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6010062630 con 0x7f5ff80a2c30 2024-09-12T02:09:44.777 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 8 on host 'smithi136' 2024-09-12T02:09:44.778 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.778+0000 7f6016109640 1 -- 172.21.15.136:0/4182219066 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5ff80a2c30 msgr2=0x7f5ff80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.778+0000 7f6016109640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5ff80a2c30 0x7f5ff80a50f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6010101b30 tx=0x7f6000008040 comp rx=0 tx=0).stop 2024-09-12T02:09:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.778+0000 7f6016109640 1 -- 172.21.15.136:0/4182219066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6010101cd0 msgr2=0x7f60101985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.778+0000 7f6016109640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6010101cd0 0x7f60101985c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6004009230 tx=0x7f6004004430 comp rx=0 tx=0).stop 2024-09-12T02:09:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.778+0000 7f6016109640 1 -- 172.21.15.136:0/4182219066 shutdown_connections 2024-09-12T02:09:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.778+0000 7f6016109640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5ff80a2c30 0x7f5ff80a50f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.778+0000 7f6016109640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6010102690 0x7f601019f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.778+0000 7f6016109640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6010101cd0 0x7f60101985c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.778+0000 7f6016109640 1 --2- 172.21.15.136:0/4182219066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6010100ad0 0x7f6010198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.778+0000 7f6016109640 1 -- 172.21.15.136:0/4182219066 >> 172.21.15.136:0/4182219066 conn(0x7f60100fc280 msgr2=0x7f6010105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.779+0000 7f6016109640 1 -- 172.21.15.136:0/4182219066 shutdown_connections 2024-09-12T02:09:44.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:09:44.779+0000 7f6016109640 1 -- 172.21.15.136:0/4182219066 wait complete. 2024-09-12T02:09:44.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:44 smithi115 ceph-mon[35351]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:44.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:44.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:44.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:44.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:44 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:44.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:44 smithi110 ceph-mon[30548]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:44.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:44.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:44.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:44.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:44.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:44 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:45.475 DEBUG:teuthology.orchestra.run.smithi136:osd.8> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.8.service 2024-09-12T02:09:45.477 INFO:tasks.cephadm:Deploying osd.9 on smithi110 with /dev/vg_nvme/lv_1... 2024-09-12T02:09:45.477 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:09:45.781 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:45.781 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:45.781 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:45.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:45.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:45.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:45.845 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:45.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:09:45.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:45.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:46.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:46 smithi110 ceph-mon[30548]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:46.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:46 smithi115 ceph-mon[35351]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:46.850 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:46 smithi136 ceph-mon[35814]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:46.851 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:09:46 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:09:46.576+0000 7f71e5cb0640 -1 osd.8 0 log_to_monitors true 2024-09-12T02:09:47.743 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:47 smithi136 ceph-mon[35814]: from='osd.8 [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:09:47.743 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:47 smithi136 ceph-mon[35814]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:09:47.782 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:47 smithi110 ceph-mon[30548]: from='osd.8 [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:09:47.782 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:47 smithi110 ceph-mon[30548]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:09:47.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:47 smithi115 ceph-mon[35351]: from='osd.8 [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:09:47.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:47 smithi115 ceph-mon[35351]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-12T02:09:48.770 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:48 smithi110 ceph-mon[30548]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:48.770 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:48 smithi110 ceph-mon[30548]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:09:48.770 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:48 smithi110 ceph-mon[30548]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T02:09:48.770 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:48.770 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:48 smithi110 ceph-mon[30548]: from='osd.8 [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:09:48.770 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:48 smithi110 ceph-mon[30548]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:09:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:48 smithi115 ceph-mon[35351]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:48 smithi115 ceph-mon[35351]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:09:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:48 smithi115 ceph-mon[35351]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T02:09:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:48 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:48 smithi115 ceph-mon[35351]: from='osd.8 [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:09:48.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:48 smithi115 ceph-mon[35351]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:09:48.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:48 smithi136 ceph-mon[35814]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:48.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:48 smithi136 ceph-mon[35814]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-12T02:09:48.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:48 smithi136 ceph-mon[35814]: osdmap e56: 9 total, 8 up, 9 in 2024-09-12T02:09:48.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:48 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:48.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:48 smithi136 ceph-mon[35814]: from='osd.8 [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:09:48.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:48 smithi136 ceph-mon[35814]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:09:49.223 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:09:49.256 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi110:vg_nvme/lv_1 2024-09-12T02:09:49.408 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:09:48 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:09:48.997+0000 7f71e1c33640 -1 osd.8 0 waiting for initial osdmap 2024-09-12T02:09:49.409 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:09:49.006+0000 7f71d9a53640 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:09:49.633 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:09:49.773 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-12T02:09:49.773 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: osdmap e57: 9 total, 8 up, 9 in 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: Detected new or changed devices on smithi136 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi136 to 5696M 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:49.774 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:49.775 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:49 smithi110 ceph-mon[30548]: from='osd.8 ' entity='osd.8' 2024-09-12T02:09:49.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-12T02:09:49.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: osdmap e57: 9 total, 8 up, 9 in 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: Detected new or changed devices on smithi136 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi136 to 5696M 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:49 smithi115 ceph-mon[35351]: from='osd.8 ' entity='osd.8' 2024-09-12T02:09:49.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-12T02:09:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: osdmap e57: 9 total, 8 up, 9 in 2024-09-12T02:09:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: Detected new or changed devices on smithi136 2024-09-12T02:09:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:49.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:49.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:09:49.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi136 to 5696M 2024-09-12T02:09:49.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:49.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:49.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:09:49.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:09:49.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:49 smithi136 ceph-mon[35814]: from='osd.8 ' entity='osd.8' 2024-09-12T02:09:50.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.262+0000 7f7723e00640 1 -- 172.21.15.110:0/2198651892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7724102c40 msgr2=0x7f77241030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:50.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.262+0000 7f7723e00640 1 --2- 172.21.15.110:0/2198651892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7724102c40 0x7f77241030c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7710009900 tx=0x7f771002a410 comp rx=0 tx=0).stop 2024-09-12T02:09:50.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.263+0000 7f7723e00640 1 -- 172.21.15.110:0/2198651892 shutdown_connections 2024-09-12T02:09:50.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.263+0000 7f7723e00640 1 --2- 172.21.15.110:0/2198651892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7724103600 0x7f7724109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:50.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.263+0000 7f7723e00640 1 --2- 172.21.15.110:0/2198651892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7724102c40 0x7f77241030c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:50.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.263+0000 7f7723e00640 1 --2- 172.21.15.110:0/2198651892 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7724101a40 0x7f7724101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:50.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.263+0000 7f7723e00640 1 -- 172.21.15.110:0/2198651892 >> 172.21.15.110:0/2198651892 conn(0x7f77240fd1f0 msgr2=0x7f77240ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:09:50.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.263+0000 7f7723e00640 1 -- 172.21.15.110:0/2198651892 shutdown_connections 2024-09-12T02:09:50.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.263+0000 7f7723e00640 1 -- 172.21.15.110:0/2198651892 wait complete. 2024-09-12T02:09:50.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.264+0000 7f7723e00640 1 Processor -- start 2024-09-12T02:09:50.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.264+0000 7f7723e00640 1 -- start start 2024-09-12T02:09:50.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.264+0000 7f7723e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7724101a40 0x7f7724075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:50.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.264+0000 7f7723e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7724102c40 0x7f77240745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:50.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.264+0000 7f7723e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7724103600 0x7f7724074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:50.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.264+0000 7f7723e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f772410d6c0 con 0x7f7724102c40 2024-09-12T02:09:50.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.264+0000 7f7723e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f772410d540 con 0x7f7724101a40 2024-09-12T02:09:50.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.264+0000 7f7723e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f772410d840 con 0x7f7724103600 2024-09-12T02:09:50.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.265+0000 7f7722000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7724102c40 0x7f77240745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:50.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.265+0000 7f7722a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7724101a40 0x7f7724075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:50.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.265+0000 7f7723400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7724103600 0x7f7724074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:50.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.265+0000 7f7722000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7724102c40 0x7f77240745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36734/0 (socket says 172.21.15.110:36734) 2024-09-12T02:09:50.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.265+0000 7f7722000640 1 -- 172.21.15.110:0/2110038904 learned_addr learned my addr 172.21.15.110:0/2110038904 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:09:50.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.265+0000 7f7722a00640 1 -- 172.21.15.110:0/2110038904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7724103600 msgr2=0x7f7724074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:50.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.265+0000 7f7722a00640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7724103600 0x7f7724074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:50.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.265+0000 7f7722a00640 1 -- 172.21.15.110:0/2110038904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7724102c40 msgr2=0x7f77240745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:09:50.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.265+0000 7f7722a00640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7724102c40 0x7f77240745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:09:50.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.265+0000 7f7722a00640 1 -- 172.21.15.110:0/2110038904 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77240753e0 con 0x7f7724101a40 2024-09-12T02:09:50.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.265+0000 7f7723400640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7724103600 0x7f7724074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:09:50.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.265+0000 7f7722a00640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7724101a40 0x7f7724075f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7724102aa0 tx=0x7f771400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:50.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.266+0000 7f771b400640 1 -- 172.21.15.110:0/2110038904 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714017070 con 0x7f7724101a40 2024-09-12T02:09:50.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.266+0000 7f7723e00640 1 -- 172.21.15.110:0/2110038904 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77241a1e80 con 0x7f7724101a40 2024-09-12T02:09:50.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.266+0000 7f771b400640 1 -- 172.21.15.110:0/2110038904 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7714009c30 con 0x7f7724101a40 2024-09-12T02:09:50.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.266+0000 7f771b400640 1 -- 172.21.15.110:0/2110038904 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771400f620 con 0x7f7724101a40 2024-09-12T02:09:50.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.266+0000 7f7723e00640 1 -- 172.21.15.110:0/2110038904 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77241a2270 con 0x7f7724101a40 2024-09-12T02:09:50.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.267+0000 7f7723e00640 1 -- 172.21.15.110:0/2110038904 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7724108df0 con 0x7f7724101a40 2024-09-12T02:09:50.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.269+0000 7f771b400640 1 -- 172.21.15.110:0/2110038904 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f771401a070 con 0x7f7724101a40 2024-09-12T02:09:50.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.270+0000 7f771b400640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f77080a2b80 0x7f77080a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:09:50.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.270+0000 7f771b400640 1 -- 172.21.15.110:0/2110038904 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5858+0+0 (secure 0 0 0) 0x7f77140ce0f0 con 0x7f7724101a40 2024-09-12T02:09:50.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.270+0000 7f7722000640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f77080a2b80 0x7f77080a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:09:50.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.271+0000 7f7722000640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f77080a2b80 0x7f77080a5040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7710031440 tx=0x7f77100315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:09:50.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.272+0000 7f771b400640 1 -- 172.21.15.110:0/2110038904 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f771409b2f0 con 0x7f7724101a40 2024-09-12T02:09:50.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:09:50.458+0000 7f7723e00640 1 -- 172.21.15.110:0/2110038904 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7724062630 con 0x7f77080a2b80 2024-09-12T02:09:50.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:50 smithi115 ceph-mon[35351]: purged_snaps scrub starts 2024-09-12T02:09:50.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:50 smithi115 ceph-mon[35351]: purged_snaps scrub ok 2024-09-12T02:09:50.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:50 smithi115 ceph-mon[35351]: pgmap v199: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:50.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:50 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:50.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:50 smithi115 ceph-mon[35351]: osd.8 [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118] boot 2024-09-12T02:09:50.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:50 smithi115 ceph-mon[35351]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T02:09:50.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:50 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:50.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:50 smithi115 ceph-mon[35351]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T02:09:50.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:50 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:09:50.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:50 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:09:50.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:50 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:50.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:50 smithi136 ceph-mon[35814]: purged_snaps scrub starts 2024-09-12T02:09:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:50 smithi136 ceph-mon[35814]: purged_snaps scrub ok 2024-09-12T02:09:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:50 smithi136 ceph-mon[35814]: pgmap v199: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:50 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:50 smithi136 ceph-mon[35814]: osd.8 [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118] boot 2024-09-12T02:09:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:50 smithi136 ceph-mon[35814]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T02:09:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:50 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:50 smithi136 ceph-mon[35814]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T02:09:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:50 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:09:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:50 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:09:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:50 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:50.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:50 smithi110 ceph-mon[30548]: purged_snaps scrub starts 2024-09-12T02:09:50.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:50 smithi110 ceph-mon[30548]: purged_snaps scrub ok 2024-09-12T02:09:50.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:50 smithi110 ceph-mon[30548]: pgmap v199: 1 pgs: 1 peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-12T02:09:50.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:50 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:50.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:50 smithi110 ceph-mon[30548]: osd.8 [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118] boot 2024-09-12T02:09:50.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:50 smithi110 ceph-mon[30548]: osdmap e58: 9 total, 9 up, 9 in 2024-09-12T02:09:50.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:50 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:09:50.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:50 smithi110 ceph-mon[30548]: osdmap e59: 9 total, 9 up, 9 in 2024-09-12T02:09:50.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:50 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:09:50.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:50 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:09:50.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:50 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:09:51.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:51 smithi110 ceph-mon[30548]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:51.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:51 smithi110 ceph-mon[30548]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T02:09:51.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:51 smithi115 ceph-mon[35351]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:51.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:51 smithi115 ceph-mon[35351]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T02:09:51.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:51 smithi136 ceph-mon[35814]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi110:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:09:51.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:51 smithi136 ceph-mon[35814]: osdmap e60: 9 total, 9 up, 9 in 2024-09-12T02:09:52.659 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:52 smithi110 ceph-mon[30548]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:09:52.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:52 smithi115 ceph-mon[35351]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:09:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:52 smithi136 ceph-mon[35814]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:09:53.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:53 smithi110 ceph-mon[30548]: osdmap e61: 9 total, 9 up, 9 in 2024-09-12T02:09:53.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:53 smithi115 ceph-mon[35351]: osdmap e61: 9 total, 9 up, 9 in 2024-09-12T02:09:53.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:53 smithi136 ceph-mon[35814]: osdmap e61: 9 total, 9 up, 9 in 2024-09-12T02:09:54.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:54 smithi110 ceph-mon[30548]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:09:54.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:54 smithi110 ceph-mon[30548]: osdmap e62: 9 total, 9 up, 9 in 2024-09-12T02:09:54.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:54 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2272107947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4"}]: dispatch 2024-09-12T02:09:54.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:54 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2272107947' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4"}]': finished 2024-09-12T02:09:54.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:54 smithi110 ceph-mon[30548]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T02:09:54.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:54 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:09:54.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:54 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1642858190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:09:54.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:54 smithi115 ceph-mon[35351]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:09:54.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:54 smithi115 ceph-mon[35351]: osdmap e62: 9 total, 9 up, 9 in 2024-09-12T02:09:54.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:54 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2272107947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4"}]: dispatch 2024-09-12T02:09:54.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:54 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2272107947' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4"}]': finished 2024-09-12T02:09:54.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:54 smithi115 ceph-mon[35351]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T02:09:54.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:54 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:09:54.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:54 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1642858190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:09:54.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:54 smithi136 ceph-mon[35814]: pgmap v205: 1 pgs: 1 peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:09:54.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:54 smithi136 ceph-mon[35814]: osdmap e62: 9 total, 9 up, 9 in 2024-09-12T02:09:54.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:54 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2272107947' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4"}]: dispatch 2024-09-12T02:09:54.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:54 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2272107947' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4"}]': finished 2024-09-12T02:09:54.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:54 smithi136 ceph-mon[35814]: osdmap e63: 10 total, 9 up, 10 in 2024-09-12T02:09:54.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:54 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:09:54.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:54 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1642858190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:09:56.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:56 smithi115 ceph-mon[35351]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-12T02:09:56.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:56 smithi136 ceph-mon[35814]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-12T02:09:56.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:56 smithi110 ceph-mon[30548]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-12T02:09:58.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:09:58 smithi115 ceph-mon[35351]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:09:58.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:09:58 smithi136 ceph-mon[35814]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:09:58.915 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:09:58 smithi110 ceph-mon[30548]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-12T02:10:00.772 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:00 smithi110 ceph-mon[30548]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-12T02:10:00.772 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:00 smithi110 ceph-mon[30548]: overall HEALTH_OK 2024-09-12T02:10:00.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:00 smithi115 ceph-mon[35351]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-12T02:10:00.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:00 smithi115 ceph-mon[35351]: overall HEALTH_OK 2024-09-12T02:10:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:00 smithi136 ceph-mon[35814]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-12T02:10:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:00 smithi136 ceph-mon[35814]: overall HEALTH_OK 2024-09-12T02:10:02.632 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:02 smithi110 ceph-mon[30548]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:10:02.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:02 smithi115 ceph-mon[35351]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:10:02.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:02 smithi136 ceph-mon[35814]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:10:04.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:04 smithi110 ceph-mon[30548]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:10:04.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:04 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:10:04.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:04 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:04.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:04 smithi110 ceph-mon[30548]: Deploying daemon osd.9 on smithi110 2024-09-12T02:10:04.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:04 smithi115 ceph-mon[35351]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:10:04.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:04 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:10:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:04 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:04 smithi115 ceph-mon[35351]: Deploying daemon osd.9 on smithi110 2024-09-12T02:10:04.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:04 smithi136 ceph-mon[35814]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T02:10:04.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:04 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-12T02:10:04.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:04 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:04.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:04 smithi136 ceph-mon[35814]: Deploying daemon osd.9 on smithi110 2024-09-12T02:10:06.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:06 smithi115 ceph-mon[35351]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:06.843 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:06 smithi110 ceph-mon[30548]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:06.912 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:06 smithi136 ceph-mon[35814]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:08.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:08 smithi115 ceph-mon[35351]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:08.895 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:08 smithi110 ceph-mon[30548]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:08.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:08 smithi136 ceph-mon[35814]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:10.603 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:10 smithi110 ceph-mon[30548]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:10.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:10 smithi115 ceph-mon[35351]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:10 smithi136 ceph-mon[35814]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:11.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:11.806 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:10:11.806 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:11.806 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:11.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:10:11.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:11.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:12 smithi115 ceph-mon[35351]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:12.871 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:12 smithi110 ceph-mon[30548]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:12.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:12 smithi136 ceph-mon[35814]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:14.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:14 smithi110 ceph-mon[30548]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:14.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:14 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:14.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:14 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:14.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:14 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:14.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:14 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:10:14.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:14 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:14.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:14 smithi115 ceph-mon[35351]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:14.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:14 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:14.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:14 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:14.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:14 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:14.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:14 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:10:14.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:14 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:14 smithi136 ceph-mon[35814]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:14 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:14 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:14 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:14.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:14 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:10:14.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:14 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:15.948 INFO:teuthology.orchestra.run.smithi110.stdout:Created osd(s) 9 on host 'smithi110' 2024-09-12T02:10:15.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.948+0000 7f771b400640 1 -- 172.21.15.110:0/2110038904 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7724062630 con 0x7f77080a2b80 2024-09-12T02:10:15.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.950+0000 7f7723e00640 1 -- 172.21.15.110:0/2110038904 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f77080a2b80 msgr2=0x7f77080a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:10:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.950+0000 7f7723e00640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f77080a2b80 0x7f77080a5040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7710031440 tx=0x7f77100315b0 comp rx=0 tx=0).stop 2024-09-12T02:10:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.950+0000 7f7723e00640 1 -- 172.21.15.110:0/2110038904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7724101a40 msgr2=0x7f7724075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:10:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.950+0000 7f7723e00640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7724101a40 0x7f7724075f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7724102aa0 tx=0x7f771400dde0 comp rx=0 tx=0).stop 2024-09-12T02:10:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.950+0000 7f7723e00640 1 -- 172.21.15.110:0/2110038904 shutdown_connections 2024-09-12T02:10:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.950+0000 7f7723e00640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f77080a2b80 0x7f77080a5040 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.950+0000 7f7723e00640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7724103600 0x7f7724074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.950+0000 7f7723e00640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7724102c40 0x7f77240745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.950+0000 7f7723e00640 1 --2- 172.21.15.110:0/2110038904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7724101a40 0x7f7724075f90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.950+0000 7f7723e00640 1 -- 172.21.15.110:0/2110038904 >> 172.21.15.110:0/2110038904 conn(0x7f77240fd1f0 msgr2=0x7f7724105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:10:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.950+0000 7f7723e00640 1 -- 172.21.15.110:0/2110038904 shutdown_connections 2024-09-12T02:10:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:10:15.950+0000 7f7723e00640 1 -- 172.21.15.110:0/2110038904 wait complete. 2024-09-12T02:10:16.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:16 smithi110 ceph-mon[30548]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:16.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:16 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:10:16.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:16 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:16.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:16 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:16.771 DEBUG:teuthology.orchestra.run.smithi110:osd.9> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.9.service 2024-09-12T02:10:16.775 INFO:tasks.cephadm:Deploying osd.10 on smithi115 with /dev/vg_nvme/lv_1... 2024-09-12T02:10:16.775 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:16 smithi115 ceph-mon[35351]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:16 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:16 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:16.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:16 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:16.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:16 smithi136 ceph-mon[35814]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:16.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:16 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:10:16.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:16 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:16.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:16 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:17.034 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:10:17.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:17 smithi115 ceph-mon[35351]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:10:17.811 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:17 smithi110 ceph-mon[30548]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:10:17.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:17 smithi136 ceph-mon[35814]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-12T02:10:18.740 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:18 smithi115 ceph-mon[35351]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:18.740 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:18 smithi115 ceph-mon[35351]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:10:18.740 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:18 smithi115 ceph-mon[35351]: osdmap e64: 10 total, 9 up, 10 in 2024-09-12T02:10:18.740 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:18 smithi115 ceph-mon[35351]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:10:18.741 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:18 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:18.845 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:18 smithi110 ceph-mon[30548]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:18.845 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:18 smithi110 ceph-mon[30548]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:10:18.845 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:18 smithi110 ceph-mon[30548]: osdmap e64: 10 total, 9 up, 10 in 2024-09-12T02:10:18.845 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:18 smithi110 ceph-mon[30548]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:10:18.845 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:18 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:18.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:18 smithi136 ceph-mon[35814]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:18.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:18 smithi136 ceph-mon[35814]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-12T02:10:18.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:18 smithi136 ceph-mon[35814]: osdmap e64: 10 total, 9 up, 10 in 2024-09-12T02:10:18.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:18 smithi136 ceph-mon[35814]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]: dispatch 2024-09-12T02:10:18.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:18 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:19.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:10:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:10:19.100+0000 7f9e84a00640 -1 osd.9 0 waiting for initial osdmap 2024-09-12T02:10:19.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:10:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:10:19.121+0000 7f9e7aa00640 -1 osd.9 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:10:19.786 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:19 smithi115 ceph-mon[35351]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-12T02:10:19.786 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:19 smithi115 ceph-mon[35351]: osdmap e65: 10 total, 9 up, 10 in 2024-09-12T02:10:19.787 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:19 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:19.787 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:19 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:19.787 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:19 smithi115 ceph-mon[35351]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' 2024-09-12T02:10:19.789 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-09-12T02:10:19.817 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi115:vg_nvme/lv_1 2024-09-12T02:10:19.877 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:19 smithi110 ceph-mon[30548]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-12T02:10:19.877 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:19 smithi110 ceph-mon[30548]: osdmap e65: 10 total, 9 up, 10 in 2024-09-12T02:10:19.877 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:19 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:19.877 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:19 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:19.877 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:19 smithi110 ceph-mon[30548]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' 2024-09-12T02:10:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:19 smithi136 ceph-mon[35814]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi110", "root=default"]}]': finished 2024-09-12T02:10:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:19 smithi136 ceph-mon[35814]: osdmap e65: 10 total, 9 up, 10 in 2024-09-12T02:10:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:19 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:19 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:19 smithi136 ceph-mon[35814]: from='osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753]' entity='osd.9' 2024-09-12T02:10:20.104 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:10:20.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.591+0000 7f9198c7c640 1 -- 172.21.15.115:0/2300956979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9194102690 msgr2=0x7f9194108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:10:20.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.591+0000 7f9198c7c640 1 --2- 172.21.15.115:0/2300956979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9194102690 0x7f9194108f20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f918c009ca0 tx=0x7f918c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:10:20.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.591+0000 7f9198c7c640 1 -- 172.21.15.115:0/2300956979 shutdown_connections 2024-09-12T02:10:20.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.591+0000 7f9198c7c640 1 --2- 172.21.15.115:0/2300956979 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9194102690 0x7f9194108f20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:20.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.591+0000 7f9198c7c640 1 --2- 172.21.15.115:0/2300956979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9194101cd0 0x7f9194102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:20.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.591+0000 7f9198c7c640 1 --2- 172.21.15.115:0/2300956979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9194100ad0 0x7f9194100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:20.607 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.591+0000 7f9198c7c640 1 -- 172.21.15.115:0/2300956979 >> 172.21.15.115:0/2300956979 conn(0x7f91940fc280 msgr2=0x7f91940fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:10:20.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.591+0000 7f9198c7c640 1 -- 172.21.15.115:0/2300956979 shutdown_connections 2024-09-12T02:10:20.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.591+0000 7f9198c7c640 1 -- 172.21.15.115:0/2300956979 wait complete. 2024-09-12T02:10:20.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.591+0000 7f9198c7c640 1 Processor -- start 2024-09-12T02:10:20.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9198c7c640 1 -- start start 2024-09-12T02:10:20.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9198c7c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9194100ad0 0x7f9194197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:10:20.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9198c7c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9194101cd0 0x7f91941983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:10:20.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9198c7c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9194102690 0x7f919419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:10:20.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9198c7c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f919410c750 con 0x7f9194100ad0 2024-09-12T02:10:20.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9198c7c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f919410c5d0 con 0x7f9194102690 2024-09-12T02:10:20.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9198c7c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f919410c8d0 con 0x7f9194101cd0 2024-09-12T02:10:20.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9192d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9194102690 0x7f919419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:10:20.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9192d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9194102690 0x7f919419f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:42208/0 (socket says 172.21.15.115:42208) 2024-09-12T02:10:20.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9192d9d640 1 -- 172.21.15.115:0/1390150665 learned_addr learned my addr 172.21.15.115:0/1390150665 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-09-12T02:10:20.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f919259c640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9194100ad0 0x7f9194197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:10:20.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9191d9b640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9194101cd0 0x7f91941983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:10:20.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9192d9d640 1 -- 172.21.15.115:0/1390150665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9194101cd0 msgr2=0x7f91941983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:10:20.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9192d9d640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9194101cd0 0x7f91941983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:20.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9192d9d640 1 -- 172.21.15.115:0/1390150665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9194100ad0 msgr2=0x7f9194197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:10:20.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9192d9d640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9194100ad0 0x7f9194197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:20.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9192d9d640 1 -- 172.21.15.115:0/1390150665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919419fab0 con 0x7f9194102690 2024-09-12T02:10:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f919259c640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9194100ad0 0x7f9194197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:10:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9192d9d640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9194102690 0x7f919419f440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f918c031ae0 tx=0x7f918c031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:10:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f91837fe640 1 -- 172.21.15.115:0/1390150665 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c003c30 con 0x7f9194102690 2024-09-12T02:10:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f91837fe640 1 -- 172.21.15.115:0/1390150665 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f918c003dd0 con 0x7f9194102690 2024-09-12T02:10:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9198c7c640 1 -- 172.21.15.115:0/1390150665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919419fd40 con 0x7f9194102690 2024-09-12T02:10:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f91837fe640 1 -- 172.21.15.115:0/1390150665 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c02fcb0 con 0x7f9194102690 2024-09-12T02:10:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.592+0000 7f9198c7c640 1 -- 172.21.15.115:0/1390150665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91941a0220 con 0x7f9194102690 2024-09-12T02:10:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.593+0000 7f9198c7c640 1 -- 172.21.15.115:0/1390150665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91941a0450 con 0x7f9194102690 2024-09-12T02:10:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.595+0000 7f91837fe640 1 -- 172.21.15.115:0/1390150665 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f918c004050 con 0x7f9194102690 2024-09-12T02:10:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.595+0000 7f91837fe640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f917c0a2bb0 0x7f917c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:10:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.595+0000 7f91837fe640 1 -- 172.21.15.115:0/1390150665 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6261+0+0 (secure 0 0 0) 0x7f918c0efde0 con 0x7f9194102690 2024-09-12T02:10:20.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.595+0000 7f919259c640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f917c0a2bb0 0x7f917c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:10:20.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.596+0000 7f919259c640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f917c0a2bb0 0x7f917c0a5070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9194101b30 tx=0x7f9188005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:10:20.611 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.598+0000 7f91837fe640 1 -- 172.21.15.115:0/1390150665 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f918c0bd540 con 0x7f9194102690 2024-09-12T02:10:20.775 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:20.775+0000 7f9198c7c640 1 -- 172.21.15.115:0/1390150665 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f91941a0620 con 0x7f917c0a2bb0 2024-09-12T02:10:20.775 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:20 smithi115 ceph-mon[35351]: purged_snaps scrub starts 2024-09-12T02:10:20.775 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:20 smithi115 ceph-mon[35351]: purged_snaps scrub ok 2024-09-12T02:10:20.775 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:20 smithi115 ceph-mon[35351]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:20.775 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:20 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:20.775 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:20 smithi115 ceph-mon[35351]: osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753] boot 2024-09-12T02:10:20.775 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:20 smithi115 ceph-mon[35351]: osdmap e66: 10 total, 10 up, 10 in 2024-09-12T02:10:20.775 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:20 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:20.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:20 smithi136 ceph-mon[35814]: purged_snaps scrub starts 2024-09-12T02:10:20.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:20 smithi136 ceph-mon[35814]: purged_snaps scrub ok 2024-09-12T02:10:20.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:20 smithi136 ceph-mon[35814]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:20.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:20 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:20.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:20 smithi136 ceph-mon[35814]: osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753] boot 2024-09-12T02:10:20.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:20 smithi136 ceph-mon[35814]: osdmap e66: 10 total, 10 up, 10 in 2024-09-12T02:10:20.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:20 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:20 smithi110 ceph-mon[30548]: purged_snaps scrub starts 2024-09-12T02:10:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:20 smithi110 ceph-mon[30548]: purged_snaps scrub ok 2024-09-12T02:10:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:20 smithi110 ceph-mon[30548]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-12T02:10:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:20 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:20 smithi110 ceph-mon[30548]: osd.9 [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753] boot 2024-09-12T02:10:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:20 smithi110 ceph-mon[30548]: osdmap e66: 10 total, 10 up, 10 in 2024-09-12T02:10:20.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:20 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:10:21.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: Detected new or changed devices on smithi110 2024-09-12T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi110 to 4272M 2024-09-12T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:10:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: osdmap e67: 10 total, 10 up, 10 in 2024-09-12T02:10:21.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:21 smithi115 ceph-mon[35351]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:21.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: Detected new or changed devices on smithi110 2024-09-12T02:10:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi110 to 4272M 2024-09-12T02:10:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:21.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:10:21.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:21.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:10:21.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:10:21.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:10:21.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:21.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: osdmap e67: 10 total, 10 up, 10 in 2024-09-12T02:10:21.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:21 smithi110 ceph-mon[30548]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:22.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: Detected new or changed devices on smithi110 2024-09-12T02:10:22.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:22.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:22.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:22.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:22.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:22.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:22.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi110 to 4272M 2024-09-12T02:10:22.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:22.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:22.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:10:22.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:22.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi115:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:10:22.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:10:22.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:10:22.161 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:22.161 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: osdmap e67: 10 total, 10 up, 10 in 2024-09-12T02:10:22.161 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:21 smithi136 ceph-mon[35814]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 308 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:23.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:23 smithi115 ceph-mon[35351]: from='client.? 172.21.15.115:0/4121400454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9409f555-8139-4a02-9fe2-446f30072aca"}]: dispatch 2024-09-12T02:10:23.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:23 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9409f555-8139-4a02-9fe2-446f30072aca"}]: dispatch 2024-09-12T02:10:23.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:23 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9409f555-8139-4a02-9fe2-446f30072aca"}]': finished 2024-09-12T02:10:23.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:23 smithi115 ceph-mon[35351]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T02:10:23.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:23 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:23.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:23 smithi136 ceph-mon[35814]: from='client.? 172.21.15.115:0/4121400454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9409f555-8139-4a02-9fe2-446f30072aca"}]: dispatch 2024-09-12T02:10:23.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:23 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9409f555-8139-4a02-9fe2-446f30072aca"}]: dispatch 2024-09-12T02:10:23.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:23 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9409f555-8139-4a02-9fe2-446f30072aca"}]': finished 2024-09-12T02:10:23.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:23 smithi136 ceph-mon[35814]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T02:10:23.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:23 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:23.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:23 smithi110 ceph-mon[30548]: from='client.? 172.21.15.115:0/4121400454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9409f555-8139-4a02-9fe2-446f30072aca"}]: dispatch 2024-09-12T02:10:23.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:23 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9409f555-8139-4a02-9fe2-446f30072aca"}]: dispatch 2024-09-12T02:10:23.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:23 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9409f555-8139-4a02-9fe2-446f30072aca"}]': finished 2024-09-12T02:10:23.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:23 smithi110 ceph-mon[30548]: osdmap e68: 11 total, 10 up, 11 in 2024-09-12T02:10:23.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:23 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:24.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:24 smithi115 ceph-mon[35351]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:24.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:24 smithi115 ceph-mon[35351]: from='client.? 172.21.15.115:0/1313841176' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:10:24.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:24 smithi136 ceph-mon[35814]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:24.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:24 smithi136 ceph-mon[35814]: from='client.? 172.21.15.115:0/1313841176' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:10:24.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:24 smithi110 ceph-mon[30548]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:24.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:24 smithi110 ceph-mon[30548]: from='client.? 172.21.15.115:0/1313841176' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:10:26.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:26 smithi115 ceph-mon[35351]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:26.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:26 smithi136 ceph-mon[35814]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:26.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:26 smithi110 ceph-mon[30548]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:28.714 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:28 smithi115 ceph-mon[35351]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:28.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:28 smithi136 ceph-mon[35814]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:28.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:28 smithi110 ceph-mon[30548]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:30.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:30 smithi115 ceph-mon[35351]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:30.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:30 smithi136 ceph-mon[35814]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:30.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:30 smithi110 ceph-mon[30548]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:32.710 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:32 smithi115 ceph-mon[35351]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:32.710 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:32 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:10:32.711 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:32 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:32.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:32 smithi136 ceph-mon[35814]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:32.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:32 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:10:32.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:32 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:32.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:32 smithi110 ceph-mon[30548]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:32.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:32 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-12T02:10:32.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:32 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:33.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:33 smithi115 ceph-mon[35351]: Deploying daemon osd.10 on smithi115 2024-09-12T02:10:33.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:33 smithi136 ceph-mon[35814]: Deploying daemon osd.10 on smithi115 2024-09-12T02:10:33.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:33 smithi110 ceph-mon[30548]: Deploying daemon osd.10 on smithi115 2024-09-12T02:10:34.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:34 smithi115 ceph-mon[35351]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:34.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:34 smithi136 ceph-mon[35814]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:34.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:34 smithi110 ceph-mon[30548]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:36.627 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:36 smithi115 ceph-mon[35351]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:36.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:36 smithi136 ceph-mon[35814]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:36.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:36 smithi110 ceph-mon[30548]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:38.665 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:38 smithi115 ceph-mon[35351]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:38.665 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:38 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:10:38.665 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:38 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:38.665 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:38 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:38.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:38 smithi110 ceph-mon[30548]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:38.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:38 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:10:38.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:38 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:38.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:38 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:38.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:38 smithi136 ceph-mon[35814]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:38.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:38 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:10:38.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:38 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:38.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:38 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:40.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:40 smithi115 ceph-mon[35351]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:40.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:40 smithi136 ceph-mon[35814]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:40.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:40 smithi110 ceph-mon[30548]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:41.446 INFO:teuthology.orchestra.run.smithi115.stdout:Created osd(s) 10 on host 'smithi115' 2024-09-12T02:10:41.446 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.445+0000 7f91837fe640 1 -- 172.21.15.115:0/1390150665 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f91941a0620 con 0x7f917c0a2bb0 2024-09-12T02:10:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.447+0000 7f9198c7c640 1 -- 172.21.15.115:0/1390150665 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f917c0a2bb0 msgr2=0x7f917c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:10:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.447+0000 7f9198c7c640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f917c0a2bb0 0x7f917c0a5070 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9194101b30 tx=0x7f9188005f90 comp rx=0 tx=0).stop 2024-09-12T02:10:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.447+0000 7f9198c7c640 1 -- 172.21.15.115:0/1390150665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9194102690 msgr2=0x7f919419f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:10:41.448 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.447+0000 7f9198c7c640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9194102690 0x7f919419f440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f918c031ae0 tx=0x7f918c031ee0 comp rx=0 tx=0).stop 2024-09-12T02:10:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.447+0000 7f9198c7c640 1 -- 172.21.15.115:0/1390150665 shutdown_connections 2024-09-12T02:10:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.447+0000 7f9198c7c640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f917c0a2bb0 0x7f917c0a5070 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.447+0000 7f9198c7c640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9194102690 0x7f919419f440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.447+0000 7f9198c7c640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9194101cd0 0x7f91941983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.447+0000 7f9198c7c640 1 --2- 172.21.15.115:0/1390150665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9194100ad0 0x7f9194197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.447+0000 7f9198c7c640 1 -- 172.21.15.115:0/1390150665 >> 172.21.15.115:0/1390150665 conn(0x7f91940fc280 msgr2=0x7f9194069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:10:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.447+0000 7f9198c7c640 1 -- 172.21.15.115:0/1390150665 shutdown_connections 2024-09-12T02:10:41.449 INFO:teuthology.orchestra.run.smithi115.stderr:2024-09-12T02:10:41.447+0000 7f9198c7c640 1 -- 172.21.15.115:0/1390150665 wait complete. 2024-09-12T02:10:42.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:42.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:10:42.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:41 smithi115 ceph-mon[35351]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:42.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:10:42.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:41 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.129 DEBUG:teuthology.orchestra.run.smithi115:osd.10> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.10.service 2024-09-12T02:10:42.131 INFO:tasks.cephadm:Deploying osd.11 on smithi136 with /dev/vg_nvme/lv_1... 2024-09-12T02:10:42.131 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-12T02:10:42.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:42.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:10:42.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:41 smithi136 ceph-mon[35814]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:42.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:10:42.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:41 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:42.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:10:42.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:41 smithi110 ceph-mon[30548]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:42.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:10:42.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:41 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:42.386 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:10:43.864 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:10:43 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:10:43.817+0000 7f914f16a640 -1 osd.10 0 log_to_monitors true 2024-09-12T02:10:44.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:44 smithi136 ceph-mon[35814]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:44.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:44 smithi136 ceph-mon[35814]: from='osd.10 [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:10:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:44 smithi136 ceph-mon[35814]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:10:44.725 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:44 smithi115 ceph-mon[35351]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:44.725 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:44 smithi115 ceph-mon[35351]: from='osd.10 [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:10:44.725 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:44 smithi115 ceph-mon[35351]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:10:44.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:44 smithi110 ceph-mon[30548]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:44.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:44 smithi110 ceph-mon[30548]: from='osd.10 [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:10:44.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:44 smithi110 ceph-mon[30548]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-12T02:10:45.107 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-09-12T02:10:45.133 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_1 2024-09-12T02:10:45.424 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:10:45.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:10:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='osd.10 [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:10:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: osdmap e69: 11 total, 10 up, 11 in 2024-09-12T02:10:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:10:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:45.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:45.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:45.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:10:45.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:45.808 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:10:45.808 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='osd.10 [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: osdmap e69: 11 total, 10 up, 11 in 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:10:45.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:45.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.890+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/2115684457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f18102690 msgr2=0x7f2f18108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:10:45.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.890+0000 7f2f1ffeb640 1 --2- 172.21.15.136:0/2115684457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f18102690 0x7f2f18108f20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009ca0 tx=0x7f2f1002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:10:45.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.890+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/2115684457 shutdown_connections 2024-09-12T02:10:45.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.890+0000 7f2f1ffeb640 1 --2- 172.21.15.136:0/2115684457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f18102690 0x7f2f18108f20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:45.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.890+0000 7f2f1ffeb640 1 --2- 172.21.15.136:0/2115684457 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f18101cd0 0x7f2f18102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:45.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.890+0000 7f2f1ffeb640 1 --2- 172.21.15.136:0/2115684457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18100ad0 0x7f2f18100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:45.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.890+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/2115684457 >> 172.21.15.136:0/2115684457 conn(0x7f2f180fc280 msgr2=0x7f2f180fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:10:45.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.890+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/2115684457 shutdown_connections 2024-09-12T02:10:45.925 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.890+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/2115684457 wait complete. 2024-09-12T02:10:45.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.891+0000 7f2f1ffeb640 1 Processor -- start 2024-09-12T02:10:45.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.891+0000 7f2f1ffeb640 1 -- start start 2024-09-12T02:10:45.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.891+0000 7f2f1ffeb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f18100ad0 0x7f2f18196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:10:45.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.891+0000 7f2f1ffeb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f18101cd0 0x7f2f181972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:10:45.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.891+0000 7f2f1ffeb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18102690 0x7f2f1819e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:10:45.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.891+0000 7f2f1ffeb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1810c750 con 0x7f2f18102690 2024-09-12T02:10:45.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.891+0000 7f2f1ffeb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1810c5d0 con 0x7f2f18100ad0 2024-09-12T02:10:45.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.891+0000 7f2f1ffeb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1810c8d0 con 0x7f2f18101cd0 2024-09-12T02:10:45.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.891+0000 7f2f1d586640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f18101cd0 0x7f2f181972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:10:45.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.891+0000 7f2f1d586640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f18101cd0 0x7f2f181972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:44268/0 (socket says 172.21.15.136:44268) 2024-09-12T02:10:45.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.891+0000 7f2f1d586640 1 -- 172.21.15.136:0/1133211998 learned_addr learned my addr 172.21.15.136:0/1133211998 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-12T02:10:45.926 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.891+0000 7f2f1dd87640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f18100ad0 0x7f2f18196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:10:45.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f1e588640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18102690 0x7f2f1819e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:10:45.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f1d586640 1 -- 172.21.15.136:0/1133211998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f18100ad0 msgr2=0x7f2f18196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:10:45.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f1d586640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f18100ad0 0x7f2f18196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:45.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f1d586640 1 -- 172.21.15.136:0/1133211998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18102690 msgr2=0x7f2f1819e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:10:45.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f1d586640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18102690 0x7f2f1819e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:10:45.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f1d586640 1 -- 172.21.15.136:0/1133211998 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1819e9d0 con 0x7f2f18101cd0 2024-09-12T02:10:45.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f1e588640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18102690 0x7f2f1819e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:10:45.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f1d586640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f18101cd0 0x7f2f181972e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800d770 tx=0x7f2f0800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:10:45.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f0effd640 1 -- 172.21.15.136:0/1133211998 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08017070 con 0x7f2f18101cd0 2024-09-12T02:10:45.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f0effd640 1 -- 172.21.15.136:0/1133211998 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f08005500 con 0x7f2f18101cd0 2024-09-12T02:10:45.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/1133211998 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1819ecc0 con 0x7f2f18101cd0 2024-09-12T02:10:45.927 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f0effd640 1 -- 172.21.15.136:0/1133211998 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f08004e00 con 0x7f2f18101cd0 2024-09-12T02:10:45.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.892+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/1133211998 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1819f1b0 con 0x7f2f18101cd0 2024-09-12T02:10:45.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.893+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/1133211998 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f18107f20 con 0x7f2f18101cd0 2024-09-12T02:10:45.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.894+0000 7f2f0effd640 1 -- 172.21.15.136:0/1133211998 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2f08004fa0 con 0x7f2f18101cd0 2024-09-12T02:10:45.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.895+0000 7f2f0effd640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2f040a2c30 0x7f2f040a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:10:45.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.895+0000 7f2f0effd640 1 -- 172.21.15.136:0/1133211998 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6414+0+0 (secure 0 0 0) 0x7f2f080ce280 con 0x7f2f18101cd0 2024-09-12T02:10:45.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.895+0000 7f2f1dd87640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2f040a2c30 0x7f2f040a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:10:45.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.896+0000 7f2f1dd87640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2f040a2c30 0x7f2f040a50f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2f18101b30 tx=0x7f2f1400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:10:45.928 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:45.899+0000 7f2f0effd640 1 -- 172.21.15.136:0/1133211998 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f0809b950 con 0x7f2f18101cd0 2024-09-12T02:10:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-12T02:10:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='osd.10 [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:10:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: osdmap e69: 11 total, 10 up, 11 in 2024-09-12T02:10:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]: dispatch 2024-09-12T02:10:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:10:45.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:45.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:45.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:10:45.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:10:46.077 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:10:46.076+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/1133211998 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2f18062630 con 0x7f2f040a2c30 2024-09-12T02:10:46.494 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:10:46.183+0000 7f914b0ed640 -1 osd.10 0 waiting for initial osdmap 2024-09-12T02:10:46.495 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:10:46.194+0000 7f9142f0d640 -1 osd.10 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:10:46.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-mon[35351]: Detected new or changed devices on smithi115 2024-09-12T02:10:46.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi115 to 4272M 2024-09-12T02:10:46.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-mon[35351]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:46.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-mon[35351]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-12T02:10:46.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-mon[35351]: osdmap e70: 11 total, 10 up, 11 in 2024-09-12T02:10:46.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:46.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:46.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:10:46.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:10:46.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:46.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:46 smithi115 ceph-mon[35351]: from='osd.10 ' entity='osd.10' 2024-09-12T02:10:46.820 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:46 smithi136 ceph-mon[35814]: Detected new or changed devices on smithi115 2024-09-12T02:10:46.820 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:46 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi115 to 4272M 2024-09-12T02:10:46.820 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:46 smithi136 ceph-mon[35814]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:46.820 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:46 smithi136 ceph-mon[35814]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-12T02:10:46.820 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:46 smithi136 ceph-mon[35814]: osdmap e70: 11 total, 10 up, 11 in 2024-09-12T02:10:46.820 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:46.820 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:46.820 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:10:46.820 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:10:46.821 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:46.821 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:46 smithi136 ceph-mon[35814]: from='osd.10 ' entity='osd.10' 2024-09-12T02:10:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:46 smithi110 ceph-mon[30548]: Detected new or changed devices on smithi115 2024-09-12T02:10:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:46 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi115 to 4272M 2024-09-12T02:10:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:46 smithi110 ceph-mon[30548]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:46 smithi110 ceph-mon[30548]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi115", "root=default"]}]': finished 2024-09-12T02:10:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:46 smithi110 ceph-mon[30548]: osdmap e70: 11 total, 10 up, 11 in 2024-09-12T02:10:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T02:10:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T02:10:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:46 smithi110 ceph-mon[30548]: from='osd.10 ' entity='osd.10' 2024-09-12T02:10:47.760 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:47 smithi136 ceph-mon[35814]: purged_snaps scrub starts 2024-09-12T02:10:47.760 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:47 smithi136 ceph-mon[35814]: purged_snaps scrub ok 2024-09-12T02:10:47.760 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:47 smithi136 ceph-mon[35814]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:10:47.760 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:47 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:47.760 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:47 smithi136 ceph-mon[35814]: osd.10 [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814] boot 2024-09-12T02:10:47.760 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:47 smithi136 ceph-mon[35814]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T02:10:47.760 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:47 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:47.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:47 smithi115 ceph-mon[35351]: purged_snaps scrub starts 2024-09-12T02:10:47.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:47 smithi115 ceph-mon[35351]: purged_snaps scrub ok 2024-09-12T02:10:47.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:47 smithi115 ceph-mon[35351]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:10:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:47 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:47 smithi115 ceph-mon[35351]: osd.10 [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814] boot 2024-09-12T02:10:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:47 smithi115 ceph-mon[35351]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T02:10:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:47 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:47.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:47 smithi110 ceph-mon[30548]: purged_snaps scrub starts 2024-09-12T02:10:47.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:47 smithi110 ceph-mon[30548]: purged_snaps scrub ok 2024-09-12T02:10:47.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:47 smithi110 ceph-mon[30548]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:10:47.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:47 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:47.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:47 smithi110 ceph-mon[30548]: osd.10 [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814] boot 2024-09-12T02:10:47.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:47 smithi110 ceph-mon[30548]: osdmap e71: 11 total, 11 up, 11 in 2024-09-12T02:10:47.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:47 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:10:48.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:48 smithi136 ceph-mon[35814]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:48.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:48 smithi136 ceph-mon[35814]: osdmap e72: 11 total, 11 up, 11 in 2024-09-12T02:10:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:48 smithi115 ceph-mon[35351]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:48 smithi115 ceph-mon[35351]: osdmap e72: 11 total, 11 up, 11 in 2024-09-12T02:10:48.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:48 smithi110 ceph-mon[30548]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 313 MiB used, 894 GiB / 894 GiB avail 2024-09-12T02:10:48.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:48 smithi110 ceph-mon[30548]: osdmap e72: 11 total, 11 up, 11 in 2024-09-12T02:10:49.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:49 smithi110 ceph-mon[30548]: from='client.? 172.21.15.136:0/1338873363' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16"}]: dispatch 2024-09-12T02:10:49.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:49 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16"}]: dispatch 2024-09-12T02:10:49.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:49 smithi110 ceph-mon[30548]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16"}]': finished 2024-09-12T02:10:49.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:49 smithi110 ceph-mon[30548]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:10:49.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:49 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:10:49.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:49 smithi110 ceph-mon[30548]: from='client.? 172.21.15.136:0/2852885762' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:10:49.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:49 smithi115 ceph-mon[35351]: from='client.? 172.21.15.136:0/1338873363' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16"}]: dispatch 2024-09-12T02:10:49.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:49 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16"}]: dispatch 2024-09-12T02:10:49.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:49 smithi115 ceph-mon[35351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16"}]': finished 2024-09-12T02:10:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:49 smithi115 ceph-mon[35351]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:10:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:49 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:10:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:49 smithi115 ceph-mon[35351]: from='client.? 172.21.15.136:0/2852885762' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:10:49.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:49 smithi136 ceph-mon[35814]: from='client.? 172.21.15.136:0/1338873363' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16"}]: dispatch 2024-09-12T02:10:49.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:49 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16"}]: dispatch 2024-09-12T02:10:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:49 smithi136 ceph-mon[35814]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16"}]': finished 2024-09-12T02:10:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:49 smithi136 ceph-mon[35814]: osdmap e73: 12 total, 11 up, 12 in 2024-09-12T02:10:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:49 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:10:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:49 smithi136 ceph-mon[35814]: from='client.? 172.21.15.136:0/2852885762' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T02:10:50.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:50 smithi136 ceph-mon[35814]: pgmap v245: 1 pgs: 1 remapped+peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:10:50.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:50 smithi136 ceph-mon[35814]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T02:10:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:50 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:10:50.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:50 smithi110 ceph-mon[30548]: pgmap v245: 1 pgs: 1 remapped+peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:10:50.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:50 smithi110 ceph-mon[30548]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T02:10:50.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:50 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:10:51.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:50 smithi115 ceph-mon[35351]: pgmap v245: 1 pgs: 1 remapped+peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:10:51.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:50 smithi115 ceph-mon[35351]: osdmap e74: 12 total, 11 up, 12 in 2024-09-12T02:10:51.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:50 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:10:51.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:51 smithi136 ceph-mon[35814]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T02:10:51.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:51 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:10:51.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:51 smithi110 ceph-mon[30548]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T02:10:51.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:51 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:51 smithi115 ceph-mon[35351]: osdmap e75: 12 total, 11 up, 12 in 2024-09-12T02:10:52.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:51 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:10:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:52 smithi136 ceph-mon[35814]: pgmap v248: 1 pgs: 1 remapped+peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:10:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:52 smithi110 ceph-mon[30548]: pgmap v248: 1 pgs: 1 remapped+peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:10:53.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:52 smithi115 ceph-mon[35351]: pgmap v248: 1 pgs: 1 remapped+peering; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:10:54.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:54 smithi136 ceph-mon[35814]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 346 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:10:54.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:54 smithi110 ceph-mon[30548]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 346 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:10:55.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:54 smithi115 ceph-mon[35351]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 346 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:10:56.801 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:56 smithi136 ceph-mon[35814]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T02:10:56.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:56 smithi110 ceph-mon[30548]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T02:10:57.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:56 smithi115 ceph-mon[35351]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-12T02:10:57.761 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:57 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:10:57.761 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:57 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:57 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:10:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:57 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:58.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:57 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-12T02:10:58.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:57 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:10:58.926 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:58 smithi136 ceph-mon[35814]: Deploying daemon osd.11 on smithi136 2024-09-12T02:10:58.926 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:10:58 smithi136 ceph-mon[35814]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:10:58.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:58 smithi110 ceph-mon[30548]: Deploying daemon osd.11 on smithi136 2024-09-12T02:10:58.944 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:10:58 smithi110 ceph-mon[30548]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:10:58.948 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:58 smithi115 ceph-mon[35351]: Deploying daemon osd.11 on smithi136 2024-09-12T02:10:58.949 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:10:58 smithi115 ceph-mon[35351]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-12T02:11:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:00 smithi136 ceph-mon[35814]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T02:11:00.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:00 smithi110 ceph-mon[30548]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T02:11:01.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:00 smithi115 ceph-mon[35351]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-12T02:11:02.878 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:02 smithi136 ceph-mon[35814]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:11:02.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:02 smithi110 ceph-mon[30548]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:11:03.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:02 smithi115 ceph-mon[35351]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-12T02:11:03.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:03 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:11:03.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:03 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:03.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:03 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:03.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:03 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:11:03.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:03 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:03.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:03 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:04.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:03 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:11:04.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:03 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:04.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:03 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:04.894 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:04 smithi136 ceph-mon[35814]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:11:04.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:04 smithi110 ceph-mon[30548]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:11:05.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:04 smithi115 ceph-mon[35351]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:11:06.260 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.260+0000 7f2f0effd640 1 -- 172.21.15.136:0/1133211998 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f2f18062630 con 0x7f2f040a2c30 2024-09-12T02:11:06.260 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 11 on host 'smithi136' 2024-09-12T02:11:06.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.262+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/1133211998 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2f040a2c30 msgr2=0x7f2f040a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:06.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.262+0000 7f2f1ffeb640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2f040a2c30 0x7f2f040a50f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2f18101b30 tx=0x7f2f1400a2d0 comp rx=0 tx=0).stop 2024-09-12T02:11:06.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.262+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/1133211998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f18101cd0 msgr2=0x7f2f181972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:06.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.262+0000 7f2f1ffeb640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f18101cd0 0x7f2f181972e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800d770 tx=0x7f2f0800dc30 comp rx=0 tx=0).stop 2024-09-12T02:11:06.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.262+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/1133211998 shutdown_connections 2024-09-12T02:11:06.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.262+0000 7f2f1ffeb640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2f040a2c30 0x7f2f040a50f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:06.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.262+0000 7f2f1ffeb640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f18102690 0x7f2f1819e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:06.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.262+0000 7f2f1ffeb640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f18101cd0 0x7f2f181972e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:06.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.262+0000 7f2f1ffeb640 1 --2- 172.21.15.136:0/1133211998 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2f18100ad0 0x7f2f18196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:06.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.262+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/1133211998 >> 172.21.15.136:0/1133211998 conn(0x7f2f180fc280 msgr2=0x7f2f181050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:06.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.262+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/1133211998 shutdown_connections 2024-09-12T02:11:06.263 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:06.262+0000 7f2f1ffeb640 1 -- 172.21.15.136:0/1133211998 wait complete. 2024-09-12T02:11:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:06 smithi136 ceph-mon[35814]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:11:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:06 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:06 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:06 smithi110 ceph-mon[30548]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:11:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:06 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:06 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:07.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:06 smithi115 ceph-mon[35351]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-12T02:11:07.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:06 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:07.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:06 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:07.288 DEBUG:teuthology.orchestra.run.smithi136:osd.11> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.11.service 2024-09-12T02:11:07.291 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-12T02:11:07.291 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:11:07.677 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:08.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.263+0000 7fb97ce00640 1 -- 172.21.15.110:0/3001307405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb978101c00 msgr2=0x7fb978102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:08.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.263+0000 7fb97ce00640 1 --2- 172.21.15.110:0/3001307405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb978101c00 0x7fb978102000 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb968009860 tx=0x7fb96802a340 comp rx=0 tx=0).stop 2024-09-12T02:11:08.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.263+0000 7fb97ce00640 1 -- 172.21.15.110:0/3001307405 shutdown_connections 2024-09-12T02:11:08.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.263+0000 7fb97ce00640 1 --2- 172.21.15.110:0/3001307405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9781037c0 0x7fb97810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:08.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.263+0000 7fb97ce00640 1 --2- 172.21.15.110:0/3001307405 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb978102e00 0x7fb978103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:08.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.263+0000 7fb97ce00640 1 --2- 172.21.15.110:0/3001307405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb978101c00 0x7fb978102000 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:08.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.263+0000 7fb97ce00640 1 -- 172.21.15.110:0/3001307405 >> 172.21.15.110:0/3001307405 conn(0x7fb9780fd390 msgr2=0x7fb9780ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:08.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.263+0000 7fb97ce00640 1 -- 172.21.15.110:0/3001307405 shutdown_connections 2024-09-12T02:11:08.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.263+0000 7fb97ce00640 1 -- 172.21.15.110:0/3001307405 wait complete. 2024-09-12T02:11:08.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.264+0000 7fb97ce00640 1 Processor -- start 2024-09-12T02:11:08.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.264+0000 7fb97ce00640 1 -- start start 2024-09-12T02:11:08.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.264+0000 7fb97ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb978101c00 0x7fb978197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:08.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb97ce00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb978102e00 0x7fb978198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:08.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb97ce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9781037c0 0x7fb97819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:08.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb97ce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb97810d880 con 0x7fb978101c00 2024-09-12T02:11:08.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb97ce00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb97810d700 con 0x7fb978102e00 2024-09-12T02:11:08.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb97ce00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb97810da00 con 0x7fb9781037c0 2024-09-12T02:11:08.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb975e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb978101c00 0x7fb978197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:08.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb975e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb978101c00 0x7fb978197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51106/0 (socket says 172.21.15.110:51106) 2024-09-12T02:11:08.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb975e00640 1 -- 172.21.15.110:0/3161368294 learned_addr learned my addr 172.21.15.110:0/3161368294 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:08.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb976800640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9781037c0 0x7fb97819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:08.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb975400640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb978102e00 0x7fb978198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:08.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb975e00640 1 -- 172.21.15.110:0/3161368294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9781037c0 msgr2=0x7fb97819f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:08.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb975e00640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9781037c0 0x7fb97819f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:08.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb975e00640 1 -- 172.21.15.110:0/3161368294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb978102e00 msgr2=0x7fb978198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:08.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb975e00640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb978102e00 0x7fb978198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:08.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.265+0000 7fb975e00640 1 -- 172.21.15.110:0/3161368294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb97819fb40 con 0x7fb978101c00 2024-09-12T02:11:08.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.266+0000 7fb975e00640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb978101c00 0x7fb978197f10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb9680305b0 tx=0x7fb968033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:08.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.266+0000 7fb96ea00640 1 -- 172.21.15.110:0/3161368294 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96803f020 con 0x7fb978101c00 2024-09-12T02:11:08.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.266+0000 7fb96ea00640 1 -- 172.21.15.110:0/3161368294 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb968030850 con 0x7fb978101c00 2024-09-12T02:11:08.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.266+0000 7fb96ea00640 1 -- 172.21.15.110:0/3161368294 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb968037040 con 0x7fb978101c00 2024-09-12T02:11:08.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.266+0000 7fb97ce00640 1 -- 172.21.15.110:0/3161368294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb97819fdd0 con 0x7fb978101c00 2024-09-12T02:11:08.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.266+0000 7fb97ce00640 1 -- 172.21.15.110:0/3161368294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9781a01a0 con 0x7fb978101c00 2024-09-12T02:11:08.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.267+0000 7fb97ce00640 1 -- 172.21.15.110:0/3161368294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb978108ff0 con 0x7fb978101c00 2024-09-12T02:11:08.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.269+0000 7fb96ea00640 1 -- 172.21.15.110:0/3161368294 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fb968042020 con 0x7fb978101c00 2024-09-12T02:11:08.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.270+0000 7fb96ea00640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb95c0a2bb0 0x7fb95c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:08.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.271+0000 7fb96ea00640 1 -- 172.21.15.110:0/3161368294 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6809+0+0 (secure 0 0 0) 0x7fb9680ef100 con 0x7fb978101c00 2024-09-12T02:11:08.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.271+0000 7fb975400640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb95c0a2bb0 0x7fb95c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:08.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.271+0000 7fb975400640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb95c0a2bb0 0x7fb95c0a5070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb978199430 tx=0x7fb964005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:08.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.273+0000 7fb96ea00640 1 -- 172.21.15.110:0/3161368294 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb968049020 con 0x7fb978101c00 2024-09-12T02:11:08.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.451+0000 7fb97ce00640 1 -- 172.21.15.110:0/3161368294 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb978062ef0 con 0x7fb978101c00 2024-09-12T02:11:08.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.451+0000 7fb96ea00640 1 -- 172.21.15.110:0/3161368294 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7fb9680bc5a0 con 0x7fb978101c00 2024-09-12T02:11:08.452 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:08.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.454+0000 7fb97ce00640 1 -- 172.21.15.110:0/3161368294 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb95c0a2bb0 msgr2=0x7fb95c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.454+0000 7fb97ce00640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb95c0a2bb0 0x7fb95c0a5070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb978199430 tx=0x7fb964005f90 comp rx=0 tx=0).stop 2024-09-12T02:11:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.454+0000 7fb97ce00640 1 -- 172.21.15.110:0/3161368294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb978101c00 msgr2=0x7fb978197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.454+0000 7fb97ce00640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb978101c00 0x7fb978197f10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb9680305b0 tx=0x7fb968033d90 comp rx=0 tx=0).stop 2024-09-12T02:11:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.454+0000 7fb97ce00640 1 -- 172.21.15.110:0/3161368294 shutdown_connections 2024-09-12T02:11:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.454+0000 7fb97ce00640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb95c0a2bb0 0x7fb95c0a5070 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.454+0000 7fb97ce00640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9781037c0 0x7fb97819f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.454+0000 7fb97ce00640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb978102e00 0x7fb978198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.454+0000 7fb97ce00640 1 --2- 172.21.15.110:0/3161368294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb978101c00 0x7fb978197f10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.454+0000 7fb97ce00640 1 -- 172.21.15.110:0/3161368294 >> 172.21.15.110:0/3161368294 conn(0x7fb9780fd390 msgr2=0x7fb9781061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.454+0000 7fb97ce00640 1 -- 172.21.15.110:0/3161368294 shutdown_connections 2024-09-12T02:11:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:08.454+0000 7fb97ce00640 1 -- 172.21.15.110:0/3161368294 wait complete. 2024-09-12T02:11:08.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:08 smithi115 ceph-mon[35351]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:11:08.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:08 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:08.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:08 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:08.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:08 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3161368294' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:11:08.812 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:08 smithi110 ceph-mon[30548]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:11:08.812 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:08.812 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:08.813 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:08 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3161368294' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:11:08.894 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:08 smithi136 ceph-mon[35814]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:11:08.895 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:08 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:08.895 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:08 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:08.895 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:08 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3161368294' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:11:09.343 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1726107047,"num_in_osds":12,"osd_in_since":1726107048,"num_remapped_pgs":0} 2024-09-12T02:11:09.501 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:11:09 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:11:09.216+0000 7f8daca43640 -1 osd.11 0 log_to_monitors true 2024-09-12T02:11:09.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:09 smithi110 ceph-mon[30548]: from='osd.11 [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:11:09.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:09 smithi110 ceph-mon[30548]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:11:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:09 smithi115 ceph-mon[35351]: from='osd.11 [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:11:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:09 smithi115 ceph-mon[35351]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:11:09.902 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:09 smithi136 ceph-mon[35814]: from='osd.11 [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:11:09.902 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:09 smithi136 ceph-mon[35814]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-12T02:11:10.345 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:11:10.596 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:11:10 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:11:10.513+0000 7f8da89c6640 -1 osd.11 0 waiting for initial osdmap 2024-09-12T02:11:10.596 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:11:10 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:11:10.526+0000 7f8da47ee640 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T02:11:10.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:10 smithi136 ceph-mon[35814]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:11:10.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:10 smithi136 ceph-mon[35814]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:11:10.596 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:10 smithi136 ceph-mon[35814]: osdmap e76: 12 total, 11 up, 12 in 2024-09-12T02:11:10.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:11:10.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:10 smithi136 ceph-mon[35814]: from='osd.11 [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:11:10.597 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:10 smithi136 ceph-mon[35814]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:11:10.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:10 smithi110 ceph-mon[30548]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:11:10.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:10 smithi110 ceph-mon[30548]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:11:10.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:10 smithi110 ceph-mon[30548]: osdmap e76: 12 total, 11 up, 12 in 2024-09-12T02:11:10.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:11:10.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:10 smithi110 ceph-mon[30548]: from='osd.11 [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:11:10.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:10 smithi110 ceph-mon[30548]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:11:10.751 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:10.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:10 smithi115 ceph-mon[35351]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:11:10.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:10 smithi115 ceph-mon[35351]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-12T02:11:10.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:10 smithi115 ceph-mon[35351]: osdmap e76: 12 total, 11 up, 12 in 2024-09-12T02:11:10.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:11:10.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:10 smithi115 ceph-mon[35351]: from='osd.11 [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:11:10.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:10 smithi115 ceph-mon[35351]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-09-12T02:11:11.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.299+0000 7f66dac00640 1 -- 172.21.15.110:0/436849335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d4101c00 msgr2=0x7f66d4102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:11.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.299+0000 7f66dac00640 1 --2- 172.21.15.110:0/436849335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d4101c00 0x7f66d4102000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f66c4009900 tx=0x7f66c402a410 comp rx=0 tx=0).stop 2024-09-12T02:11:11.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.299+0000 7f66dac00640 1 -- 172.21.15.110:0/436849335 shutdown_connections 2024-09-12T02:11:11.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.299+0000 7f66dac00640 1 --2- 172.21.15.110:0/436849335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66d41037c0 0x7f66d410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:11.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.299+0000 7f66dac00640 1 --2- 172.21.15.110:0/436849335 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d4102e00 0x7f66d4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:11.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.299+0000 7f66dac00640 1 --2- 172.21.15.110:0/436849335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d4101c00 0x7f66d4102000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:11.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.299+0000 7f66dac00640 1 -- 172.21.15.110:0/436849335 >> 172.21.15.110:0/436849335 conn(0x7f66d40fd390 msgr2=0x7f66d40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:11.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.300+0000 7f66dac00640 1 -- 172.21.15.110:0/436849335 shutdown_connections 2024-09-12T02:11:11.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.300+0000 7f66dac00640 1 -- 172.21.15.110:0/436849335 wait complete. 2024-09-12T02:11:11.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.301+0000 7f66dac00640 1 Processor -- start 2024-09-12T02:11:11.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.301+0000 7f66dac00640 1 -- start start 2024-09-12T02:11:11.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.301+0000 7f66dac00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d4101c00 0x7f66d419e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:11.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.301+0000 7f66dac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d4102e00 0x7f66d419ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:11.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.301+0000 7f66dac00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66d41037c0 0x7f66d41a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:11.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.301+0000 7f66dac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f66d410d890 con 0x7f66d4102e00 2024-09-12T02:11:11.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.301+0000 7f66dac00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f66d410d710 con 0x7f66d4101c00 2024-09-12T02:11:11.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.301+0000 7f66dac00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f66d410da10 con 0x7f66d41037c0 2024-09-12T02:11:11.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.302+0000 7f66d3e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d4101c00 0x7f66d419e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:11.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.302+0000 7f66d3e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d4101c00 0x7f66d419e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:57098/0 (socket says 172.21.15.110:57098) 2024-09-12T02:11:11.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.302+0000 7f66d3e00640 1 -- 172.21.15.110:0/2173576355 learned_addr learned my addr 172.21.15.110:0/2173576355 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:11.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.302+0000 7f66d8c00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66d41037c0 0x7f66d41a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:11.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.302+0000 7f66d3400640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d4102e00 0x7f66d419ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:11.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.302+0000 7f66d8c00640 1 -- 172.21.15.110:0/2173576355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d4101c00 msgr2=0x7f66d419e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:11.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.302+0000 7f66d8c00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d4101c00 0x7f66d419e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:11.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.302+0000 7f66d8c00640 1 -- 172.21.15.110:0/2173576355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d4102e00 msgr2=0x7f66d419ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:11.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.302+0000 7f66d8c00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d4102e00 0x7f66d419ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:11.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.302+0000 7f66d8c00640 1 -- 172.21.15.110:0/2173576355 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d41a6180 con 0x7f66d41037c0 2024-09-12T02:11:11.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.302+0000 7f66d3e00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d4101c00 0x7f66d419e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:11:11.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.303+0000 7f66d8c00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66d41037c0 0x7f66d41a5b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009fd0 tx=0x7f66cc00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:11.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.303+0000 7f66d0c00640 1 -- 172.21.15.110:0/2173576355 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc00ce20 con 0x7f66d41037c0 2024-09-12T02:11:11.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.303+0000 7f66dac00640 1 -- 172.21.15.110:0/2173576355 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d41a6470 con 0x7f66d41037c0 2024-09-12T02:11:11.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.303+0000 7f66d0c00640 1 -- 172.21.15.110:0/2173576355 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66cc005020 con 0x7f66d41037c0 2024-09-12T02:11:11.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.303+0000 7f66d0c00640 1 -- 172.21.15.110:0/2173576355 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc010720 con 0x7f66d41037c0 2024-09-12T02:11:11.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.303+0000 7f66dac00640 1 -- 172.21.15.110:0/2173576355 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d41a69b0 con 0x7f66d41037c0 2024-09-12T02:11:11.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.304+0000 7f66dac00640 1 -- 172.21.15.110:0/2173576355 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d41a6c70 con 0x7f66d41037c0 2024-09-12T02:11:11.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.306+0000 7f66d0c00640 1 -- 172.21.15.110:0/2173576355 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f66cc005540 con 0x7f66d41037c0 2024-09-12T02:11:11.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.307+0000 7f66d0c00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f66b80a2bb0 0x7f66b80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:11.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.307+0000 7f66d0c00640 1 -- 172.21.15.110:0/2173576355 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6847+0+0 (secure 0 0 0) 0x7f66cc0cf300 con 0x7f66d41037c0 2024-09-12T02:11:11.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.308+0000 7f66d3e00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f66b80a2bb0 0x7f66b80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:11.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.308+0000 7f66d3e00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f66b80a2bb0 0x7f66b80a5070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f66c4031610 tx=0x7f66c40095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:11.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.311+0000 7f66d0c00640 1 -- 172.21.15.110:0/2173576355 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f66cc09c780 con 0x7f66d41037c0 2024-09-12T02:11:11.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.489+0000 7f66dac00640 1 -- 172.21.15.110:0/2173576355 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f66d41a6ee0 con 0x7f66d41037c0 2024-09-12T02:11:11.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.490+0000 7f66d0c00640 1 -- 172.21.15.110:0/2173576355 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7f66cc09c080 con 0x7f66d41037c0 2024-09-12T02:11:11.491 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:11.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.493+0000 7f66dac00640 1 -- 172.21.15.110:0/2173576355 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f66b80a2bb0 msgr2=0x7f66b80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:11.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.493+0000 7f66dac00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f66b80a2bb0 0x7f66b80a5070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f66c4031610 tx=0x7f66c40095f0 comp rx=0 tx=0).stop 2024-09-12T02:11:11.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.493+0000 7f66dac00640 1 -- 172.21.15.110:0/2173576355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66d41037c0 msgr2=0x7f66d41a5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:11.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.493+0000 7f66dac00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66d41037c0 0x7f66d41a5b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009fd0 tx=0x7f66cc00ef10 comp rx=0 tx=0).stop 2024-09-12T02:11:11.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.493+0000 7f66dac00640 1 -- 172.21.15.110:0/2173576355 shutdown_connections 2024-09-12T02:11:11.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.493+0000 7f66dac00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f66b80a2bb0 0x7f66b80a5070 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:11.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.493+0000 7f66dac00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f66d41037c0 0x7f66d41a5b10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:11.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.493+0000 7f66dac00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d4102e00 0x7f66d419ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:11.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.493+0000 7f66dac00640 1 --2- 172.21.15.110:0/2173576355 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f66d4101c00 0x7f66d419e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:11.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.493+0000 7f66dac00640 1 -- 172.21.15.110:0/2173576355 >> 172.21.15.110:0/2173576355 conn(0x7f66d40fd390 msgr2=0x7f66d41085d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:11.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.493+0000 7f66dac00640 1 -- 172.21.15.110:0/2173576355 shutdown_connections 2024-09-12T02:11:11.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:11.493+0000 7f66dac00640 1 -- 172.21.15.110:0/2173576355 wait complete. 2024-09-12T02:11:11.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-12T02:11:11.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: osdmap e77: 12 total, 11 up, 12 in 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: Detected new or changed devices on smithi136 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi136 to 4272M 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:11.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:11:11.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:11:11.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:11.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:11:11.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:11 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2173576355' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:11:11.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-12T02:11:11.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: osdmap e77: 12 total, 11 up, 12 in 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: Detected new or changed devices on smithi136 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi136 to 4272M 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:11:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:11:11.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:11.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:11:11.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:11 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2173576355' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:11:11.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-09-12T02:11:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: osdmap e77: 12 total, 11 up, 12 in 2024-09-12T02:11:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:11:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:11:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: Detected new or changed devices on smithi136 2024-09-12T02:11:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:11:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:11:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:11:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:11:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi136 to 4272M 2024-09-12T02:11:11.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:11.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:11:11.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:11:11.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:11.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:11:11.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:11.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:11 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2173576355' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:11:12.456 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":77,"num_osds":12,"num_up_osds":11,"osd_up_since":1726107047,"num_in_osds":12,"osd_in_since":1726107048,"num_remapped_pgs":0} 2024-09-12T02:11:12.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:12 smithi110 ceph-mon[30548]: purged_snaps scrub starts 2024-09-12T02:11:12.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:12 smithi110 ceph-mon[30548]: purged_snaps scrub ok 2024-09-12T02:11:12.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:12 smithi110 ceph-mon[30548]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:11:12.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:12 smithi110 ceph-mon[30548]: osd.11 [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671] boot 2024-09-12T02:11:12.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:12 smithi110 ceph-mon[30548]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:11:12.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:11:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:12 smithi115 ceph-mon[35351]: purged_snaps scrub starts 2024-09-12T02:11:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:12 smithi115 ceph-mon[35351]: purged_snaps scrub ok 2024-09-12T02:11:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:12 smithi115 ceph-mon[35351]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:11:12.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:12 smithi115 ceph-mon[35351]: osd.11 [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671] boot 2024-09-12T02:11:12.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:12 smithi115 ceph-mon[35351]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:11:12.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:12 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:11:12.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:12 smithi136 ceph-mon[35814]: purged_snaps scrub starts 2024-09-12T02:11:12.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:12 smithi136 ceph-mon[35814]: purged_snaps scrub ok 2024-09-12T02:11:12.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:12 smithi136 ceph-mon[35814]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-12T02:11:12.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:12 smithi136 ceph-mon[35814]: osd.11 [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671] boot 2024-09-12T02:11:12.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:12 smithi136 ceph-mon[35814]: osdmap e78: 12 total, 12 up, 12 in 2024-09-12T02:11:12.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:12 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:11:13.457 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T02:11:13.831 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:14.137 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:13 smithi110 ceph-mon[30548]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:11:14.138 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:13 smithi110 ceph-mon[30548]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:14.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:13 smithi136 ceph-mon[35814]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:11:14.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:13 smithi136 ceph-mon[35814]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:14.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:13 smithi115 ceph-mon[35351]: osdmap e79: 12 total, 12 up, 12 in 2024-09-12T02:11:14.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:13 smithi115 ceph-mon[35351]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:14.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.380+0000 7f43c1000640 1 -- 172.21.15.110:0/1290339672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43bc101a40 msgr2=0x7f43bc101e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:14.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.380+0000 7f43c1000640 1 --2- 172.21.15.110:0/1290339672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43bc101a40 0x7f43bc101e40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009900 tx=0x7f43ac02a410 comp rx=0 tx=0).stop 2024-09-12T02:11:14.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.380+0000 7f43c1000640 1 -- 172.21.15.110:0/1290339672 shutdown_connections 2024-09-12T02:11:14.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.380+0000 7f43c1000640 1 --2- 172.21.15.110:0/1290339672 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43bc103600 0x7f43bc109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:14.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.380+0000 7f43c1000640 1 --2- 172.21.15.110:0/1290339672 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43bc102c40 0x7f43bc1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:14.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.380+0000 7f43c1000640 1 --2- 172.21.15.110:0/1290339672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43bc101a40 0x7f43bc101e40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:14.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.380+0000 7f43c1000640 1 -- 172.21.15.110:0/1290339672 >> 172.21.15.110:0/1290339672 conn(0x7f43bc0fd1f0 msgr2=0x7f43bc0ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:14.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.380+0000 7f43c1000640 1 -- 172.21.15.110:0/1290339672 shutdown_connections 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.380+0000 7f43c1000640 1 -- 172.21.15.110:0/1290339672 wait complete. 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.381+0000 7f43c1000640 1 Processor -- start 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.381+0000 7f43c1000640 1 -- start start 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.381+0000 7f43c1000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43bc101a40 0x7f43bc075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.381+0000 7f43c1000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43bc102c40 0x7f43bc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.381+0000 7f43c1000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43bc103600 0x7f43bc074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.381+0000 7f43c1000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc10d710 con 0x7f43bc101a40 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.381+0000 7f43c1000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc10d590 con 0x7f43bc102c40 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.381+0000 7f43c1000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f43bc10d890 con 0x7f43bc103600 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.382+0000 7f43bb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43bc101a40 0x7f43bc075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.382+0000 7f43bb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43bc101a40 0x7f43bc075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46360/0 (socket says 172.21.15.110:46360) 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.382+0000 7f43bb400640 1 -- 172.21.15.110:0/3870078205 learned_addr learned my addr 172.21.15.110:0/3870078205 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.382+0000 7f43b3e00640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43bc102c40 0x7f43bc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:14.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.382+0000 7f43bbe00640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43bc103600 0x7f43bc074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:14.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.382+0000 7f43bb400640 1 -- 172.21.15.110:0/3870078205 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43bc103600 msgr2=0x7f43bc074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.382+0000 7f43bb400640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43bc103600 0x7f43bc074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.382+0000 7f43bb400640 1 -- 172.21.15.110:0/3870078205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43bc102c40 msgr2=0x7f43bc0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.382+0000 7f43bb400640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43bc102c40 0x7f43bc0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.382+0000 7f43bb400640 1 -- 172.21.15.110:0/3870078205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43bc0753e0 con 0x7f43bc101a40 2024-09-12T02:11:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.382+0000 7f43bbe00640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43bc103600 0x7f43bc074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:11:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.383+0000 7f43bb400640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43bc101a40 0x7f43bc075f90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43ac031440 tx=0x7f43ac032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.383+0000 7f43b8c00640 1 -- 172.21.15.110:0/3870078205 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac03f030 con 0x7f43bc101a40 2024-09-12T02:11:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.383+0000 7f43b8c00640 1 -- 172.21.15.110:0/3870078205 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43ac003ce0 con 0x7f43bc101a40 2024-09-12T02:11:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.383+0000 7f43b8c00640 1 -- 172.21.15.110:0/3870078205 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac035070 con 0x7f43bc101a40 2024-09-12T02:11:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.383+0000 7f43c1000640 1 -- 172.21.15.110:0/3870078205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43bc1a1e90 con 0x7f43bc101a40 2024-09-12T02:11:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.383+0000 7f43c1000640 1 -- 172.21.15.110:0/3870078205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43bc1a2230 con 0x7f43bc101a40 2024-09-12T02:11:14.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.384+0000 7f43c1000640 1 -- 172.21.15.110:0/3870078205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43bc108e40 con 0x7f43bc101a40 2024-09-12T02:11:14.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.386+0000 7f43b8c00640 1 -- 172.21.15.110:0/3870078205 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f43ac042030 con 0x7f43bc101a40 2024-09-12T02:11:14.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.388+0000 7f43b8c00640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f43a00a2b80 0x7f43a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:14.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.388+0000 7f43b8c00640 1 -- 172.21.15.110:0/3870078205 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f43ac0ef640 con 0x7f43bc101a40 2024-09-12T02:11:14.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.389+0000 7f43b3e00640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f43a00a2b80 0x7f43a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:14.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.389+0000 7f43b3e00640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f43a00a2b80 0x7f43a00a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f43bc075d10 tx=0x7f43a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:14.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.391+0000 7f43b8c00640 1 -- 172.21.15.110:0/3870078205 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43ac0bc9a0 con 0x7f43bc101a40 2024-09-12T02:11:14.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.568+0000 7f43c1000640 1 -- 172.21.15.110:0/3870078205 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f43bc062e90 con 0x7f43bc101a40 2024-09-12T02:11:14.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.569+0000 7f43b8c00640 1 -- 172.21.15.110:0/3870078205 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7f43ac0bc2a0 con 0x7f43bc101a40 2024-09-12T02:11:14.569 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:14.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.571+0000 7f43c1000640 1 -- 172.21.15.110:0/3870078205 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f43a00a2b80 msgr2=0x7f43a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:14.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.571+0000 7f43c1000640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f43a00a2b80 0x7f43a00a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f43bc075d10 tx=0x7f43a400b390 comp rx=0 tx=0).stop 2024-09-12T02:11:14.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.571+0000 7f43c1000640 1 -- 172.21.15.110:0/3870078205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43bc101a40 msgr2=0x7f43bc075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:14.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.571+0000 7f43c1000640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43bc101a40 0x7f43bc075f90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43ac031440 tx=0x7f43ac032ce0 comp rx=0 tx=0).stop 2024-09-12T02:11:14.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.571+0000 7f43c1000640 1 -- 172.21.15.110:0/3870078205 shutdown_connections 2024-09-12T02:11:14.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.571+0000 7f43c1000640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f43a00a2b80 0x7f43a00a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:14.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.571+0000 7f43c1000640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43bc103600 0x7f43bc074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:14.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.571+0000 7f43c1000640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f43bc102c40 0x7f43bc0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:14.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.571+0000 7f43c1000640 1 --2- 172.21.15.110:0/3870078205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43bc101a40 0x7f43bc075f90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:14.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.571+0000 7f43c1000640 1 -- 172.21.15.110:0/3870078205 >> 172.21.15.110:0/3870078205 conn(0x7f43bc0fd1f0 msgr2=0x7f43bc106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:14.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.571+0000 7f43c1000640 1 -- 172.21.15.110:0/3870078205 shutdown_connections 2024-09-12T02:11:14.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:14.572+0000 7f43c1000640 1 -- 172.21.15.110:0/3870078205 wait complete. 2024-09-12T02:11:15.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:14 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3870078205' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:11:15.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:14 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3870078205' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:11:15.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:14 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3870078205' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T02:11:15.490 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1726107071,"num_in_osds":12,"osd_in_since":1726107048,"num_remapped_pgs":0} 2024-09-12T02:11:15.491 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:11:15.853 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:16.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:15 smithi136 ceph-mon[35814]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:16.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:15 smithi110 ceph-mon[30548]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:16.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:15 smithi115 ceph-mon[35351]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:16.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.500+0000 7f8264e00640 1 -- 172.21.15.110:0/2990121501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8260108f60 msgr2=0x7f8260110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:16.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.500+0000 7f8264e00640 1 --2- 172.21.15.110:0/2990121501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8260108f60 0x7f8260110ae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8258009ca0 tx=0x7f825802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:11:16.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.500+0000 7f8264e00640 1 -- 172.21.15.110:0/2990121501 shutdown_connections 2024-09-12T02:11:16.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.500+0000 7f8264e00640 1 --2- 172.21.15.110:0/2990121501 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8260108f60 0x7f8260110ae0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:16.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.500+0000 7f8264e00640 1 --2- 172.21.15.110:0/2990121501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82601047e0 0x7f8260108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:16.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.500+0000 7f8264e00640 1 --2- 172.21.15.110:0/2990121501 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8260103e30 0x7f8260104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:16.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.500+0000 7f8264e00640 1 -- 172.21.15.110:0/2990121501 >> 172.21.15.110:0/2990121501 conn(0x7f82600ff910 msgr2=0x7f8260101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:16.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.500+0000 7f8264e00640 1 -- 172.21.15.110:0/2990121501 shutdown_connections 2024-09-12T02:11:16.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.501+0000 7f8264e00640 1 -- 172.21.15.110:0/2990121501 wait complete. 2024-09-12T02:11:16.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.501+0000 7f8264e00640 1 Processor -- start 2024-09-12T02:11:16.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.502+0000 7f8264e00640 1 -- start start 2024-09-12T02:11:16.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.502+0000 7f8264e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8260103e30 0x7f826019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:16.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.502+0000 7f8264e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82601047e0 0x7f826019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:16.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.502+0000 7f8264e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8260108f60 0x7f826019ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:16.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.502+0000 7f8264e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8260113fc0 con 0x7f8260108f60 2024-09-12T02:11:16.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.502+0000 7f8264e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8260113e40 con 0x7f8260103e30 2024-09-12T02:11:16.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.502+0000 7f8264e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8260114140 con 0x7f82601047e0 2024-09-12T02:11:16.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.502+0000 7f825ea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82601047e0 0x7f826019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:16.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.502+0000 7f825f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8260103e30 0x7f826019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:16.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.502+0000 7f825ea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82601047e0 0x7f826019a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:60082/0 (socket says 172.21.15.110:60082) 2024-09-12T02:11:16.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.502+0000 7f825ea00640 1 -- 172.21.15.110:0/1260415841 learned_addr learned my addr 172.21.15.110:0/1260415841 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:16.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.502+0000 7f825fe00640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8260108f60 0x7f826019ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:16.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.503+0000 7f825ea00640 1 -- 172.21.15.110:0/1260415841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8260103e30 msgr2=0x7f826019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.503+0000 7f825ea00640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8260103e30 0x7f826019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.503+0000 7f825ea00640 1 -- 172.21.15.110:0/1260415841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8260108f60 msgr2=0x7f826019ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.503+0000 7f825ea00640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8260108f60 0x7f826019ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.503+0000 7f825ea00640 1 -- 172.21.15.110:0/1260415841 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826019f390 con 0x7f82601047e0 2024-09-12T02:11:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.503+0000 7f825f400640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8260103e30 0x7f826019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:11:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.503+0000 7f825ea00640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82601047e0 0x7f826019a920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f824c00ea60 tx=0x7f824c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.503+0000 7f8257e00640 1 -- 172.21.15.110:0/1260415841 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c00cde0 con 0x7f82601047e0 2024-09-12T02:11:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.503+0000 7f8257e00640 1 -- 172.21.15.110:0/1260415841 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f824c0035f0 con 0x7f82601047e0 2024-09-12T02:11:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.503+0000 7f8264e00640 1 -- 172.21.15.110:0/1260415841 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826019f680 con 0x7f82601047e0 2024-09-12T02:11:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.503+0000 7f8257e00640 1 -- 172.21.15.110:0/1260415841 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c010670 con 0x7f82601047e0 2024-09-12T02:11:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.504+0000 7f8264e00640 1 -- 172.21.15.110:0/1260415841 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82601a6f60 con 0x7f82601047e0 2024-09-12T02:11:16.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.504+0000 7f8264e00640 1 -- 172.21.15.110:0/1260415841 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8260105310 con 0x7f82601047e0 2024-09-12T02:11:16.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.507+0000 7f8257e00640 1 -- 172.21.15.110:0/1260415841 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f824c0037a0 con 0x7f82601047e0 2024-09-12T02:11:16.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.508+0000 7f8257e00640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f82440a2b80 0x7f82440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:16.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.508+0000 7f8257e00640 1 -- 172.21.15.110:0/1260415841 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f824c0cee80 con 0x7f82601047e0 2024-09-12T02:11:16.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.509+0000 7f825f400640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f82440a2b80 0x7f82440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:16.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.509+0000 7f825f400640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f82440a2b80 0x7f82440a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8250009fc0 tx=0x7f8250005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:16.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.510+0000 7f8257e00640 1 -- 172.21.15.110:0/1260415841 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f824c09c1e0 con 0x7f82601047e0 2024-09-12T02:11:16.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.685+0000 7f8264e00640 1 -- 172.21.15.110:0/1260415841 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8260104210 con 0x7f82601047e0 2024-09-12T02:11:16.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.686+0000 7f8257e00640 1 -- 172.21.15.110:0/1260415841 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+18551 (secure 0 0 0) 0x7f8260104210 con 0x7f82601047e0 2024-09-12T02:11:16.687 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:16.687 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":79,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:11:12.818568+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:11:16.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.689+0000 7f8264e00640 1 -- 172.21.15.110:0/1260415841 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f82440a2b80 msgr2=0x7f82440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:16.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.689+0000 7f8264e00640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f82440a2b80 0x7f82440a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8250009fc0 tx=0x7f8250005f90 comp rx=0 tx=0).stop 2024-09-12T02:11:16.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.689+0000 7f8264e00640 1 -- 172.21.15.110:0/1260415841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82601047e0 msgr2=0x7f826019a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:16.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.689+0000 7f8264e00640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82601047e0 0x7f826019a920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f824c00ea60 tx=0x7f824c00ef20 comp rx=0 tx=0).stop 2024-09-12T02:11:16.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.689+0000 7f8264e00640 1 -- 172.21.15.110:0/1260415841 shutdown_connections 2024-09-12T02:11:16.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.689+0000 7f8264e00640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f82440a2b80 0x7f82440a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:16.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.689+0000 7f8264e00640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8260108f60 0x7f826019ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:16.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.689+0000 7f8264e00640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f82601047e0 0x7f826019a920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:16.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.689+0000 7f8264e00640 1 --2- 172.21.15.110:0/1260415841 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8260103e30 0x7f826019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:16.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.689+0000 7f8264e00640 1 -- 172.21.15.110:0/1260415841 >> 172.21.15.110:0/1260415841 conn(0x7f82600ff910 msgr2=0x7f8260100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:16.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.689+0000 7f8264e00640 1 -- 172.21.15.110:0/1260415841 shutdown_connections 2024-09-12T02:11:16.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:16.689+0000 7f8264e00640 1 -- 172.21.15.110:0/1260415841 wait complete. 2024-09-12T02:11:17.127 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:16 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1260415841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:11:17.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:16 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1260415841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:11:17.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:16 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1260415841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:11:17.499 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:07:07.945973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T02:11:17.500 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T02:11:17.867 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:18.156 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:17 smithi110 ceph-mon[30548]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:18.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:17 smithi136 ceph-mon[35814]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:18.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:17 smithi115 ceph-mon[35351]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:18.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.401+0000 7fc6f0600640 1 -- 172.21.15.110:0/4044986157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6e8102790 msgr2=0x7fc6e81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:18.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.401+0000 7fc6f0600640 1 --2- 172.21.15.110:0/4044986157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6e8102790 0x7fc6e81067e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009900 tx=0x7fc6d402a410 comp rx=0 tx=0).stop 2024-09-12T02:11:18.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.401+0000 7fc6f0600640 1 -- 172.21.15.110:0/4044986157 shutdown_connections 2024-09-12T02:11:18.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.401+0000 7fc6f0600640 1 --2- 172.21.15.110:0/4044986157 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e8106f10 0x7fc6e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:18.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.401+0000 7fc6f0600640 1 --2- 172.21.15.110:0/4044986157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6e8102790 0x7fc6e81067e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:18.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.401+0000 7fc6f0600640 1 --2- 172.21.15.110:0/4044986157 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6e8101de0 0x7fc6e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:18.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.401+0000 7fc6f0600640 1 -- 172.21.15.110:0/4044986157 >> 172.21.15.110:0/4044986157 conn(0x7fc6e80fd8c0 msgr2=0x7fc6e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:18.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.401+0000 7fc6f0600640 1 -- 172.21.15.110:0/4044986157 shutdown_connections 2024-09-12T02:11:18.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.401+0000 7fc6f0600640 1 -- 172.21.15.110:0/4044986157 wait complete. 2024-09-12T02:11:18.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.402+0000 7fc6f0600640 1 Processor -- start 2024-09-12T02:11:18.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.402+0000 7fc6f0600640 1 -- start start 2024-09-12T02:11:18.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.402+0000 7fc6f0600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6e8101de0 0x7fc6e819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:18.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.402+0000 7fc6f0600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6e8102790 0x7fc6e819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:18.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.402+0000 7fc6f0600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e8106f10 0x7fc6e819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:18.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.402+0000 7fc6f0600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e8111f70 con 0x7fc6e8102790 2024-09-12T02:11:18.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.402+0000 7fc6f0600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e8111df0 con 0x7fc6e8106f10 2024-09-12T02:11:18.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.402+0000 7fc6f0600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e81120f0 con 0x7fc6e8101de0 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.403+0000 7fc6edc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6e8101de0 0x7fc6e819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.403+0000 7fc6ee600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e8106f10 0x7fc6e819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.403+0000 7fc6edc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6e8101de0 0x7fc6e819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:60110/0 (socket says 172.21.15.110:60110) 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.403+0000 7fc6edc00640 1 -- 172.21.15.110:0/2362993149 learned_addr learned my addr 172.21.15.110:0/2362993149 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.403+0000 7fc6ed200640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6e8102790 0x7fc6e819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.403+0000 7fc6ee600640 1 -- 172.21.15.110:0/2362993149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6e8101de0 msgr2=0x7fc6e819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.403+0000 7fc6ee600640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6e8101de0 0x7fc6e819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.403+0000 7fc6ee600640 1 -- 172.21.15.110:0/2362993149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6e8102790 msgr2=0x7fc6e819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.403+0000 7fc6ee600640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6e8102790 0x7fc6e819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.403+0000 7fc6ee600640 1 -- 172.21.15.110:0/2362993149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e819f5f0 con 0x7fc6e8106f10 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.403+0000 7fc6ee600640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e8106f10 0x7fc6e819ef10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009fd0 tx=0x7fc6e000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.404+0000 7fc6e6000640 1 -- 172.21.15.110:0/2362993149 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000ce20 con 0x7fc6e8106f10 2024-09-12T02:11:18.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.404+0000 7fc6f0600640 1 -- 172.21.15.110:0/2362993149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e819f8e0 con 0x7fc6e8106f10 2024-09-12T02:11:18.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.404+0000 7fc6e6000640 1 -- 172.21.15.110:0/2362993149 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6e0005020 con 0x7fc6e8106f10 2024-09-12T02:11:18.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.404+0000 7fc6e6000640 1 -- 172.21.15.110:0/2362993149 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0010720 con 0x7fc6e8106f10 2024-09-12T02:11:18.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.404+0000 7fc6f0600640 1 -- 172.21.15.110:0/2362993149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e81a71c0 con 0x7fc6e8106f10 2024-09-12T02:11:18.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.405+0000 7fc6f0600640 1 -- 172.21.15.110:0/2362993149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e81021c0 con 0x7fc6e8106f10 2024-09-12T02:11:18.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.407+0000 7fc6e6000640 1 -- 172.21.15.110:0/2362993149 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fc6e0005540 con 0x7fc6e8106f10 2024-09-12T02:11:18.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.408+0000 7fc6e6000640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc6d00a2b80 0x7fc6d00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:18.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.409+0000 7fc6e6000640 1 -- 172.21.15.110:0/2362993149 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fc6e00cf2f0 con 0x7fc6e8106f10 2024-09-12T02:11:18.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.409+0000 7fc6edc00640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc6d00a2b80 0x7fc6d00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:18.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.409+0000 7fc6edc00640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc6d00a2b80 0x7fc6d00a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009cd0 tx=0x7fc6dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:18.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.410+0000 7fc6e6000640 1 -- 172.21.15.110:0/2362993149 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6e009c650 con 0x7fc6e8106f10 2024-09-12T02:11:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.585+0000 7fc6f0600640 1 -- 172.21.15.110:0/2362993149 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc6e81a73f0 con 0x7fc6e8106f10 2024-09-12T02:11:18.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.586+0000 7fc6e6000640 1 -- 172.21.15.110:0/2362993149 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7fc6e009bf50 con 0x7fc6e8106f10 2024-09-12T02:11:18.586 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-09-12T02:11:18.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.588+0000 7fc6f0600640 1 -- 172.21.15.110:0/2362993149 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc6d00a2b80 msgr2=0x7fc6d00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:18.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.588+0000 7fc6f0600640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc6d00a2b80 0x7fc6d00a5040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009cd0 tx=0x7fc6dc005f90 comp rx=0 tx=0).stop 2024-09-12T02:11:18.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.588+0000 7fc6f0600640 1 -- 172.21.15.110:0/2362993149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e8106f10 msgr2=0x7fc6e819ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:18.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.588+0000 7fc6f0600640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e8106f10 0x7fc6e819ef10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009fd0 tx=0x7fc6e000ef10 comp rx=0 tx=0).stop 2024-09-12T02:11:18.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.588+0000 7fc6f0600640 1 -- 172.21.15.110:0/2362993149 shutdown_connections 2024-09-12T02:11:18.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.588+0000 7fc6f0600640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc6d00a2b80 0x7fc6d00a5040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:18.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.588+0000 7fc6f0600640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc6e8106f10 0x7fc6e819ef10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:18.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.588+0000 7fc6f0600640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6e8102790 0x7fc6e819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:18.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.588+0000 7fc6f0600640 1 --2- 172.21.15.110:0/2362993149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6e8101de0 0x7fc6e819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:18.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.588+0000 7fc6f0600640 1 -- 172.21.15.110:0/2362993149 >> 172.21.15.110:0/2362993149 conn(0x7fc6e80fd8c0 msgr2=0x7fc6e80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:18.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.588+0000 7fc6f0600640 1 -- 172.21.15.110:0/2362993149 shutdown_connections 2024-09-12T02:11:18.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:18.588+0000 7fc6f0600640 1 -- 172.21.15.110:0/2362993149 wait complete. 2024-09-12T02:11:19.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:18 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2362993149' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:11:19.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:18 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2362993149' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:11:19.286 INFO:tasks.cephadm:Adding mds.a on smithi110 2024-09-12T02:11:19.286 INFO:tasks.cephadm:Adding mds.d on smithi110 2024-09-12T02:11:19.287 INFO:tasks.cephadm:Adding mds.g on smithi110 2024-09-12T02:11:19.287 INFO:tasks.cephadm:Adding mds.j on smithi110 2024-09-12T02:11:19.287 INFO:tasks.cephadm:Adding mds.b on smithi115 2024-09-12T02:11:19.287 INFO:tasks.cephadm:Adding mds.e on smithi115 2024-09-12T02:11:19.287 INFO:tasks.cephadm:Adding mds.h on smithi115 2024-09-12T02:11:19.288 INFO:tasks.cephadm:Adding mds.k on smithi115 2024-09-12T02:11:19.288 INFO:tasks.cephadm:Adding mds.c on smithi136 2024-09-12T02:11:19.288 INFO:tasks.cephadm:Adding mds.f on smithi136 2024-09-12T02:11:19.288 INFO:tasks.cephadm:Adding mds.i on smithi136 2024-09-12T02:11:19.288 INFO:tasks.cephadm:Adding mds.l on smithi136 2024-09-12T02:11:19.289 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l' 2024-09-12T02:11:19.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:18 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2362993149' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:11:19.548 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:11:19.968 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:19 smithi136 ceph-mon[35814]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:20.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 -- 172.21.15.136:0/1678705119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f0107920 msgr2=0x7f81f0109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:20.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 --2- 172.21.15.136:0/1678705119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f0107920 0x7f81f0109d10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009ca0 tx=0x7f81e802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:11:20.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 -- 172.21.15.136:0/1678705119 shutdown_connections 2024-09-12T02:11:20.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 --2- 172.21.15.136:0/1678705119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f0107920 0x7f81f0109d10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:20.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 --2- 172.21.15.136:0/1678705119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f0104ff0 0x7f81f01073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:20.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 --2- 172.21.15.136:0/1678705119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81f01026c0 0x7f81f0104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:20.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 -- 172.21.15.136:0/1678705119 >> 172.21.15.136:0/1678705119 conn(0x7f81f00fc280 msgr2=0x7f81f00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:20.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 -- 172.21.15.136:0/1678705119 shutdown_connections 2024-09-12T02:11:20.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 -- 172.21.15.136:0/1678705119 wait complete. 2024-09-12T02:11:20.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 Processor -- start 2024-09-12T02:11:20.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 -- start start 2024-09-12T02:11:20.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f01026c0 0x7f81f0102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:20.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f0104ff0 0x7f81f0100670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:20.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81f0107920 0x7f81f0100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:20.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.054+0000 7f81f80eb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f81f010d880 con 0x7f81f0107920 2024-09-12T02:11:20.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f80eb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f81f010d700 con 0x7f81f01026c0 2024-09-12T02:11:20.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f80eb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f81f010da00 con 0x7f81f0104ff0 2024-09-12T02:11:20.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f5686640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f0104ff0 0x7f81f0100670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:20.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f5686640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f0104ff0 0x7f81f0100670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:43302/0 (socket says 172.21.15.136:43302) 2024-09-12T02:11:20.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f5686640 1 -- 172.21.15.136:0/1051359476 learned_addr learned my addr 172.21.15.136:0/1051359476 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-09-12T02:11:20.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f5e87640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f01026c0 0x7f81f0102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:20.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f6688640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81f0107920 0x7f81f0100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:20.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f5686640 1 -- 172.21.15.136:0/1051359476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f01026c0 msgr2=0x7f81f0102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:20.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f5686640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f01026c0 0x7f81f0102020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:20.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f5686640 1 -- 172.21.15.136:0/1051359476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81f0107920 msgr2=0x7f81f0100bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:20.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f5686640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81f0107920 0x7f81f0100bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:20.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f5686640 1 -- 172.21.15.136:0/1051359476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f0101470 con 0x7f81f0104ff0 2024-09-12T02:11:20.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f6688640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81f0107920 0x7f81f0100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T02:11:20.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f5686640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f0104ff0 0x7f81f0100670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f81e000d740 tx=0x7f81e000dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:20.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81e6ffd640 1 -- 172.21.15.136:0/1051359476 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0017070 con 0x7f81f0104ff0 2024-09-12T02:11:20.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f80eb640 1 -- 172.21.15.136:0/1051359476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f01a2070 con 0x7f81f0104ff0 2024-09-12T02:11:20.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81e6ffd640 1 -- 172.21.15.136:0/1051359476 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e000de50 con 0x7f81f0104ff0 2024-09-12T02:11:20.072 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81e6ffd640 1 -- 172.21.15.136:0/1051359476 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0004e00 con 0x7f81f0104ff0 2024-09-12T02:11:20.072 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.055+0000 7f81f80eb640 1 -- 172.21.15.136:0/1051359476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f01a2580 con 0x7f81f0104ff0 2024-09-12T02:11:20.072 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.057+0000 7f81f80eb640 1 -- 172.21.15.136:0/1051359476 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f00fdd70 con 0x7f81f0104ff0 2024-09-12T02:11:20.072 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.057+0000 7f81e6ffd640 1 -- 172.21.15.136:0/1051359476 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f81e0004fa0 con 0x7f81f0104ff0 2024-09-12T02:11:20.072 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.058+0000 7f81e6ffd640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f81dc0a2b80 0x7f81dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:20.072 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.058+0000 7f81e6ffd640 1 -- 172.21.15.136:0/1051359476 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f81e00ce640 con 0x7f81f0104ff0 2024-09-12T02:11:20.072 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.058+0000 7f81f5e87640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f81dc0a2b80 0x7f81dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:20.072 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.059+0000 7f81f5e87640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f81dc0a2b80 0x7f81dc0a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0058c0 tx=0x7f81ec00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:20.072 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.062+0000 7f81e6ffd640 1 -- 172.21.15.136:0/1051359476 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f81e009ba20 con 0x7f81f0104ff0 2024-09-12T02:11:20.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:19 smithi110 ceph-mon[30548]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:20.245 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.245+0000 7f81f80eb640 1 -- 172.21.15.136:0/1051359476 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l", "target": ["mon-mgr", ""]}) -- 0x7f81f00627f0 con 0x7f81dc0a2b80 2024-09-12T02:11:20.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.253+0000 7f81e6ffd640 1 -- 172.21.15.136:0/1051359476 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f81f00627f0 con 0x7f81dc0a2b80 2024-09-12T02:11:20.253 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled mds.all update... 2024-09-12T02:11:20.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.255+0000 7f81f80eb640 1 -- 172.21.15.136:0/1051359476 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f81dc0a2b80 msgr2=0x7f81dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:20.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.255+0000 7f81f80eb640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f81dc0a2b80 0x7f81dc0a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0058c0 tx=0x7f81ec00a4c0 comp rx=0 tx=0).stop 2024-09-12T02:11:20.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.255+0000 7f81f80eb640 1 -- 172.21.15.136:0/1051359476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f0104ff0 msgr2=0x7f81f0100670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:20.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.255+0000 7f81f80eb640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f0104ff0 0x7f81f0100670 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f81e000d740 tx=0x7f81e000dc00 comp rx=0 tx=0).stop 2024-09-12T02:11:20.255 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.255+0000 7f81f80eb640 1 -- 172.21.15.136:0/1051359476 shutdown_connections 2024-09-12T02:11:20.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.255+0000 7f81f80eb640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f81dc0a2b80 0x7f81dc0a5040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:20.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.255+0000 7f81f80eb640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81f0107920 0x7f81f0100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:20.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.255+0000 7f81f80eb640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f81f0104ff0 0x7f81f0100670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:20.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.255+0000 7f81f80eb640 1 --2- 172.21.15.136:0/1051359476 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f81f01026c0 0x7f81f0102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:20.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.255+0000 7f81f80eb640 1 -- 172.21.15.136:0/1051359476 >> 172.21.15.136:0/1051359476 conn(0x7f81f00fc280 msgr2=0x7f81f0102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:20.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.255+0000 7f81f80eb640 1 -- 172.21.15.136:0/1051359476 shutdown_connections 2024-09-12T02:11:20.256 INFO:teuthology.orchestra.run.smithi136.stderr:2024-09-12T02:11:20.255+0000 7f81f80eb640 1 -- 172.21.15.136:0/1051359476 wait complete. 2024-09-12T02:11:20.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:19 smithi115 ceph-mon[35351]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:21.058 DEBUG:teuthology.orchestra.run.smithi110:mds.a> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.a.service 2024-09-12T02:11:21.062 DEBUG:teuthology.orchestra.run.smithi110:mds.d> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.d.service 2024-09-12T02:11:21.107 DEBUG:teuthology.orchestra.run.smithi110:mds.g> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.g.service 2024-09-12T02:11:21.152 DEBUG:teuthology.orchestra.run.smithi110:mds.j> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.j.service 2024-09-12T02:11:21.197 DEBUG:teuthology.orchestra.run.smithi115:mds.b> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.b.service 2024-09-12T02:11:21.199 DEBUG:teuthology.orchestra.run.smithi115:mds.e> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.e.service 2024-09-12T02:11:21.243 DEBUG:teuthology.orchestra.run.smithi115:mds.h> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.h.service 2024-09-12T02:11:21.287 DEBUG:teuthology.orchestra.run.smithi115:mds.k> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.k.service 2024-09-12T02:11:21.289 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:21 smithi136 ceph-mon[35814]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:11:21.289 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:21 smithi136 ceph-mon[35814]: Saving service mds.all spec with placement smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l;count:12 2024-09-12T02:11:21.289 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:21.289 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:11:21.289 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:21.289 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:11:21.290 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:21.290 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:21.290 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:21.290 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:21 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:21.290 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:21 smithi136 ceph-mon[35814]: Deploying daemon mds.l on smithi136 2024-09-12T02:11:21.330 DEBUG:teuthology.orchestra.run.smithi136:mds.c> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.c.service 2024-09-12T02:11:21.333 DEBUG:teuthology.orchestra.run.smithi136:mds.f> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.f.service 2024-09-12T02:11:21.376 DEBUG:teuthology.orchestra.run.smithi136:mds.i> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.i.service 2024-09-12T02:11:21.419 DEBUG:teuthology.orchestra.run.smithi136:mds.l> sudo journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.l.service 2024-09-12T02:11:21.440 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:21 smithi110 ceph-mon[30548]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:11:21.440 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:21 smithi110 ceph-mon[30548]: Saving service mds.all spec with placement smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l;count:12 2024-09-12T02:11:21.440 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:21.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:11:21.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:21.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:11:21.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:21.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:21.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:21.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:21 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:21.441 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:21 smithi110 ceph-mon[30548]: Deploying daemon mds.l on smithi136 2024-09-12T02:11:21.463 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-12T02:11:21.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:11:21.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:21 smithi115 ceph-mon[35351]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:11:21.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:21 smithi115 ceph-mon[35351]: Saving service mds.all spec with placement smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l;count:12 2024-09-12T02:11:21.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:21.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:11:21.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:21.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:11:21.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:21.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:21.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:21.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:21 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:21.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:21 smithi115 ceph-mon[35351]: Deploying daemon mds.l on smithi136 2024-09-12T02:11:21.825 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:22.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.399+0000 7f398f800640 1 -- 172.21.15.110:0/3735435490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3988109140 msgr2=0x7f3988110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:22.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.399+0000 7f398f800640 1 --2- 172.21.15.110:0/3735435490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3988109140 0x7f3988110cc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3980009ca0 tx=0x7f398002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:11:22.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.399+0000 7f398f800640 1 -- 172.21.15.110:0/3735435490 shutdown_connections 2024-09-12T02:11:22.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.399+0000 7f398f800640 1 --2- 172.21.15.110:0/3735435490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3988109140 0x7f3988110cc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:22.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.399+0000 7f398f800640 1 --2- 172.21.15.110:0/3735435490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39881049c0 0x7f3988108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:22.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.399+0000 7f398f800640 1 --2- 172.21.15.110:0/3735435490 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3988104010 0x7f39881043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:22.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.399+0000 7f398f800640 1 -- 172.21.15.110:0/3735435490 >> 172.21.15.110:0/3735435490 conn(0x7f39880ffa50 msgr2=0x7f3988101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:22.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.399+0000 7f398f800640 1 -- 172.21.15.110:0/3735435490 shutdown_connections 2024-09-12T02:11:22.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.399+0000 7f398f800640 1 -- 172.21.15.110:0/3735435490 wait complete. 2024-09-12T02:11:22.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.400+0000 7f398f800640 1 Processor -- start 2024-09-12T02:11:22.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.400+0000 7f398f800640 1 -- start start 2024-09-12T02:11:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.401+0000 7f398f800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3988104010 0x7f398819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.401+0000 7f398f800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39881049c0 0x7f398819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.401+0000 7f398f800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3988109140 0x7f398819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.401+0000 7f398f800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f39881141a0 con 0x7f3988109140 2024-09-12T02:11:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.401+0000 7f398f800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3988114020 con 0x7f39881049c0 2024-09-12T02:11:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.401+0000 7f398f800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3988114320 con 0x7f3988104010 2024-09-12T02:11:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.401+0000 7f398ce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3988104010 0x7f398819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.401+0000 7f398ce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3988104010 0x7f398819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:35178/0 (socket says 172.21.15.110:35178) 2024-09-12T02:11:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.401+0000 7f398ce00640 1 -- 172.21.15.110:0/3540241213 learned_addr learned my addr 172.21.15.110:0/3540241213 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.401+0000 7f3987e00640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39881049c0 0x7f398819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.401+0000 7f398d800640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3988109140 0x7f398819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.402+0000 7f398ce00640 1 -- 172.21.15.110:0/3540241213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39881049c0 msgr2=0x7f398819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.402+0000 7f398ce00640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39881049c0 0x7f398819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.402+0000 7f398ce00640 1 -- 172.21.15.110:0/3540241213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3988109140 msgr2=0x7f398819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.402+0000 7f398ce00640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3988109140 0x7f398819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:22.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.402+0000 7f398ce00640 1 -- 172.21.15.110:0/3540241213 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398819f650 con 0x7f3988104010 2024-09-12T02:11:22.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.402+0000 7f398ce00640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3988104010 0x7f398819a6a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f397800e9f0 tx=0x7f397800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:22.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.402+0000 7f3985600640 1 -- 172.21.15.110:0/3540241213 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397800cd80 con 0x7f3988104010 2024-09-12T02:11:22.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.402+0000 7f398f800640 1 -- 172.21.15.110:0/3540241213 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398819f940 con 0x7f3988104010 2024-09-12T02:11:22.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.402+0000 7f3985600640 1 -- 172.21.15.110:0/3540241213 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3978010910 con 0x7f3988104010 2024-09-12T02:11:22.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.402+0000 7f3985600640 1 -- 172.21.15.110:0/3540241213 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39780188f0 con 0x7f3988104010 2024-09-12T02:11:22.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.402+0000 7f398f800640 1 -- 172.21.15.110:0/3540241213 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39881a7220 con 0x7f3988104010 2024-09-12T02:11:22.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.403+0000 7f398f800640 1 -- 172.21.15.110:0/3540241213 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39881043f0 con 0x7f3988104010 2024-09-12T02:11:22.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.405+0000 7f3985600640 1 -- 172.21.15.110:0/3540241213 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3978010ac0 con 0x7f3988104010 2024-09-12T02:11:22.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.406+0000 7f3985600640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f396c0a2b80 0x7f396c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:22.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.407+0000 7f3985600640 1 -- 172.21.15.110:0/3540241213 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f39780cefd0 con 0x7f3988104010 2024-09-12T02:11:22.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.407+0000 7f3987e00640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f396c0a2b80 0x7f396c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:22.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.407+0000 7f3987e00640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f396c0a2b80 0x7f396c0a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f39880ffe70 tx=0x7f3974005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:22.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.410+0000 7f3985600640 1 -- 172.21.15.110:0/3540241213 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f397809bce0 con 0x7f3988104010 2024-09-12T02:11:22.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:22 smithi115 ceph-mon[35351]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:22.613 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:22 smithi136 ceph-mon[35814]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:22.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.621+0000 7f398f800640 1 -- 172.21.15.110:0/3540241213 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f398810c380 con 0x7f3988104010 2024-09-12T02:11:22.622 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:22 smithi110 ceph-mon[30548]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:22.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.622+0000 7f3985600640 1 -- 172.21.15.110:0/3540241213 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f397809ffe0 con 0x7f3988104010 2024-09-12T02:11:22.622 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:22.622 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":1,"btime":"2024-09-12T02:03:43:877639+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-12T02:11:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 1 2024-09-12T02:11:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.625+0000 7f398f800640 1 -- 172.21.15.110:0/3540241213 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f396c0a2b80 msgr2=0x7f396c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.625+0000 7f398f800640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f396c0a2b80 0x7f396c0a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f39880ffe70 tx=0x7f3974005f90 comp rx=0 tx=0).stop 2024-09-12T02:11:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.625+0000 7f398f800640 1 -- 172.21.15.110:0/3540241213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3988104010 msgr2=0x7f398819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.625+0000 7f398f800640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3988104010 0x7f398819a6a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f397800e9f0 tx=0x7f397800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:11:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.625+0000 7f398f800640 1 -- 172.21.15.110:0/3540241213 shutdown_connections 2024-09-12T02:11:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.625+0000 7f398f800640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f396c0a2b80 0x7f396c0a5040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.625+0000 7f398f800640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3988109140 0x7f398819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.625+0000 7f398f800640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39881049c0 0x7f398819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.625+0000 7f398f800640 1 --2- 172.21.15.110:0/3540241213 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3988104010 0x7f398819a6a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.625+0000 7f398f800640 1 -- 172.21.15.110:0/3540241213 >> 172.21.15.110:0/3540241213 conn(0x7f39880ffa50 msgr2=0x7f3988100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.625+0000 7f398f800640 1 -- 172.21.15.110:0/3540241213 shutdown_connections 2024-09-12T02:11:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:22.625+0000 7f398f800640 1 -- 172.21.15.110:0/3540241213 wait complete. 2024-09-12T02:11:22.908 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:11:22 smithi136 systemd[1]: Starting Ceph mds.l for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:11:23.259 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:11:23 smithi136 podman[65458]: 2024-09-12 02:11:22.910425234 +0000 UTC m=+0.015940102 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:23.259 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:11:23 smithi136 podman[65458]: 2024-09-12 02:11:23.033251793 +0000 UTC m=+0.138766654 container create 68aeba1b67e7d098314d1f6f4c963bf134e9424ef0f38dad98d090b509cf8625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-l, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:11:23.412 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:23 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3540241213' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:23.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:23 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3540241213' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:23.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:23 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3540241213' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:23.658 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:11:23 smithi136 podman[65458]: 2024-09-12 02:11:23.281656169 +0000 UTC m=+0.387171030 container init 68aeba1b67e7d098314d1f6f4c963bf134e9424ef0f38dad98d090b509cf8625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:11:23.659 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:11:23 smithi136 podman[65458]: 2024-09-12 02:11:23.284668734 +0000 UTC m=+0.390183605 container start 68aeba1b67e7d098314d1f6f4c963bf134e9424ef0f38dad98d090b509cf8625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-l, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T02:11:23.659 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:11:23 smithi136 ceph-mds[65477]: -- 172.21.15.136:0/3656679697 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5624a36b9860 con 0x5624a3696800 2024-09-12T02:11:23.659 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:11:23 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-l[65473]: starting mds.l at 2024-09-12T02:11:23.659 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:11:23 smithi136 bash[65458]: 68aeba1b67e7d098314d1f6f4c963bf134e9424ef0f38dad98d090b509cf8625 2024-09-12T02:11:23.659 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:11:23 smithi136 systemd[1]: Started Ceph mds.l for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:11:24.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:24 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.136:6832/701119527,v1:172.21.15.136:6833/701119527] up:boot 2024-09-12T02:11:24.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:24 smithi115 ceph-mon[35351]: fsmap 1 up:standby 2024-09-12T02:11:24.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:24 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:11:24.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:24 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:24.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:24 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:24.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:24 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:24.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:24 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:24.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:24 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:24.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:24 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:24.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:24 smithi115 ceph-mon[35351]: Deploying daemon mds.k on smithi115 2024-09-12T02:11:24.546 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:24 smithi115 ceph-mon[35351]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:24.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:24 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.136:6832/701119527,v1:172.21.15.136:6833/701119527] up:boot 2024-09-12T02:11:24.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:24 smithi136 ceph-mon[35814]: fsmap 1 up:standby 2024-09-12T02:11:24.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:24 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:11:24.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:24 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:24.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:24 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:24.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:24 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:24.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:24 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:24.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:24 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:24.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:24 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:24.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:24 smithi136 ceph-mon[35814]: Deploying daemon mds.k on smithi115 2024-09-12T02:11:24.660 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:24 smithi136 ceph-mon[35814]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:24.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:24 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.136:6832/701119527,v1:172.21.15.136:6833/701119527] up:boot 2024-09-12T02:11:24.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:24 smithi110 ceph-mon[30548]: fsmap 1 up:standby 2024-09-12T02:11:24.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:24 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:11:24.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:24 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:24.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:24 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:24.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:24 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:24.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:24 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:24.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:24 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:24.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:24 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:24.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:24 smithi110 ceph-mon[30548]: Deploying daemon mds.k on smithi115 2024-09-12T02:11:24.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:24 smithi110 ceph-mon[30548]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:25.459 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:11:25.544 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:11:25 smithi115 systemd[1]: Starting Ceph mds.k for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:11:25.833 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:25.921 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:11:25 smithi115 podman[64216]: 2024-09-12 02:11:25.550734228 +0000 UTC m=+0.015671576 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:25.921 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:11:25 smithi115 podman[64216]: 2024-09-12 02:11:25.66791726 +0000 UTC m=+0.132854603 container create fbc940a853b65505e9119acf0395a82f503e13be80e1d3828261a8cb3a7a2a98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-k, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T02:11:25.921 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:11:25 smithi115 podman[64216]: 2024-09-12 02:11:25.921076508 +0000 UTC m=+0.386013859 container init fbc940a853b65505e9119acf0395a82f503e13be80e1d3828261a8cb3a7a2a98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-k, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T02:11:26.294 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:11:25 smithi115 podman[64216]: 2024-09-12 02:11:25.924019862 +0000 UTC m=+0.388957205 container start fbc940a853b65505e9119acf0395a82f503e13be80e1d3828261a8cb3a7a2a98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:11:26.295 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:11:25 smithi115 ceph-mds[64236]: -- 172.21.15.115:0/347296012 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560f34b7b860 con 0x560f34b59400 2024-09-12T02:11:26.295 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:11:25 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-k[64232]: starting mds.k at 2024-09-12T02:11:26.295 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:11:26 smithi115 bash[64216]: fbc940a853b65505e9119acf0395a82f503e13be80e1d3828261a8cb3a7a2a98 2024-09-12T02:11:26.295 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:11:26 smithi115 systemd[1]: Started Ceph mds.k for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:11:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.352+0000 7faf2ce00640 1 -- 172.21.15.110:0/2218662703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf281049a0 msgr2=0x7faf281089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.352+0000 7faf2ce00640 1 --2- 172.21.15.110:0/2218662703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf281049a0 0x7faf281089f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faf10009900 tx=0x7faf1002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:11:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.352+0000 7faf2ce00640 1 -- 172.21.15.110:0/2218662703 shutdown_connections 2024-09-12T02:11:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.352+0000 7faf2ce00640 1 --2- 172.21.15.110:0/2218662703 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf28109120 0x7faf28110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:26.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.352+0000 7faf2ce00640 1 --2- 172.21.15.110:0/2218662703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf281049a0 0x7faf281089f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.352+0000 7faf2ce00640 1 --2- 172.21.15.110:0/2218662703 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28103ff0 0x7faf281043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.352+0000 7faf2ce00640 1 -- 172.21.15.110:0/2218662703 >> 172.21.15.110:0/2218662703 conn(0x7faf280ffa90 msgr2=0x7faf28101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.353+0000 7faf2ce00640 1 -- 172.21.15.110:0/2218662703 shutdown_connections 2024-09-12T02:11:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.353+0000 7faf2ce00640 1 -- 172.21.15.110:0/2218662703 wait complete. 2024-09-12T02:11:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.354+0000 7faf2ce00640 1 Processor -- start 2024-09-12T02:11:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.354+0000 7faf2ce00640 1 -- start start 2024-09-12T02:11:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.354+0000 7faf2ce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28103ff0 0x7faf2819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.354+0000 7faf2ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf281049a0 0x7faf2819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.354+0000 7faf2ce00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf28109120 0x7faf2819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.354+0000 7faf2ce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faf28114140 con 0x7faf281049a0 2024-09-12T02:11:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.354+0000 7faf2ce00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faf28113fc0 con 0x7faf28109120 2024-09-12T02:11:26.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.354+0000 7faf2ce00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7faf281142c0 con 0x7faf28103ff0 2024-09-12T02:11:26.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.354+0000 7faf1fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf281049a0 0x7faf2819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:26.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.354+0000 7faf25e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28103ff0 0x7faf2819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:26.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.354+0000 7faf25e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28103ff0 0x7faf2819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:35196/0 (socket says 172.21.15.110:35196) 2024-09-12T02:11:26.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.354+0000 7faf1fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf281049a0 0x7faf2819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:38436/0 (socket says 172.21.15.110:38436) 2024-09-12T02:11:26.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.355+0000 7faf25e00640 1 -- 172.21.15.110:0/4265686558 learned_addr learned my addr 172.21.15.110:0/4265686558 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:26.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.355+0000 7faf26800640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf28109120 0x7faf2819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:26.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.355+0000 7faf25e00640 1 -- 172.21.15.110:0/4265686558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf28109120 msgr2=0x7faf2819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:26.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.355+0000 7faf25e00640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf28109120 0x7faf2819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:26.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.355+0000 7faf25e00640 1 -- 172.21.15.110:0/4265686558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf281049a0 msgr2=0x7faf2819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:26.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.355+0000 7faf25e00640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf281049a0 0x7faf2819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:26.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.355+0000 7faf25e00640 1 -- 172.21.15.110:0/4265686558 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2819f5d0 con 0x7faf28103ff0 2024-09-12T02:11:26.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.355+0000 7faf26800640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf28109120 0x7faf2819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:11:26.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.355+0000 7faf25e00640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28103ff0 0x7faf2819a620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf1800d770 tx=0x7faf1800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:26.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.355+0000 7faf1ea00640 1 -- 172.21.15.110:0/4265686558 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18017070 con 0x7faf28103ff0 2024-09-12T02:11:26.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.356+0000 7faf1ea00640 1 -- 172.21.15.110:0/4265686558 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf18005500 con 0x7faf28103ff0 2024-09-12T02:11:26.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.356+0000 7faf2ce00640 1 -- 172.21.15.110:0/4265686558 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2819f8c0 con 0x7faf28103ff0 2024-09-12T02:11:26.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.356+0000 7faf1ea00640 1 -- 172.21.15.110:0/4265686558 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18004e00 con 0x7faf28103ff0 2024-09-12T02:11:26.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.356+0000 7faf2ce00640 1 -- 172.21.15.110:0/4265686558 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf281a71a0 con 0x7faf28103ff0 2024-09-12T02:11:26.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.357+0000 7faf2ce00640 1 -- 172.21.15.110:0/4265686558 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf281043d0 con 0x7faf28103ff0 2024-09-12T02:11:26.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.359+0000 7faf1ea00640 1 -- 172.21.15.110:0/4265686558 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7faf18004fa0 con 0x7faf28103ff0 2024-09-12T02:11:26.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.360+0000 7faf1ea00640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7faf0c0a2c00 0x7faf0c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:26.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.360+0000 7faf1ea00640 1 -- 172.21.15.110:0/4265686558 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7faf180ce560 con 0x7faf28103ff0 2024-09-12T02:11:26.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.361+0000 7faf1fe00640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7faf0c0a2c00 0x7faf0c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:26.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.361+0000 7faf1fe00640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7faf0c0a2c00 0x7faf0c0a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faf10009230 tx=0x7faf100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:26.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.363+0000 7faf1ea00640 1 -- 172.21.15.110:0/4265686558 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf1809b2f0 con 0x7faf28103ff0 2024-09-12T02:11:26.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.591+0000 7faf2ce00640 1 -- 172.21.15.110:0/4265686558 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf2819b980 con 0x7faf28103ff0 2024-09-12T02:11:26.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:26 smithi110 ceph-mon[30548]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:26.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:26.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:26.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:26.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:26.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:26.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:26 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:26.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.591+0000 7faf1ea00640 1 -- 172.21.15.110:0/4265686558 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7faf2819b980 con 0x7faf28103ff0 2024-09-12T02:11:26.593 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:26.593 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":3,"btime":"2024-09-12T02:11:26:488216+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:11:26.593 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 3 2024-09-12T02:11:26.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.595+0000 7faf2ce00640 1 -- 172.21.15.110:0/4265686558 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7faf0c0a2c00 msgr2=0x7faf0c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:26.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.595+0000 7faf2ce00640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7faf0c0a2c00 0x7faf0c0a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faf10009230 tx=0x7faf100058d0 comp rx=0 tx=0).stop 2024-09-12T02:11:26.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.595+0000 7faf2ce00640 1 -- 172.21.15.110:0/4265686558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28103ff0 msgr2=0x7faf2819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:26.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.595+0000 7faf2ce00640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28103ff0 0x7faf2819a620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf1800d770 tx=0x7faf1800dc30 comp rx=0 tx=0).stop 2024-09-12T02:11:26.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.595+0000 7faf2ce00640 1 -- 172.21.15.110:0/4265686558 shutdown_connections 2024-09-12T02:11:26.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.595+0000 7faf2ce00640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7faf0c0a2c00 0x7faf0c0a50c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:26.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.595+0000 7faf2ce00640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf28109120 0x7faf2819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:26.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.595+0000 7faf2ce00640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf281049a0 0x7faf2819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:26.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.595+0000 7faf2ce00640 1 --2- 172.21.15.110:0/4265686558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faf28103ff0 0x7faf2819a620 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:26.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.595+0000 7faf2ce00640 1 -- 172.21.15.110:0/4265686558 >> 172.21.15.110:0/4265686558 conn(0x7faf280ffa90 msgr2=0x7faf28100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:26.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.596+0000 7faf2ce00640 1 -- 172.21.15.110:0/4265686558 shutdown_connections 2024-09-12T02:11:26.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:26.596+0000 7faf2ce00640 1 -- 172.21.15.110:0/4265686558 wait complete. 2024-09-12T02:11:26.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:26 smithi115 ceph-mon[35351]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:26.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:26.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:26.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:26.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:26.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:26.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:26 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:26.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:26 smithi136 ceph-mon[35814]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:26.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:26.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:26.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:26.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:26.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:26.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:26 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:27.752 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:27 smithi110 ceph-mon[30548]: Deploying daemon mds.j on smithi110 2024-09-12T02:11:27.752 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:27 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.115:6832/2767472507,v1:172.21.15.115:6833/2767472507] up:boot 2024-09-12T02:11:27.752 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:27 smithi110 ceph-mon[30548]: fsmap 2 up:standby 2024-09-12T02:11:27.752 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:27 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:11:27.752 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:27 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/4265686558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:27 smithi115 ceph-mon[35351]: Deploying daemon mds.j on smithi110 2024-09-12T02:11:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:27 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.115:6832/2767472507,v1:172.21.15.115:6833/2767472507] up:boot 2024-09-12T02:11:27.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:27 smithi115 ceph-mon[35351]: fsmap 2 up:standby 2024-09-12T02:11:27.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:27 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:11:27.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:27 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/4265686558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:27.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:27 smithi136 ceph-mon[35814]: Deploying daemon mds.j on smithi110 2024-09-12T02:11:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:27 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.115:6832/2767472507,v1:172.21.15.115:6833/2767472507] up:boot 2024-09-12T02:11:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:27 smithi136 ceph-mon[35814]: fsmap 2 up:standby 2024-09-12T02:11:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:27 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:11:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:27 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/4265686558' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:28.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:28 smithi115 ceph-mon[35351]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:28.722 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:28 smithi110 ceph-mon[30548]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:28.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:28 smithi136 ceph-mon[35814]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:29.147 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:11:28 smithi110 systemd[1]: Starting Ceph mds.j for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:11:29.417 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:11:29 smithi110 podman[70575]: 2024-09-12 02:11:29.051213345 +0000 UTC m=+0.027501598 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:29.418 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:11:29 smithi110 podman[70575]: 2024-09-12 02:11:29.165096698 +0000 UTC m=+0.141384930 container create 6db31af053e74dc1bf402cc71c9d9e02b3f613ef1cdb1346fef9f59a81d2cb81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:11:29.418 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:11:29 smithi110 podman[70575]: 2024-09-12 02:11:29.418205007 +0000 UTC m=+0.394493240 container init 6db31af053e74dc1bf402cc71c9d9e02b3f613ef1cdb1346fef9f59a81d2cb81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-j, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T02:11:29.686 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:11:29 smithi110 podman[70575]: 2024-09-12 02:11:29.424389367 +0000 UTC m=+0.400677599 container start 6db31af053e74dc1bf402cc71c9d9e02b3f613ef1cdb1346fef9f59a81d2cb81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T02:11:29.686 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:11:29 smithi110 ceph-mds[70594]: -- 172.21.15.110:0/701424550 <== mon.0 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555882aabc20 con 0x555882a89400 2024-09-12T02:11:29.686 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:11:29 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-j[70590]: starting mds.j at 2024-09-12T02:11:29.686 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:11:29 smithi110 bash[70575]: 6db31af053e74dc1bf402cc71c9d9e02b3f613ef1cdb1346fef9f59a81d2cb81 2024-09-12T02:11:29.686 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:11:29 smithi110 systemd[1]: Started Ceph mds.j for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:11:30.759 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:11:30.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:30 smithi115 ceph-mon[35351]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:30.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:30 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.110:6834/1116222673,v1:172.21.15.110:6835/1116222673] up:boot 2024-09-12T02:11:30.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:30 smithi115 ceph-mon[35351]: fsmap 3 up:standby 2024-09-12T02:11:30.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:30 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:11:30.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:30 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:30.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:30 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:30.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:30 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:30.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:30 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:30.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:30 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:30.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:30 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:30.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:30 smithi115 ceph-mon[35351]: Deploying daemon mds.d on smithi110 2024-09-12T02:11:30.810 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:30 smithi110 ceph-mon[30548]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:30.810 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:30 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.110:6834/1116222673,v1:172.21.15.110:6835/1116222673] up:boot 2024-09-12T02:11:30.811 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:30 smithi110 ceph-mon[30548]: fsmap 3 up:standby 2024-09-12T02:11:30.811 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:30 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:11:30.811 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:30 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:30.811 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:30 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:30.811 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:30 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:30.811 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:30 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:30.811 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:30 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:30.811 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:30 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:30.811 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:30 smithi110 ceph-mon[30548]: Deploying daemon mds.d on smithi110 2024-09-12T02:11:30.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:30 smithi136 ceph-mon[35814]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:30 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.110:6834/1116222673,v1:172.21.15.110:6835/1116222673] up:boot 2024-09-12T02:11:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:30 smithi136 ceph-mon[35814]: fsmap 3 up:standby 2024-09-12T02:11:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:30 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:11:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:30 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:30 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:30 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:30 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:30 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:30 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:30.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:30 smithi136 ceph-mon[35814]: Deploying daemon mds.d on smithi110 2024-09-12T02:11:31.581 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:32.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.429+0000 7f2105000640 1 -- 172.21.15.110:0/2705314250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21001049c0 msgr2=0x7f2100108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:32.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.429+0000 7f2105000640 1 --2- 172.21.15.110:0/2705314250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21001049c0 0x7f2100108a10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009900 tx=0x7f20ec02a410 comp rx=0 tx=0).stop 2024-09-12T02:11:32.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.429+0000 7f2105000640 1 -- 172.21.15.110:0/2705314250 shutdown_connections 2024-09-12T02:11:32.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.429+0000 7f2105000640 1 --2- 172.21.15.110:0/2705314250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2100109140 0x7f2100110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:32.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.429+0000 7f2105000640 1 --2- 172.21.15.110:0/2705314250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21001049c0 0x7f2100108a10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:32.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.429+0000 7f2105000640 1 --2- 172.21.15.110:0/2705314250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100104010 0x7f21001043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:32.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.429+0000 7f2105000640 1 -- 172.21.15.110:0/2705314250 >> 172.21.15.110:0/2705314250 conn(0x7f21000ffa50 msgr2=0x7f2100101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:32.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.429+0000 7f2105000640 1 -- 172.21.15.110:0/2705314250 shutdown_connections 2024-09-12T02:11:32.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.429+0000 7f2105000640 1 -- 172.21.15.110:0/2705314250 wait complete. 2024-09-12T02:11:32.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.430+0000 7f2105000640 1 Processor -- start 2024-09-12T02:11:32.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.431+0000 7f2105000640 1 -- start start 2024-09-12T02:11:32.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.431+0000 7f2105000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100104010 0x7f210019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:32.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.431+0000 7f2105000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21001049c0 0x7f210019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:32.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.431+0000 7f2105000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2100109140 0x7f210019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:32.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.431+0000 7f2105000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2100114160 con 0x7f21001049c0 2024-09-12T02:11:32.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.431+0000 7f2105000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2100113fe0 con 0x7f2100109140 2024-09-12T02:11:32.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.431+0000 7f2105000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f21001142e0 con 0x7f2100104010 2024-09-12T02:11:32.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.432+0000 7f20fde00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100104010 0x7f210019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:32.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.432+0000 7f20fde00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100104010 0x7f210019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:43796/0 (socket says 172.21.15.110:43796) 2024-09-12T02:11:32.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.432+0000 7f20fde00640 1 -- 172.21.15.110:0/2621706917 learned_addr learned my addr 172.21.15.110:0/2621706917 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:32.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.432+0000 7f20fe800640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2100109140 0x7f210019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:32.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.432+0000 7f20fd400640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21001049c0 0x7f210019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:32.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.432+0000 7f20fde00640 1 -- 172.21.15.110:0/2621706917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2100109140 msgr2=0x7f210019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:32.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.432+0000 7f20fde00640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2100109140 0x7f210019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:32.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.432+0000 7f20fde00640 1 -- 172.21.15.110:0/2621706917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21001049c0 msgr2=0x7f210019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:32.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.432+0000 7f20fde00640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21001049c0 0x7f210019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:32.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.432+0000 7f20fde00640 1 -- 172.21.15.110:0/2621706917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210019f610 con 0x7f2100104010 2024-09-12T02:11:32.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.432+0000 7f20fde00640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100104010 0x7f210019a660 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20f000e9f0 tx=0x7f20f000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:32.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.433+0000 7f20f6a00640 1 -- 172.21.15.110:0/2621706917 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f000cd80 con 0x7f2100104010 2024-09-12T02:11:32.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.433+0000 7f2105000640 1 -- 172.21.15.110:0/2621706917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210019f900 con 0x7f2100104010 2024-09-12T02:11:32.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.433+0000 7f20f6a00640 1 -- 172.21.15.110:0/2621706917 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20f0005500 con 0x7f2100104010 2024-09-12T02:11:32.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.433+0000 7f20f6a00640 1 -- 172.21.15.110:0/2621706917 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0010690 con 0x7f2100104010 2024-09-12T02:11:32.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.433+0000 7f2105000640 1 -- 172.21.15.110:0/2621706917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21001a71e0 con 0x7f2100104010 2024-09-12T02:11:32.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.434+0000 7f2105000640 1 -- 172.21.15.110:0/2621706917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21001043f0 con 0x7f2100104010 2024-09-12T02:11:32.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.436+0000 7f20f6a00640 1 -- 172.21.15.110:0/2621706917 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f20f00046c0 con 0x7f2100104010 2024-09-12T02:11:32.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.437+0000 7f20f6a00640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f20e40a2c00 0x7f20e40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:32.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.438+0000 7f20f6a00640 1 -- 172.21.15.110:0/2621706917 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f20f00cefc0 con 0x7f2100104010 2024-09-12T02:11:32.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.438+0000 7f20fd400640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f20e40a2c00 0x7f20e40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:32.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.438+0000 7f20fd400640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f20e40a2c00 0x7f20e40a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009230 tx=0x7f20ec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:32.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.440+0000 7f20f6a00640 1 -- 172.21.15.110:0/2621706917 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f20f009c320 con 0x7f2100104010 2024-09-12T02:11:32.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.678+0000 7f2105000640 1 -- 172.21.15.110:0/2621706917 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f210010c3e0 con 0x7f2100104010 2024-09-12T02:11:32.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.679+0000 7f20f6a00640 1 -- 172.21.15.110:0/2621706917 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f20f009bc20 con 0x7f2100104010 2024-09-12T02:11:32.679 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:32.679 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":4,"btime":"2024-09-12T02:11:29:501008+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:11:32.679 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 4 2024-09-12T02:11:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.681+0000 7f2105000640 1 -- 172.21.15.110:0/2621706917 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f20e40a2c00 msgr2=0x7f20e40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.681+0000 7f2105000640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f20e40a2c00 0x7f20e40a50c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009230 tx=0x7f20ec0058d0 comp rx=0 tx=0).stop 2024-09-12T02:11:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.681+0000 7f2105000640 1 -- 172.21.15.110:0/2621706917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100104010 msgr2=0x7f210019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.681+0000 7f2105000640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100104010 0x7f210019a660 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20f000e9f0 tx=0x7f20f000edf0 comp rx=0 tx=0).stop 2024-09-12T02:11:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.681+0000 7f2105000640 1 -- 172.21.15.110:0/2621706917 shutdown_connections 2024-09-12T02:11:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.681+0000 7f2105000640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f20e40a2c00 0x7f20e40a50c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.681+0000 7f2105000640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2100109140 0x7f210019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.681+0000 7f2105000640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21001049c0 0x7f210019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.681+0000 7f2105000640 1 --2- 172.21.15.110:0/2621706917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2100104010 0x7f210019a660 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:32.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.681+0000 7f2105000640 1 -- 172.21.15.110:0/2621706917 >> 172.21.15.110:0/2621706917 conn(0x7f21000ffa50 msgr2=0x7f2100100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:32.682 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:32 smithi110 ceph-mon[30548]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:32.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.682+0000 7f2105000640 1 -- 172.21.15.110:0/2621706917 shutdown_connections 2024-09-12T02:11:32.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:32.682+0000 7f2105000640 1 -- 172.21.15.110:0/2621706917 wait complete. 2024-09-12T02:11:32.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:32 smithi115 ceph-mon[35351]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:32.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:32 smithi136 ceph-mon[35814]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:33.682 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:33 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2621706917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:33.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:33 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2621706917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:33.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:33 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2621706917' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:33.937 INFO:journalctl@ceph.mds.d.smithi110.stdout:Sep 12 02:11:33 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-d[70997]: starting mds.d at 2024-09-12T02:11:34.436 INFO:journalctl@ceph.mds.d.smithi110.stdout:Sep 12 02:11:33 smithi110 bash[70969]: db5421d39bba1bcb2dc8f794fceb7d627c9bf63a7fd11471f0ebef652a118afc 2024-09-12T02:11:34.436 INFO:journalctl@ceph.mds.d.smithi110.stdout:Sep 12 02:11:33 smithi110 systemd[1]: Started Ceph mds.d for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:11:34.726 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:34 smithi115 ceph-mon[35351]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:34.727 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:34 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:34.727 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:34 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:34.727 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:34 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:34.727 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:34 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:34.727 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:34 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:34.727 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:34 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:34.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:34 smithi136 ceph-mon[35814]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:34.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:34 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:34.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:34 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:34.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:34 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:34.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:34 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:34.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:34 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:34.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:34 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:34.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:34 smithi110 ceph-mon[30548]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:34.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:34 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:34.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:34 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:34.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:34 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:34.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:34 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:34.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:34 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:34.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:34 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:35.718 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:11:35.775 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:35 smithi110 ceph-mon[30548]: Deploying daemon mds.e on smithi115 2024-09-12T02:11:35.775 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:35 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.110:6836/574606945,v1:172.21.15.110:6837/574606945] up:boot 2024-09-12T02:11:35.775 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:35 smithi110 ceph-mon[30548]: fsmap 4 up:standby 2024-09-12T02:11:35.775 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:35 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:11:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:35 smithi115 ceph-mon[35351]: Deploying daemon mds.e on smithi115 2024-09-12T02:11:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:35 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.110:6836/574606945,v1:172.21.15.110:6837/574606945] up:boot 2024-09-12T02:11:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:35 smithi115 ceph-mon[35351]: fsmap 4 up:standby 2024-09-12T02:11:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:35 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:11:35.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:35 smithi136 ceph-mon[35814]: Deploying daemon mds.e on smithi115 2024-09-12T02:11:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:35 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.110:6836/574606945,v1:172.21.15.110:6837/574606945] up:boot 2024-09-12T02:11:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:35 smithi136 ceph-mon[35814]: fsmap 4 up:standby 2024-09-12T02:11:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:35 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:11:36.098 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:36.290 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:11:36 smithi115 systemd[1]: Starting Ceph mds.e for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:11:36.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:36 smithi115 ceph-mon[35351]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:36.545 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:11:36 smithi115 podman[64531]: 2024-09-12 02:11:36.193336384 +0000 UTC m=+0.015807461 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:36.545 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:11:36 smithi115 podman[64531]: 2024-09-12 02:11:36.322730473 +0000 UTC m=+0.145201544 container create 98167f62abd0ebb10736b96b74df3b41190d7c75ec82a0fa98a65a4215eb427e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:11:36.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.691+0000 7fbbf7400640 1 -- 172.21.15.110:0/2328747564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf0076720 msgr2=0x7fbbf0076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:36.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.691+0000 7fbbf7400640 1 --2- 172.21.15.110:0/2328747564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf0076720 0x7fbbf0076b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009900 tx=0x7fbbe402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:11:36.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.691+0000 7fbbf7400640 1 -- 172.21.15.110:0/2328747564 shutdown_connections 2024-09-12T02:11:36.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.691+0000 7fbbf7400640 1 --2- 172.21.15.110:0/2328747564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf0112a30 0x7fbbf0114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:36.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.691+0000 7fbbf7400640 1 --2- 172.21.15.110:0/2328747564 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf0077040 0x7fbbf01124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:36.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.691+0000 7fbbf7400640 1 --2- 172.21.15.110:0/2328747564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf0076720 0x7fbbf0076b00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:36.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.691+0000 7fbbf7400640 1 -- 172.21.15.110:0/2328747564 >> 172.21.15.110:0/2328747564 conn(0x7fbbf00ffa90 msgr2=0x7fbbf0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:36.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.691+0000 7fbbf7400640 1 -- 172.21.15.110:0/2328747564 shutdown_connections 2024-09-12T02:11:36.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.691+0000 7fbbf7400640 1 -- 172.21.15.110:0/2328747564 wait complete. 2024-09-12T02:11:36.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.692+0000 7fbbf7400640 1 Processor -- start 2024-09-12T02:11:36.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.692+0000 7fbbf7400640 1 -- start start 2024-09-12T02:11:36.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf0076720 0x7fbbf01a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:36.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf7400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf0077040 0x7fbbf01a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:36.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf7400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf0112a30 0x7fbbf019e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:36.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf7400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf01185f0 con 0x7fbbf0076720 2024-09-12T02:11:36.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf7400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0118470 con 0x7fbbf0077040 2024-09-12T02:11:36.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf7400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0118770 con 0x7fbbf0112a30 2024-09-12T02:11:36.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf4a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf0076720 0x7fbbf01a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:36.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf4a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf0076720 0x7fbbf01a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:37788/0 (socket says 172.21.15.110:37788) 2024-09-12T02:11:36.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf4a00640 1 -- 172.21.15.110:0/4023282332 learned_addr learned my addr 172.21.15.110:0/4023282332 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:36.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbefe00640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf0077040 0x7fbbf01a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf5400640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf0112a30 0x7fbbf019e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf4a00640 1 -- 172.21.15.110:0/4023282332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf0112a30 msgr2=0x7fbbf019e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf4a00640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf0112a30 0x7fbbf019e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf4a00640 1 -- 172.21.15.110:0/4023282332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf0077040 msgr2=0x7fbbf01a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf4a00640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf0077040 0x7fbbf01a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf4a00640 1 -- 172.21.15.110:0/4023282332 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf019efd0 con 0x7fbbf0076720 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbefe00640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf0077040 0x7fbbf01a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.693+0000 7fbbf5400640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf0112a30 0x7fbbf019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.694+0000 7fbbf4a00640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf0076720 0x7fbbf01a46e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4004770 tx=0x7fbbe4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.694+0000 7fbbed600640 1 -- 172.21.15.110:0/4023282332 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe403f070 con 0x7fbbf0076720 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.694+0000 7fbbed600640 1 -- 172.21.15.110:0/4023282332 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbe4031ca0 con 0x7fbbf0076720 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.694+0000 7fbbf7400640 1 -- 172.21.15.110:0/4023282332 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf019f260 con 0x7fbbf0076720 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.694+0000 7fbbed600640 1 -- 172.21.15.110:0/4023282332 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4035030 con 0x7fbbf0076720 2024-09-12T02:11:36.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.694+0000 7fbbf7400640 1 -- 172.21.15.110:0/4023282332 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf01ab5b0 con 0x7fbbf0076720 2024-09-12T02:11:36.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.696+0000 7fbbf7400640 1 -- 172.21.15.110:0/4023282332 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf0076b00 con 0x7fbbf0076720 2024-09-12T02:11:36.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.697+0000 7fbbed600640 1 -- 172.21.15.110:0/4023282332 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fbbe4042070 con 0x7fbbf0076720 2024-09-12T02:11:36.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.698+0000 7fbbed600640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fbbd80a2c00 0x7fbbd80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:36.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.699+0000 7fbbed600640 1 -- 172.21.15.110:0/4023282332 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fbbe40eee00 con 0x7fbbf0076720 2024-09-12T02:11:36.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.699+0000 7fbbefe00640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fbbd80a2c00 0x7fbbd80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:36.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.699+0000 7fbbefe00640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fbbd80a2c00 0x7fbbd80a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00095f0 tx=0x7fbbe0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:36.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.703+0000 7fbbed600640 1 -- 172.21.15.110:0/4023282332 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbbe40bc160 con 0x7fbbf0076720 2024-09-12T02:11:36.716 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:36 smithi110 ceph-mon[30548]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:36.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:36 smithi136 ceph-mon[35814]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:36.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.938+0000 7fbbf7400640 1 -- 172.21.15.110:0/4023282332 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbf010dbc0 con 0x7fbbf0076720 2024-09-12T02:11:36.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.939+0000 7fbbed600640 1 -- 172.21.15.110:0/4023282332 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7fbbe40bba60 con 0x7fbbf0076720 2024-09-12T02:11:36.940 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:36.940 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":5,"btime":"2024-09-12T02:11:34:513003+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T02:11:36.940 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 5 2024-09-12T02:11:36.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.941+0000 7fbbf7400640 1 -- 172.21.15.110:0/4023282332 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fbbd80a2c00 msgr2=0x7fbbd80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:36.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.941+0000 7fbbf7400640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fbbd80a2c00 0x7fbbd80a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00095f0 tx=0x7fbbe0005f90 comp rx=0 tx=0).stop 2024-09-12T02:11:36.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.941+0000 7fbbf7400640 1 -- 172.21.15.110:0/4023282332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf0076720 msgr2=0x7fbbf01a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:36.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.941+0000 7fbbf7400640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf0076720 0x7fbbf01a46e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4004770 tx=0x7fbbe4003c10 comp rx=0 tx=0).stop 2024-09-12T02:11:36.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.941+0000 7fbbf7400640 1 -- 172.21.15.110:0/4023282332 shutdown_connections 2024-09-12T02:11:36.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.941+0000 7fbbf7400640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fbbd80a2c00 0x7fbbd80a50c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:36.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.941+0000 7fbbf7400640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbbf0112a30 0x7fbbf019e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:36.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.941+0000 7fbbf7400640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbbf0077040 0x7fbbf01a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:36.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.941+0000 7fbbf7400640 1 --2- 172.21.15.110:0/4023282332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbf0076720 0x7fbbf01a46e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:36.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.941+0000 7fbbf7400640 1 -- 172.21.15.110:0/4023282332 >> 172.21.15.110:0/4023282332 conn(0x7fbbf00ffa90 msgr2=0x7fbbf0113630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:36.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.942+0000 7fbbf7400640 1 -- 172.21.15.110:0/4023282332 shutdown_connections 2024-09-12T02:11:36.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:36.942+0000 7fbbf7400640 1 -- 172.21.15.110:0/4023282332 wait complete. 2024-09-12T02:11:37.044 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:11:36 smithi115 podman[64531]: 2024-09-12 02:11:36.567192918 +0000 UTC m=+0.389663983 container init 98167f62abd0ebb10736b96b74df3b41190d7c75ec82a0fa98a65a4215eb427e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T02:11:37.044 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:11:36 smithi115 podman[64531]: 2024-09-12 02:11:36.570227321 +0000 UTC m=+0.392698387 container start 98167f62abd0ebb10736b96b74df3b41190d7c75ec82a0fa98a65a4215eb427e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T02:11:37.044 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:11:36 smithi115 ceph-mds[64550]: -- 172.21.15.115:0/1140030300 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5652ba54bc20 con 0x5652ba529000 2024-09-12T02:11:37.045 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:11:36 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-e[64546]: starting mds.e at 2024-09-12T02:11:37.045 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:11:36 smithi115 bash[64531]: 98167f62abd0ebb10736b96b74df3b41190d7c75ec82a0fa98a65a4215eb427e 2024-09-12T02:11:37.045 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:11:36 smithi115 systemd[1]: Started Ceph mds.e for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:11:37.962 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:37 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:37.962 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:37 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:37.962 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:37 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:37.963 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:37 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:37.963 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:37 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:37.963 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:37 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:37.963 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:37 smithi110 ceph-mon[30548]: Deploying daemon mds.f on smithi136 2024-09-12T02:11:37.963 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:37 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/4023282332' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:37.963 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:37 smithi110 ceph-mon[30548]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:37.963 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:37 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.115:6834/3409231586,v1:172.21.15.115:6835/3409231586] up:boot 2024-09-12T02:11:37.963 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:37 smithi110 ceph-mon[30548]: fsmap 5 up:standby 2024-09-12T02:11:37.963 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:37 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:11:38.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:38.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:37 smithi115 ceph-mon[35351]: Deploying daemon mds.f on smithi136 2024-09-12T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:37 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/4023282332' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:37 smithi115 ceph-mon[35351]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:37 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.115:6834/3409231586,v1:172.21.15.115:6835/3409231586] up:boot 2024-09-12T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:37 smithi115 ceph-mon[35351]: fsmap 5 up:standby 2024-09-12T02:11:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:37 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:11:38.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:37 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:38.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:37 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:38.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:37 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:38.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:37 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:38.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:37 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:38.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:37 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:38.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:37 smithi136 ceph-mon[35814]: Deploying daemon mds.f on smithi136 2024-09-12T02:11:38.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:37 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/4023282332' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:38.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:37 smithi136 ceph-mon[35814]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:38.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:37 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.115:6834/3409231586,v1:172.21.15.115:6835/3409231586] up:boot 2024-09-12T02:11:38.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:37 smithi136 ceph-mon[35814]: fsmap 5 up:standby 2024-09-12T02:11:38.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:37 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:11:38.869 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:11:38 smithi136 systemd[1]: Starting Ceph mds.f for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:11:39.130 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:11:38 smithi136 podman[65761]: 2024-09-12 02:11:38.771497848 +0000 UTC m=+0.015464347 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:39.131 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:11:38 smithi136 podman[65761]: 2024-09-12 02:11:38.88660183 +0000 UTC m=+0.130568319 container create 54f541aac00618ff583817223cca2deae4b0369863bdaf7ed5d83c827d8b93bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-12T02:11:39.131 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:11:39 smithi136 podman[65761]: 2024-09-12 02:11:39.131326297 +0000 UTC m=+0.375292786 container init 54f541aac00618ff583817223cca2deae4b0369863bdaf7ed5d83c827d8b93bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:11:39.408 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:11:39 smithi136 podman[65761]: 2024-09-12 02:11:39.134200674 +0000 UTC m=+0.378167165 container start 54f541aac00618ff583817223cca2deae4b0369863bdaf7ed5d83c827d8b93bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-f, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T02:11:39.408 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:11:39 smithi136 ceph-mds[65780]: -- 172.21.15.136:0/3841252932 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55952fcf7860 con 0x55952fcd5400 2024-09-12T02:11:39.409 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:11:39 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-f[65776]: starting mds.f at 2024-09-12T02:11:39.409 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:11:39 smithi136 bash[65761]: 54f541aac00618ff583817223cca2deae4b0369863bdaf7ed5d83c827d8b93bf 2024-09-12T02:11:39.409 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:11:39 smithi136 systemd[1]: Started Ceph mds.f for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:11:39.741 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:11:40.117 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:40.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:40 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.136:6834/2205978549,v1:172.21.15.136:6835/2205978549] up:boot 2024-09-12T02:11:40.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:40 smithi136 ceph-mon[35814]: fsmap 6 up:standby 2024-09-12T02:11:40.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:11:40.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:40.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:40.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:40.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:40.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:40.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:40 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:40.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:40 smithi136 ceph-mon[35814]: Deploying daemon mds.c on smithi136 2024-09-12T02:11:40.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:40 smithi136 ceph-mon[35814]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:40.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:40 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.136:6834/2205978549,v1:172.21.15.136:6835/2205978549] up:boot 2024-09-12T02:11:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:40 smithi115 ceph-mon[35351]: fsmap 6 up:standby 2024-09-12T02:11:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:11:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:40 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:40 smithi115 ceph-mon[35351]: Deploying daemon mds.c on smithi136 2024-09-12T02:11:40.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:40 smithi115 ceph-mon[35351]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:40.563 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:40 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.136:6834/2205978549,v1:172.21.15.136:6835/2205978549] up:boot 2024-09-12T02:11:40.563 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:40 smithi110 ceph-mon[30548]: fsmap 6 up:standby 2024-09-12T02:11:40.563 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:11:40.563 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:40.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:40.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:40.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:40.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:40.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:40 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:40.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:40 smithi110 ceph-mon[30548]: Deploying daemon mds.c on smithi136 2024-09-12T02:11:40.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:40 smithi110 ceph-mon[30548]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:40.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.674+0000 7fda71000640 1 -- 172.21.15.110:0/3110788480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda6c104800 msgr2=0x7fda6c108960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:40.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.674+0000 7fda71000640 1 --2- 172.21.15.110:0/3110788480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda6c104800 0x7fda6c108960 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fda54009900 tx=0x7fda5402a410 comp rx=0 tx=0).stop 2024-09-12T02:11:40.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.674+0000 7fda71000640 1 -- 172.21.15.110:0/3110788480 shutdown_connections 2024-09-12T02:11:40.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.674+0000 7fda71000640 1 --2- 172.21.15.110:0/3110788480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda6c109090 0x7fda6c110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:40.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.674+0000 7fda71000640 1 --2- 172.21.15.110:0/3110788480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda6c104800 0x7fda6c108960 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:40.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.674+0000 7fda71000640 1 --2- 172.21.15.110:0/3110788480 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda6c103e50 0x7fda6c104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:40.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.674+0000 7fda71000640 1 -- 172.21.15.110:0/3110788480 >> 172.21.15.110:0/3110788480 conn(0x7fda6c0ff8b0 msgr2=0x7fda6c101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:40.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.674+0000 7fda71000640 1 -- 172.21.15.110:0/3110788480 shutdown_connections 2024-09-12T02:11:40.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.674+0000 7fda71000640 1 -- 172.21.15.110:0/3110788480 wait complete. 2024-09-12T02:11:40.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.675+0000 7fda71000640 1 Processor -- start 2024-09-12T02:11:40.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.675+0000 7fda71000640 1 -- start start 2024-09-12T02:11:40.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.675+0000 7fda71000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda6c103e50 0x7fda6c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.675+0000 7fda71000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda6c104800 0x7fda6c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.675+0000 7fda71000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda6c109090 0x7fda6c19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.675+0000 7fda71000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c1140e0 con 0x7fda6c103e50 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.675+0000 7fda71000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c113f60 con 0x7fda6c109090 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.675+0000 7fda71000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fda6c114260 con 0x7fda6c104800 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.676+0000 7fda6b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda6c103e50 0x7fda6c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.676+0000 7fda6b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda6c103e50 0x7fda6c19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35612/0 (socket says 172.21.15.110:35612) 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.676+0000 7fda63e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda6c104800 0x7fda6c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.676+0000 7fda6b400640 1 -- 172.21.15.110:0/429039390 learned_addr learned my addr 172.21.15.110:0/429039390 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.676+0000 7fda6be00640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda6c109090 0x7fda6c19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.676+0000 7fda6b400640 1 -- 172.21.15.110:0/429039390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda6c104800 msgr2=0x7fda6c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.676+0000 7fda6b400640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda6c104800 0x7fda6c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:40.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.676+0000 7fda6b400640 1 -- 172.21.15.110:0/429039390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda6c109090 msgr2=0x7fda6c19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:40.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.676+0000 7fda6b400640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda6c109090 0x7fda6c19ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:40.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.676+0000 7fda6b400640 1 -- 172.21.15.110:0/429039390 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c19f550 con 0x7fda6c103e50 2024-09-12T02:11:40.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.676+0000 7fda6be00640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda6c109090 0x7fda6c19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:11:40.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.676+0000 7fda6b400640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda6c103e50 0x7fda6c19a5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00e9f0 tx=0x7fda5c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:40.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.677+0000 7fda68c00640 1 -- 172.21.15.110:0/429039390 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00cd80 con 0x7fda6c103e50 2024-09-12T02:11:40.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.677+0000 7fda68c00640 1 -- 172.21.15.110:0/429039390 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda5c010910 con 0x7fda6c103e50 2024-09-12T02:11:40.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.677+0000 7fda71000640 1 -- 172.21.15.110:0/429039390 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6c19f840 con 0x7fda6c103e50 2024-09-12T02:11:40.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.677+0000 7fda68c00640 1 -- 172.21.15.110:0/429039390 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c018990 con 0x7fda6c103e50 2024-09-12T02:11:40.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.677+0000 7fda71000640 1 -- 172.21.15.110:0/429039390 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda6c1a7120 con 0x7fda6c103e50 2024-09-12T02:11:40.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.678+0000 7fda71000640 1 -- 172.21.15.110:0/429039390 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda6c105330 con 0x7fda6c103e50 2024-09-12T02:11:40.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.680+0000 7fda68c00640 1 -- 172.21.15.110:0/429039390 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fda5c010ac0 con 0x7fda6c103e50 2024-09-12T02:11:40.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.682+0000 7fda68c00640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fda500a2c00 0x7fda500a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:40.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.682+0000 7fda68c00640 1 -- 172.21.15.110:0/429039390 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fda5c0cf510 con 0x7fda6c103e50 2024-09-12T02:11:40.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.682+0000 7fda63e00640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fda500a2c00 0x7fda500a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:40.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.683+0000 7fda63e00640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fda500a2c00 0x7fda500a50c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda54000c00 tx=0x7fda54005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:40.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.685+0000 7fda68c00640 1 -- 172.21.15.110:0/429039390 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda5c09c870 con 0x7fda6c103e50 2024-09-12T02:11:40.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.897+0000 7fda71000640 1 -- 172.21.15.110:0/429039390 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda6c104230 con 0x7fda6c103e50 2024-09-12T02:11:40.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.897+0000 7fda68c00640 1 -- 172.21.15.110:0/429039390 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5572 (secure 0 0 0) 0x7fda5c09c170 con 0x7fda6c103e50 2024-09-12T02:11:40.898 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:40.898 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":7,"btime":"2024-09-12T02:11:39:212754+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-12T02:11:40.898 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 7 2024-09-12T02:11:40.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.900+0000 7fda71000640 1 -- 172.21.15.110:0/429039390 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fda500a2c00 msgr2=0x7fda500a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:40.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.900+0000 7fda71000640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fda500a2c00 0x7fda500a50c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fda54000c00 tx=0x7fda54005b50 comp rx=0 tx=0).stop 2024-09-12T02:11:40.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.900+0000 7fda71000640 1 -- 172.21.15.110:0/429039390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda6c103e50 msgr2=0x7fda6c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:40.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.900+0000 7fda71000640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda6c103e50 0x7fda6c19a5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00e9f0 tx=0x7fda5c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:11:40.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.900+0000 7fda71000640 1 -- 172.21.15.110:0/429039390 shutdown_connections 2024-09-12T02:11:40.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.900+0000 7fda71000640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fda500a2c00 0x7fda500a50c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:40.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.900+0000 7fda71000640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda6c109090 0x7fda6c19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:40.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.900+0000 7fda71000640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda6c104800 0x7fda6c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:40.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.900+0000 7fda71000640 1 --2- 172.21.15.110:0/429039390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda6c103e50 0x7fda6c19a5a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:40.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.900+0000 7fda71000640 1 -- 172.21.15.110:0/429039390 >> 172.21.15.110:0/429039390 conn(0x7fda6c0ff8b0 msgr2=0x7fda6c100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:40.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.900+0000 7fda71000640 1 -- 172.21.15.110:0/429039390 shutdown_connections 2024-09-12T02:11:40.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:40.900+0000 7fda71000640 1 -- 172.21.15.110:0/429039390 wait complete. 2024-09-12T02:11:41.556 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:41 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/429039390' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:41.556 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:11:41 smithi136 systemd[1]: Starting Ceph mds.c for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:11:41.635 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:41 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/429039390' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:41 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/429039390' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:41.870 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:11:41 smithi136 podman[66060]: 2024-09-12 02:11:41.459110577 +0000 UTC m=+0.015896428 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:41.870 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:11:41 smithi136 podman[66060]: 2024-09-12 02:11:41.601331197 +0000 UTC m=+0.158117080 container create 308a66ea38d923d7e6dec36b489332ff02ada301a1fdf024448a21d3b6293ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T02:11:41.870 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:11:41 smithi136 podman[66060]: 2024-09-12 02:11:41.870837411 +0000 UTC m=+0.427623252 container init 308a66ea38d923d7e6dec36b489332ff02ada301a1fdf024448a21d3b6293ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-12T02:11:42.158 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:11:41 smithi136 podman[66060]: 2024-09-12 02:11:41.873840135 +0000 UTC m=+0.430625973 container start 308a66ea38d923d7e6dec36b489332ff02ada301a1fdf024448a21d3b6293ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:11:42.159 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:11:41 smithi136 ceph-mds[66079]: -- 172.21.15.136:0/3629344889 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56351da3b860 con 0x56351da18800 2024-09-12T02:11:42.159 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:11:41 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c[66075]: starting mds.c at 2024-09-12T02:11:42.159 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:11:41 smithi136 bash[66060]: 308a66ea38d923d7e6dec36b489332ff02ada301a1fdf024448a21d3b6293ef8 2024-09-12T02:11:42.159 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:11:41 smithi136 systemd[1]: Started Ceph mds.c for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:11:42.599 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:42 smithi115 ceph-mon[35351]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:42.599 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:42.599 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:42.599 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:42.599 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:42.599 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:42.600 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:42 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:42.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:42 smithi136 ceph-mon[35814]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:42.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:42.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:42.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:42.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:42.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:42.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:42 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:42 smithi110 ceph-mon[30548]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:42.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:42 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:43.608 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:43 smithi115 ceph-mon[35351]: Deploying daemon mds.h on smithi115 2024-09-12T02:11:43.609 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:43 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.136:6836/3503120492,v1:172.21.15.136:6837/3503120492] up:boot 2024-09-12T02:11:43.609 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:43 smithi115 ceph-mon[35351]: fsmap 7 up:standby 2024-09-12T02:11:43.609 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:43 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:11:43.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:43 smithi136 ceph-mon[35814]: Deploying daemon mds.h on smithi115 2024-09-12T02:11:43.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:43 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.136:6836/3503120492,v1:172.21.15.136:6837/3503120492] up:boot 2024-09-12T02:11:43.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:43 smithi136 ceph-mon[35814]: fsmap 7 up:standby 2024-09-12T02:11:43.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:43 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:11:43.674 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:11:43.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:43 smithi110 ceph-mon[30548]: Deploying daemon mds.h on smithi115 2024-09-12T02:11:43.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:43 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.136:6836/3503120492,v1:172.21.15.136:6837/3503120492] up:boot 2024-09-12T02:11:43.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:43 smithi110 ceph-mon[30548]: fsmap 7 up:standby 2024-09-12T02:11:43.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:43 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:11:44.052 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:44.294 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:11:44 smithi115 systemd[1]: Starting Ceph mds.h for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:11:44.522 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:44 smithi110 ceph-mon[30548]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:44.580 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:44 smithi115 ceph-mon[35351]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:44.580 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:11:44 smithi115 podman[64831]: 2024-09-12 02:11:44.198580646 +0000 UTC m=+0.016602103 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:44.580 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:11:44 smithi115 podman[64831]: 2024-09-12 02:11:44.353031539 +0000 UTC m=+0.171052989 container create d193662e59b28ac6633d489b78eca3a5c9ff2b70d346e579f6d758beb501c55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T02:11:44.580 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:11:44 smithi115 podman[64831]: 2024-09-12 02:11:44.580724218 +0000 UTC m=+0.398745669 container init d193662e59b28ac6633d489b78eca3a5c9ff2b70d346e579f6d758beb501c55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:11:44.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.633+0000 7f0f0c400640 1 -- 172.21.15.110:0/2295564614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f04074620 msgr2=0x7f0f04074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:44.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.633+0000 7f0f0c400640 1 --2- 172.21.15.110:0/2295564614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f04074620 0x7f0f04074a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009900 tx=0x7f0ef802a480 comp rx=0 tx=0).stop 2024-09-12T02:11:44.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.633+0000 7f0f0c400640 1 -- 172.21.15.110:0/2295564614 shutdown_connections 2024-09-12T02:11:44.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.633+0000 7f0f0c400640 1 --2- 172.21.15.110:0/2295564614 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f0410e3c0 0x7f0f04110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:44.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.633+0000 7f0f0c400640 1 --2- 172.21.15.110:0/2295564614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f04074f40 0x7f0f0410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:44.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.633+0000 7f0f0c400640 1 --2- 172.21.15.110:0/2295564614 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f04074620 0x7f0f04074a00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:44.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.633+0000 7f0f0c400640 1 -- 172.21.15.110:0/2295564614 >> 172.21.15.110:0/2295564614 conn(0x7f0f040fd8c0 msgr2=0x7f0f040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:44.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.633+0000 7f0f0c400640 1 -- 172.21.15.110:0/2295564614 shutdown_connections 2024-09-12T02:11:44.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.633+0000 7f0f0c400640 1 -- 172.21.15.110:0/2295564614 wait complete. 2024-09-12T02:11:44.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.634+0000 7f0f0c400640 1 Processor -- start 2024-09-12T02:11:44.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.634+0000 7f0f0c400640 1 -- start start 2024-09-12T02:11:44.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.634+0000 7f0f0c400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f04074620 0x7f0f0419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:44.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.634+0000 7f0f0c400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f04074f40 0x7f0f0419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:44.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.634+0000 7f0f0c400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f0410e3c0 0x7f0f0419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:44.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.634+0000 7f0f0c400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0f041141c0 con 0x7f0f04074f40 2024-09-12T02:11:44.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.634+0000 7f0f0c400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0f04114040 con 0x7f0f04074620 2024-09-12T02:11:44.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.634+0000 7f0f0c400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0f04114340 con 0x7f0f0410e3c0 2024-09-12T02:11:44.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.635+0000 7f0f09a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f04074620 0x7f0f0419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:44.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.635+0000 7f0f09000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f04074f40 0x7f0f0419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:44.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.635+0000 7f0f09a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f04074620 0x7f0f0419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:47170/0 (socket says 172.21.15.110:47170) 2024-09-12T02:11:44.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.635+0000 7f0f09a00640 1 -- 172.21.15.110:0/2678674789 learned_addr learned my addr 172.21.15.110:0/2678674789 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:44.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.635+0000 7f0f0a400640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f0410e3c0 0x7f0f0419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:44.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.635+0000 7f0f09000640 1 -- 172.21.15.110:0/2678674789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f0410e3c0 msgr2=0x7f0f0419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:44.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.635+0000 7f0f09000640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f0410e3c0 0x7f0f0419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:44.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.635+0000 7f0f09000640 1 -- 172.21.15.110:0/2678674789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f04074620 msgr2=0x7f0f0419a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:44.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.635+0000 7f0f09000640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f04074620 0x7f0f0419a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:44.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.635+0000 7f0f09000640 1 -- 172.21.15.110:0/2678674789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0419f620 con 0x7f0f04074f40 2024-09-12T02:11:44.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.635+0000 7f0f09000640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f04074f40 0x7f0f0419abb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000e9f0 tx=0x7f0ef000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:44.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.636+0000 7f0f02000640 1 -- 172.21.15.110:0/2678674789 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000ccc0 con 0x7f0f04074f40 2024-09-12T02:11:44.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.636+0000 7f0f02000640 1 -- 172.21.15.110:0/2678674789 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ef0010910 con 0x7f0f04074f40 2024-09-12T02:11:44.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.636+0000 7f0f0c400640 1 -- 172.21.15.110:0/2678674789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0419f910 con 0x7f0f04074f40 2024-09-12T02:11:44.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.636+0000 7f0f02000640 1 -- 172.21.15.110:0/2678674789 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0018960 con 0x7f0f04074f40 2024-09-12T02:11:44.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.636+0000 7f0f0c400640 1 -- 172.21.15.110:0/2678674789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f041a71f0 con 0x7f0f04074f40 2024-09-12T02:11:44.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.637+0000 7f0f0c400640 1 -- 172.21.15.110:0/2678674789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f04074a00 con 0x7f0f04074f40 2024-09-12T02:11:44.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.639+0000 7f0f02000640 1 -- 172.21.15.110:0/2678674789 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f0ef0010ac0 con 0x7f0f04074f40 2024-09-12T02:11:44.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.641+0000 7f0f02000640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0eec0a2b80 0x7f0eec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:44.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.641+0000 7f0f02000640 1 -- 172.21.15.110:0/2678674789 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f0ef00cefd0 con 0x7f0f04074f40 2024-09-12T02:11:44.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.641+0000 7f0f09a00640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0eec0a2b80 0x7f0eec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:44.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.642+0000 7f0f09a00640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0eec0a2b80 0x7f0eec0a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80096c0 tx=0x7f0ef80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:44.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.644+0000 7f0f02000640 1 -- 172.21.15.110:0/2678674789 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ef009bce0 con 0x7f0f04074f40 2024-09-12T02:11:44.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:44 smithi136 ceph-mon[35814]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:44.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.857+0000 7f0f0c400640 1 -- 172.21.15.110:0/2678674789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f0402d7c0 con 0x7f0f04074f40 2024-09-12T02:11:44.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.858+0000 7f0f02000640 1 -- 172.21.15.110:0/2678674789 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6400 (secure 0 0 0) 0x7f0ef009ffe0 con 0x7f0f04074f40 2024-09-12T02:11:44.859 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:44.859 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":8,"btime":"2024-09-12T02:11:42:322960+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-12T02:11:44.859 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 8 2024-09-12T02:11:44.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.861+0000 7f0f0c400640 1 -- 172.21.15.110:0/2678674789 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0eec0a2b80 msgr2=0x7f0eec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:44.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.861+0000 7f0f0c400640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0eec0a2b80 0x7f0eec0a5040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80096c0 tx=0x7f0ef80046c0 comp rx=0 tx=0).stop 2024-09-12T02:11:44.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.861+0000 7f0f0c400640 1 -- 172.21.15.110:0/2678674789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f04074f40 msgr2=0x7f0f0419abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:44.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.861+0000 7f0f0c400640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f04074f40 0x7f0f0419abb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000e9f0 tx=0x7f0ef000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:11:44.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.861+0000 7f0f0c400640 1 -- 172.21.15.110:0/2678674789 shutdown_connections 2024-09-12T02:11:44.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.861+0000 7f0f0c400640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0eec0a2b80 0x7f0eec0a5040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:44.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.861+0000 7f0f0c400640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f0410e3c0 0x7f0f0419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:44.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.861+0000 7f0f0c400640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f04074f40 0x7f0f0419abb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:44.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.861+0000 7f0f0c400640 1 --2- 172.21.15.110:0/2678674789 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0f04074620 0x7f0f0419a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:44.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.861+0000 7f0f0c400640 1 -- 172.21.15.110:0/2678674789 >> 172.21.15.110:0/2678674789 conn(0x7f0f040fd8c0 msgr2=0x7f0f040fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:44.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.861+0000 7f0f0c400640 1 -- 172.21.15.110:0/2678674789 shutdown_connections 2024-09-12T02:11:44.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:44.861+0000 7f0f0c400640 1 -- 172.21.15.110:0/2678674789 wait complete. 2024-09-12T02:11:45.044 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:11:44 smithi115 podman[64831]: 2024-09-12 02:11:44.583403891 +0000 UTC m=+0.401425349 container start d193662e59b28ac6633d489b78eca3a5c9ff2b70d346e579f6d758beb501c55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:11:45.044 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:11:44 smithi115 ceph-mds[64851]: -- 172.21.15.115:0/310963471 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b12a1e7860 con 0x55b12a1c4800 2024-09-12T02:11:45.044 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:11:44 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h[64847]: starting mds.h at 2024-09-12T02:11:45.045 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:11:44 smithi115 bash[64831]: d193662e59b28ac6633d489b78eca3a5c9ff2b70d346e579f6d758beb501c55b 2024-09-12T02:11:45.045 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:11:44 smithi115 systemd[1]: Started Ceph mds.h for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:11:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:45.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:45.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:45.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:45 smithi136 ceph-mon[35814]: Deploying daemon mds.i on smithi136 2024-09-12T02:11:45.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:45 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2678674789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:45.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:45 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.115:6836/1922841773,v1:172.21.15.115:6837/1922841773] up:boot 2024-09-12T02:11:45.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:45 smithi136 ceph-mon[35814]: fsmap 8 up:standby 2024-09-12T02:11:45.911 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:11:45.911 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:45 smithi136 ceph-mon[35814]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:45.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:45.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:45 smithi110 ceph-mon[30548]: Deploying daemon mds.i on smithi136 2024-09-12T02:11:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:45 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2678674789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:45 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.115:6836/1922841773,v1:172.21.15.115:6837/1922841773] up:boot 2024-09-12T02:11:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:45 smithi110 ceph-mon[30548]: fsmap 8 up:standby 2024-09-12T02:11:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:11:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:45 smithi110 ceph-mon[30548]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:46.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:45 smithi115 ceph-mon[35351]: Deploying daemon mds.i on smithi136 2024-09-12T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:45 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2678674789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:45 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.115:6836/1922841773,v1:172.21.15.115:6837/1922841773] up:boot 2024-09-12T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:45 smithi115 ceph-mon[35351]: fsmap 8 up:standby 2024-09-12T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:11:46.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:45 smithi115 ceph-mon[35351]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:46.908 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:11:46 smithi136 systemd[1]: Starting Ceph mds.i for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:11:47.267 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:11:47 smithi136 podman[66365]: 2024-09-12 02:11:46.918834295 +0000 UTC m=+0.015586187 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:47.267 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:11:47 smithi136 podman[66365]: 2024-09-12 02:11:47.03159671 +0000 UTC m=+0.128348646 container create 629083f990d1d31f0fd03859dacedfc6e832146d7f036a94d30ec8562252bfc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T02:11:47.267 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:11:47 smithi136 podman[66365]: 2024-09-12 02:11:47.267546005 +0000 UTC m=+0.364297882 container init 629083f990d1d31f0fd03859dacedfc6e832146d7f036a94d30ec8562252bfc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T02:11:47.658 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:11:47 smithi136 podman[66365]: 2024-09-12 02:11:47.270717212 +0000 UTC m=+0.367469100 container start 629083f990d1d31f0fd03859dacedfc6e832146d7f036a94d30ec8562252bfc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-i, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-12T02:11:47.659 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:11:47 smithi136 ceph-mds[66384]: -- 172.21.15.136:0/2684105210 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55792fecf860 con 0x55792feac800 2024-09-12T02:11:47.659 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:11:47 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-i[66380]: starting mds.i at 2024-09-12T02:11:47.659 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:11:47 smithi136 bash[66365]: 629083f990d1d31f0fd03859dacedfc6e832146d7f036a94d30ec8562252bfc4 2024-09-12T02:11:47.659 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:11:47 smithi136 systemd[1]: Started Ceph mds.i for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:11:47.707 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:11:48.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:48 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] up:boot 2024-09-12T02:11:48.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:48 smithi136 ceph-mon[35814]: fsmap 9 up:standby 2024-09-12T02:11:48.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:48 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:11:48.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:48 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:48.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:48 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:48.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:48 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:48.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:48 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:48.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:48 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:48.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:48 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:48.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:48 smithi136 ceph-mon[35814]: Deploying daemon mds.g on smithi110 2024-09-12T02:11:48.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:48 smithi136 ceph-mon[35814]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:48.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:48 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] up:boot 2024-09-12T02:11:48.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:48 smithi110 ceph-mon[30548]: fsmap 9 up:standby 2024-09-12T02:11:48.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:11:48.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:48.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:48.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:48.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:48.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:48.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:48 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:48.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:48 smithi110 ceph-mon[30548]: Deploying daemon mds.g on smithi110 2024-09-12T02:11:48.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:48 smithi110 ceph-mon[30548]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:48.793 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:48 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] up:boot 2024-09-12T02:11:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:48 smithi115 ceph-mon[35351]: fsmap 9 up:standby 2024-09-12T02:11:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:48 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:11:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:48 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:48 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:48 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:48.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:48 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:48.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:48 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:48.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:48 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:48.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:48 smithi115 ceph-mon[35351]: Deploying daemon mds.g on smithi110 2024-09-12T02:11:48.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:48 smithi115 ceph-mon[35351]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:50.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.091+0000 7f36a5400640 1 -- 172.21.15.110:0/3261034493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a0104010 msgr2=0x7f36a01043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:50.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.091+0000 7f36a5400640 1 --2- 172.21.15.110:0/3261034493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a0104010 0x7f36a01043f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3690009900 tx=0x7f369002a410 comp rx=0 tx=0).stop 2024-09-12T02:11:50.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.091+0000 7f36a5400640 1 -- 172.21.15.110:0/3261034493 shutdown_connections 2024-09-12T02:11:50.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.091+0000 7f36a5400640 1 --2- 172.21.15.110:0/3261034493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a0109140 0x7f36a0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:50.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.091+0000 7f36a5400640 1 --2- 172.21.15.110:0/3261034493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36a01049c0 0x7f36a0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:50.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.091+0000 7f36a5400640 1 --2- 172.21.15.110:0/3261034493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a0104010 0x7f36a01043f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:50.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.091+0000 7f36a5400640 1 -- 172.21.15.110:0/3261034493 >> 172.21.15.110:0/3261034493 conn(0x7f36a00ffa50 msgr2=0x7f36a0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:50.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.091+0000 7f36a5400640 1 -- 172.21.15.110:0/3261034493 shutdown_connections 2024-09-12T02:11:50.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.091+0000 7f36a5400640 1 -- 172.21.15.110:0/3261034493 wait complete. 2024-09-12T02:11:50.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.092+0000 7f36a5400640 1 Processor -- start 2024-09-12T02:11:50.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.092+0000 7f36a5400640 1 -- start start 2024-09-12T02:11:50.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.093+0000 7f36a5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a0104010 0x7f36a019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:50.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.093+0000 7f36a5400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36a01049c0 0x7f36a019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:50.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.093+0000 7f36a5400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a0109140 0x7f36a019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:50.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.093+0000 7f36a5400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f36a01141b0 con 0x7f36a0104010 2024-09-12T02:11:50.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.093+0000 7f36a5400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f36a0114030 con 0x7f36a0109140 2024-09-12T02:11:50.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.093+0000 7f36a5400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f36a0114330 con 0x7f36a01049c0 2024-09-12T02:11:50.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.093+0000 7f369e800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a0104010 0x7f36a019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:50.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.093+0000 7f369e800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a0104010 0x7f36a019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43348/0 (socket says 172.21.15.110:43348) 2024-09-12T02:11:50.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.093+0000 7f369e800640 1 -- 172.21.15.110:0/4230000725 learned_addr learned my addr 172.21.15.110:0/4230000725 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:50.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.093+0000 7f369de00640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36a01049c0 0x7f36a019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:50.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.093+0000 7f369f200640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a0109140 0x7f36a019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:50.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.094+0000 7f369e800640 1 -- 172.21.15.110:0/4230000725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36a01049c0 msgr2=0x7f36a019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:50.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.094+0000 7f369e800640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36a01049c0 0x7f36a019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:50.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.094+0000 7f369e800640 1 -- 172.21.15.110:0/4230000725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a0109140 msgr2=0x7f36a019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:50.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.094+0000 7f369e800640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a0109140 0x7f36a019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:50.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.094+0000 7f369e800640 1 -- 172.21.15.110:0/4230000725 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a019f5e0 con 0x7f36a0104010 2024-09-12T02:11:50.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.094+0000 7f369e800640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a0104010 0x7f36a019a630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3690004770 tx=0x7f3690003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:50.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.094+0000 7f3697400640 1 -- 172.21.15.110:0/4230000725 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369003f070 con 0x7f36a0104010 2024-09-12T02:11:50.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.094+0000 7f3697400640 1 -- 172.21.15.110:0/4230000725 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3690031ca0 con 0x7f36a0104010 2024-09-12T02:11:50.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.094+0000 7f36a5400640 1 -- 172.21.15.110:0/4230000725 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a019f870 con 0x7f36a0104010 2024-09-12T02:11:50.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.094+0000 7f3697400640 1 -- 172.21.15.110:0/4230000725 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690035030 con 0x7f36a0104010 2024-09-12T02:11:50.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.095+0000 7f36a5400640 1 -- 172.21.15.110:0/4230000725 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a01a71b0 con 0x7f36a0104010 2024-09-12T02:11:50.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.096+0000 7f36a5400640 1 -- 172.21.15.110:0/4230000725 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a01054f0 con 0x7f36a0104010 2024-09-12T02:11:50.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.099+0000 7f3697400640 1 -- 172.21.15.110:0/4230000725 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3690042070 con 0x7f36a0104010 2024-09-12T02:11:50.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.100+0000 7f3697400640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f36840a2b80 0x7f36840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:50.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.101+0000 7f3697400640 1 -- 172.21.15.110:0/4230000725 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f36900ef430 con 0x7f36a0104010 2024-09-12T02:11:50.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.101+0000 7f369de00640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f36840a2b80 0x7f36840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:50.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.101+0000 7f369de00640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f36840a2b80 0x7f36840a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36a00ffe70 tx=0x7f368c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.103+0000 7f3697400640 1 -- 172.21.15.110:0/4230000725 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36900bc200 con 0x7f36a0104010 2024-09-12T02:11:50.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.326+0000 7f36a5400640 1 -- 172.21.15.110:0/4230000725 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36a010c320 con 0x7f36a0104010 2024-09-12T02:11:50.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.327+0000 7f3697400640 1 -- 172.21.15.110:0/4230000725 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8058 (secure 0 0 0) 0x7f36900c0500 con 0x7f36a0104010 2024-09-12T02:11:50.327 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:50.327 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":10,"btime":"2024-09-12T02:11:47:337330+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T02:11:50.328 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 10 2024-09-12T02:11:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.329+0000 7f36a5400640 1 -- 172.21.15.110:0/4230000725 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f36840a2b80 msgr2=0x7f36840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.329+0000 7f36a5400640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f36840a2b80 0x7f36840a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36a00ffe70 tx=0x7f368c005f90 comp rx=0 tx=0).stop 2024-09-12T02:11:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.329+0000 7f36a5400640 1 -- 172.21.15.110:0/4230000725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a0104010 msgr2=0x7f36a019a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.329+0000 7f36a5400640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a0104010 0x7f36a019a630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3690004770 tx=0x7f3690003c10 comp rx=0 tx=0).stop 2024-09-12T02:11:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.329+0000 7f36a5400640 1 -- 172.21.15.110:0/4230000725 shutdown_connections 2024-09-12T02:11:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.329+0000 7f36a5400640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f36840a2b80 0x7f36840a5040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:50.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.329+0000 7f36a5400640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36a0109140 0x7f36a019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:50.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.329+0000 7f36a5400640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36a01049c0 0x7f36a019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:50.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.329+0000 7f36a5400640 1 --2- 172.21.15.110:0/4230000725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a0104010 0x7f36a019a630 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:50.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.329+0000 7f36a5400640 1 -- 172.21.15.110:0/4230000725 >> 172.21.15.110:0/4230000725 conn(0x7f36a00ffa50 msgr2=0x7f36a0100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:50.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.330+0000 7f36a5400640 1 -- 172.21.15.110:0/4230000725 shutdown_connections 2024-09-12T02:11:50.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:50.330+0000 7f36a5400640 1 -- 172.21.15.110:0/4230000725 wait complete. 2024-09-12T02:11:50.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:50 smithi110 ceph-mon[30548]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:50.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:50 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/4230000725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:50.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:50 smithi115 ceph-mon[35351]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:50.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:50 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/4230000725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:50.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:50 smithi136 ceph-mon[35814]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:50 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/4230000725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:51.388 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:11:51 smithi110 podman[71735]: 2024-09-12 02:11:51.247168911 +0000 UTC m=+0.871885609 container create 29b2fbabe8de861229e9602f1839e7df0c7bf043faa8aa31585b98b10201e36c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:11:51.936 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:11:51 smithi110 podman[71735]: 2024-09-12 02:11:51.525474022 +0000 UTC m=+1.150190746 container init 29b2fbabe8de861229e9602f1839e7df0c7bf043faa8aa31585b98b10201e36c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-g, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-12T02:11:51.937 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:11:51 smithi110 podman[71735]: 2024-09-12 02:11:51.531703912 +0000 UTC m=+1.156420616 container start 29b2fbabe8de861229e9602f1839e7df0c7bf043faa8aa31585b98b10201e36c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-12T02:11:51.937 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:11:51 smithi110 ceph-mds[71762]: -- 172.21.15.110:0/3466807691 <== mon.0 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55949efd7860 con 0x55949efb4800 2024-09-12T02:11:51.937 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:11:51 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-g[71758]: starting mds.g at 2024-09-12T02:11:51.937 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:11:51 smithi110 bash[71735]: 29b2fbabe8de861229e9602f1839e7df0c7bf043faa8aa31585b98b10201e36c 2024-09-12T02:11:51.937 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:11:51 smithi110 systemd[1]: Started Ceph mds.g for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:11:52.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:52 smithi110 ceph-mon[30548]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:52.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:52.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:52.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:52.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:52.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:52.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:52 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:52.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:52 smithi115 ceph-mon[35351]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:52.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:52.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:52.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:52.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:52.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:52.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:52 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:52 smithi136 ceph-mon[35814]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:52.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:52.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:52.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:52 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:53.140 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:11:53.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:53 smithi115 ceph-mon[35351]: Deploying daemon mds.a on smithi110 2024-09-12T02:11:53.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:53 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.110:6838/647319477,v1:172.21.15.110:6839/647319477] up:boot 2024-09-12T02:11:53.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:53 smithi115 ceph-mon[35351]: fsmap 10 up:standby 2024-09-12T02:11:53.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:53 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:11:53.825 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:53 smithi110 ceph-mon[30548]: Deploying daemon mds.a on smithi110 2024-09-12T02:11:53.825 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:53 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.110:6838/647319477,v1:172.21.15.110:6839/647319477] up:boot 2024-09-12T02:11:53.825 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:53 smithi110 ceph-mon[30548]: fsmap 10 up:standby 2024-09-12T02:11:53.825 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:53 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:11:53.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:53 smithi136 ceph-mon[35814]: Deploying daemon mds.a on smithi110 2024-09-12T02:11:53.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:53 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.110:6838/647319477,v1:172.21.15.110:6839/647319477] up:boot 2024-09-12T02:11:53.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:53 smithi136 ceph-mon[35814]: fsmap 10 up:standby 2024-09-12T02:11:53.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:53 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:11:53.924 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:54.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.561+0000 7f0ba4a00640 1 -- 172.21.15.110:0/54268160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ba01079c0 msgr2=0x7f0ba0107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:54.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.561+0000 7f0ba4a00640 1 --2- 172.21.15.110:0/54268160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ba01079c0 0x7f0ba0107da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009930 tx=0x7f0b9002a440 comp rx=0 tx=0).stop 2024-09-12T02:11:54.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.561+0000 7f0ba4a00640 1 -- 172.21.15.110:0/54268160 shutdown_connections 2024-09-12T02:11:54.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.561+0000 7f0ba4a00640 1 --2- 172.21.15.110:0/54268160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba0102360 0x7f0ba010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:54.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.561+0000 7f0ba4a00640 1 --2- 172.21.15.110:0/54268160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba01019c0 0x7f0ba0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:54.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.561+0000 7f0ba4a00640 1 --2- 172.21.15.110:0/54268160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ba01079c0 0x7f0ba0107da0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:54.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.561+0000 7f0ba4a00640 1 -- 172.21.15.110:0/54268160 >> 172.21.15.110:0/54268160 conn(0x7f0ba00fd740 msgr2=0x7f0ba00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:54.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.561+0000 7f0ba4a00640 1 -- 172.21.15.110:0/54268160 shutdown_connections 2024-09-12T02:11:54.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.561+0000 7f0ba4a00640 1 -- 172.21.15.110:0/54268160 wait complete. 2024-09-12T02:11:54.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.563+0000 7f0ba4a00640 1 Processor -- start 2024-09-12T02:11:54.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.563+0000 7f0ba4a00640 1 -- start start 2024-09-12T02:11:54.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.563+0000 7f0ba4a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba01019c0 0x7f0ba00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:54.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.563+0000 7f0ba4a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ba0102360 0x7f0ba0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:54.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.563+0000 7f0ba4a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba01079c0 0x7f0ba0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:54.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.563+0000 7f0ba4a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba0111dc0 con 0x7f0ba0102360 2024-09-12T02:11:54.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.563+0000 7f0ba4a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba0111c40 con 0x7f0ba01019c0 2024-09-12T02:11:54.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.563+0000 7f0ba4a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba0111f40 con 0x7f0ba01079c0 2024-09-12T02:11:54.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.563+0000 7f0b9f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba01019c0 0x7f0ba00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:54.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.563+0000 7f0b9f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba01019c0 0x7f0ba00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:58450/0 (socket says 172.21.15.110:58450) 2024-09-12T02:11:54.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.564+0000 7f0b9f400640 1 -- 172.21.15.110:0/3744577995 learned_addr learned my addr 172.21.15.110:0/3744577995 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:54.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.564+0000 7f0b97e00640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ba0102360 0x7f0ba0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:54.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.564+0000 7f0b9f400640 1 -- 172.21.15.110:0/3744577995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba01079c0 msgr2=0x7f0ba0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:54.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.564+0000 7f0b9f400640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba01079c0 0x7f0ba0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:54.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.564+0000 7f0b9f400640 1 -- 172.21.15.110:0/3744577995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ba0102360 msgr2=0x7f0ba0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:54.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.564+0000 7f0b9f400640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ba0102360 0x7f0ba0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:54.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.564+0000 7f0b9f400640 1 -- 172.21.15.110:0/3744577995 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba01a6780 con 0x7f0ba01019c0 2024-09-12T02:11:54.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.564+0000 7f0b9f400640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba01019c0 0x7f0ba00744f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009230 tx=0x7f0b90004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:54.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.565+0000 7f0b9cc00640 1 -- 172.21.15.110:0/3744577995 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9003f030 con 0x7f0ba01019c0 2024-09-12T02:11:54.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.565+0000 7f0ba4a00640 1 -- 172.21.15.110:0/3744577995 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba01a6a10 con 0x7f0ba01019c0 2024-09-12T02:11:54.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.565+0000 7f0b9cc00640 1 -- 172.21.15.110:0/3744577995 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b90004440 con 0x7f0ba01019c0 2024-09-12T02:11:54.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.565+0000 7f0b9cc00640 1 -- 172.21.15.110:0/3744577995 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90035070 con 0x7f0ba01019c0 2024-09-12T02:11:54.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.565+0000 7f0ba4a00640 1 -- 172.21.15.110:0/3744577995 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba01a6f40 con 0x7f0ba01019c0 2024-09-12T02:11:54.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.566+0000 7f0ba4a00640 1 -- 172.21.15.110:0/3744577995 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ba0101e20 con 0x7f0ba01019c0 2024-09-12T02:11:54.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.569+0000 7f0b9cc00640 1 -- 172.21.15.110:0/3744577995 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f0b90042030 con 0x7f0ba01019c0 2024-09-12T02:11:54.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.570+0000 7f0b9cc00640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0b840a2c00 0x7f0b840a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:54.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.570+0000 7f0b9cc00640 1 -- 172.21.15.110:0/3744577995 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f0b900eef60 con 0x7f0ba01019c0 2024-09-12T02:11:54.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.571+0000 7f0b97e00640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0b840a2c00 0x7f0b840a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:54.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.571+0000 7f0b97e00640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0b840a2c00 0x7f0b840a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0075f80 tx=0x7f0b88005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:54.593 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.572+0000 7f0b9cc00640 1 -- 172.21.15.110:0/3744577995 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b900bc2c0 con 0x7f0ba01019c0 2024-09-12T02:11:54.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:54 smithi115 ceph-mon[35351]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:54.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.798+0000 7f0ba4a00640 1 -- 172.21.15.110:0/3744577995 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ba0109f30 con 0x7f0ba01019c0 2024-09-12T02:11:54.799 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:54 smithi110 ceph-mon[30548]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:54.799 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:11:54 smithi110 systemd[1]: Starting Ceph mds.a for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:11:54.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.799+0000 7f0b9cc00640 1 -- 172.21.15.110:0/3744577995 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8884 (secure 0 0 0) 0x7f0b900bbbc0 con 0x7f0ba01019c0 2024-09-12T02:11:54.800 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:54.800 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":11,"btime":"2024-09-12T02:11:52:495126+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-12T02:11:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 11 2024-09-12T02:11:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.801+0000 7f0ba4a00640 1 -- 172.21.15.110:0/3744577995 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0b840a2c00 msgr2=0x7f0b840a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.801+0000 7f0ba4a00640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0b840a2c00 0x7f0b840a50c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0075f80 tx=0x7f0b88005f90 comp rx=0 tx=0).stop 2024-09-12T02:11:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.801+0000 7f0ba4a00640 1 -- 172.21.15.110:0/3744577995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba01019c0 msgr2=0x7f0ba00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.801+0000 7f0ba4a00640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba01019c0 0x7f0ba00744f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009230 tx=0x7f0b90004040 comp rx=0 tx=0).stop 2024-09-12T02:11:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.801+0000 7f0ba4a00640 1 -- 172.21.15.110:0/3744577995 shutdown_connections 2024-09-12T02:11:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.801+0000 7f0ba4a00640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0b840a2c00 0x7f0b840a50c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.801+0000 7f0ba4a00640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ba01079c0 0x7f0ba0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.801+0000 7f0ba4a00640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ba0102360 0x7f0ba0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.801+0000 7f0ba4a00640 1 --2- 172.21.15.110:0/3744577995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0ba01019c0 0x7f0ba00744f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.801+0000 7f0ba4a00640 1 -- 172.21.15.110:0/3744577995 >> 172.21.15.110:0/3744577995 conn(0x7f0ba00fd740 msgr2=0x7f0ba00ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.801+0000 7f0ba4a00640 1 -- 172.21.15.110:0/3744577995 shutdown_connections 2024-09-12T02:11:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:54.802+0000 7f0ba4a00640 1 -- 172.21.15.110:0/3744577995 wait complete. 2024-09-12T02:11:54.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:54 smithi136 ceph-mon[35814]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:55.186 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:11:54 smithi110 podman[72136]: 2024-09-12 02:11:54.807087128 +0000 UTC m=+0.031902401 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:55.498 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:11:55 smithi110 podman[72136]: 2024-09-12 02:11:55.360108093 +0000 UTC m=+0.584923344 container create d50551b60e6ebaca2ba749cb3a9205a79cf68fb9ae28d9f3c760f959a9bfced5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T02:11:55.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:55 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3744577995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:55.847 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:55 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3744577995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:55.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:55 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3744577995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:56.140 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:11:56 smithi110 podman[72136]: 2024-09-12 02:11:56.032287606 +0000 UTC m=+1.257102885 container init d50551b60e6ebaca2ba749cb3a9205a79cf68fb9ae28d9f3c760f959a9bfced5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T02:11:56.140 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:11:56 smithi110 podman[72136]: 2024-09-12 02:11:56.038976714 +0000 UTC m=+1.263791965 container start d50551b60e6ebaca2ba749cb3a9205a79cf68fb9ae28d9f3c760f959a9bfced5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T02:11:56.141 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:11:56 smithi110 ceph-mds[72171]: -- 172.21.15.110:0/3890144701 <== mon.0 v2:172.21.15.110:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5561d4485860 con 0x5561d4462800 2024-09-12T02:11:56.141 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:11:56 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a[72164]: starting mds.a at 2024-09-12T02:11:56.436 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:11:56 smithi110 bash[72136]: d50551b60e6ebaca2ba749cb3a9205a79cf68fb9ae28d9f3c760f959a9bfced5 2024-09-12T02:11:56.436 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:11:56 smithi110 systemd[1]: Started Ceph mds.a for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:11:56.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:56 smithi115 ceph-mon[35351]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:56.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:56.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:56.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:56.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:56.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:56.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:56 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:56.810 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:56 smithi136 ceph-mon[35814]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:56.810 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:56.810 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:56.810 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:56.810 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:56.810 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:56.810 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:56 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:56.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:56 smithi110 ceph-mon[30548]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:56.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:56.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:56.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:56.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T02:11:56.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T02:11:56.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:56 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:11:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:57 smithi115 ceph-mon[35351]: Deploying daemon mds.b on smithi115 2024-09-12T02:11:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:57 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] up:boot 2024-09-12T02:11:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:57 smithi115 ceph-mon[35351]: fsmap 11 up:standby 2024-09-12T02:11:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:57 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:11:57.885 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:11:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:57 smithi136 ceph-mon[35814]: Deploying daemon mds.b on smithi115 2024-09-12T02:11:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:57 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] up:boot 2024-09-12T02:11:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:57 smithi136 ceph-mon[35814]: fsmap 11 up:standby 2024-09-12T02:11:57.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:57 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:11:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:57 smithi110 ceph-mon[30548]: Deploying daemon mds.b on smithi115 2024-09-12T02:11:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:57 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] up:boot 2024-09-12T02:11:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:57 smithi110 ceph-mon[30548]: fsmap 11 up:standby 2024-09-12T02:11:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:57 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:11:58.266 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:11:58.294 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:11:58 smithi115 systemd[1]: Starting Ceph mds.b for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:11:58.601 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:58 smithi115 ceph-mon[35351]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:58.601 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:11:58 smithi115 podman[65135]: 2024-09-12 02:11:58.230593409 +0000 UTC m=+0.015889694 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:11:58.602 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:11:58 smithi115 podman[65135]: 2024-09-12 02:11:58.348775441 +0000 UTC m=+0.134071711 container create 190d421cfddae961a7723b9a78f5d448fa77ff0ee567d090d0c5ca8ed8dccd29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-12T02:11:58.670 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:58 smithi110 ceph-mon[30548]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:58.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:58 smithi136 ceph-mon[35814]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:58.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.907+0000 7feec6800640 1 -- 172.21.15.110:0/117364616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec0101df0 msgr2=0x7feec01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.907+0000 7feec6800640 1 --2- 172.21.15.110:0/117364616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec0101df0 0x7feec01021d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009900 tx=0x7feeb002a410 comp rx=0 tx=0).stop 2024-09-12T02:11:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.908+0000 7feec6800640 1 -- 172.21.15.110:0/117364616 shutdown_connections 2024-09-12T02:11:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.908+0000 7feec6800640 1 --2- 172.21.15.110:0/117364616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec0106f20 0x7feec010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.908+0000 7feec6800640 1 --2- 172.21.15.110:0/117364616 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feec01027a0 0x7feec01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.908+0000 7feec6800640 1 --2- 172.21.15.110:0/117364616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec0101df0 0x7feec01021d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.908+0000 7feec6800640 1 -- 172.21.15.110:0/117364616 >> 172.21.15.110:0/117364616 conn(0x7feec00fd8b0 msgr2=0x7feec00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.908+0000 7feec6800640 1 -- 172.21.15.110:0/117364616 shutdown_connections 2024-09-12T02:11:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.908+0000 7feec6800640 1 -- 172.21.15.110:0/117364616 wait complete. 2024-09-12T02:11:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feec6800640 1 Processor -- start 2024-09-12T02:11:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feec6800640 1 -- start start 2024-09-12T02:11:58.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feec6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec0101df0 0x7feec01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feec6800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feec01027a0 0x7feec0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feec6800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec0106f20 0x7feec019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feec6800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7feec0111fd0 con 0x7feec0101df0 2024-09-12T02:11:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feec6800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7feec0111e50 con 0x7feec01027a0 2024-09-12T02:11:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feec6800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feec0112150 con 0x7feec0106f20 2024-09-12T02:11:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feebf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec0101df0 0x7feec01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feebf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec0101df0 0x7feec01983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36644/0 (socket says 172.21.15.110:36644) 2024-09-12T02:11:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feebf400640 1 -- 172.21.15.110:0/3573642936 learned_addr learned my addr 172.21.15.110:0/3573642936 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:11:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feebfe00640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec0106f20 0x7feec019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.909+0000 7feeb7e00640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feec01027a0 0x7feec0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:58.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.910+0000 7feebf400640 1 -- 172.21.15.110:0/3573642936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec0106f20 msgr2=0x7feec019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.910+0000 7feebf400640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec0106f20 0x7feec019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.910+0000 7feebf400640 1 -- 172.21.15.110:0/3573642936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feec01027a0 msgr2=0x7feec0198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.910+0000 7feebf400640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feec01027a0 0x7feec0198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.910+0000 7feebf400640 1 -- 172.21.15.110:0/3573642936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec019d380 con 0x7feec0101df0 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.910+0000 7feebfe00640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec0106f20 0x7feec019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.910+0000 7feeb7e00640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feec01027a0 0x7feec0198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.910+0000 7feebf400640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec0101df0 0x7feec01983d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feeb0004770 tx=0x7feeb0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.910+0000 7feebcc00640 1 -- 172.21.15.110:0/3573642936 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb003f070 con 0x7feec0101df0 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.910+0000 7feebcc00640 1 -- 172.21.15.110:0/3573642936 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeb0031ca0 con 0x7feec0101df0 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.910+0000 7feebcc00640 1 -- 172.21.15.110:0/3573642936 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb0035030 con 0x7feec0101df0 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.910+0000 7feec6800640 1 -- 172.21.15.110:0/3573642936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec019d610 con 0x7feec0101df0 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.911+0000 7feec6800640 1 -- 172.21.15.110:0/3573642936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec019daa0 con 0x7feec0101df0 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.912+0000 7feec6800640 1 -- 172.21.15.110:0/3573642936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec01021d0 con 0x7feec0101df0 2024-09-12T02:11:58.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.914+0000 7feebcc00640 1 -- 172.21.15.110:0/3573642936 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7feeb0042070 con 0x7feec0101df0 2024-09-12T02:11:58.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.916+0000 7feebcc00640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7feea40a2c00 0x7feea40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:11:58.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.916+0000 7feebcc00640 1 -- 172.21.15.110:0/3573642936 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7feeb00ef210 con 0x7feec0101df0 2024-09-12T02:11:58.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.916+0000 7feeb7e00640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7feea40a2c00 0x7feea40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:11:58.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.917+0000 7feeb7e00640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7feea40a2c00 0x7feea40a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feec00fdd40 tx=0x7feea800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:11:58.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:58.919+0000 7feebcc00640 1 -- 172.21.15.110:0/3573642936 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feeb00bbf20 con 0x7feec0101df0 2024-09-12T02:11:59.044 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:11:58 smithi115 podman[65135]: 2024-09-12 02:11:58.602049237 +0000 UTC m=+0.387345507 container init 190d421cfddae961a7723b9a78f5d448fa77ff0ee567d090d0c5ca8ed8dccd29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:11:59.045 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:11:58 smithi115 podman[65135]: 2024-09-12 02:11:58.605531884 +0000 UTC m=+0.390828154 container start 190d421cfddae961a7723b9a78f5d448fa77ff0ee567d090d0c5ca8ed8dccd29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T02:11:59.045 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:11:58 smithi115 ceph-mds[65154]: -- 172.21.15.115:0/3994371418 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556b86eab860 con 0x556b86e89400 2024-09-12T02:11:59.045 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:11:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b[65150]: starting mds.b at 2024-09-12T02:11:59.045 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:11:58 smithi115 bash[65135]: 190d421cfddae961a7723b9a78f5d448fa77ff0ee567d090d0c5ca8ed8dccd29 2024-09-12T02:11:59.045 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:11:58 smithi115 systemd[1]: Started Ceph mds.b for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:11:59.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.141+0000 7feec6800640 1 -- 172.21.15.110:0/3573642936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feec002d7c0 con 0x7feec0101df0 2024-09-12T02:11:59.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.142+0000 7feebcc00640 1 -- 172.21.15.110:0/3573642936 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9713 (secure 0 0 0) 0x7feeb00c0220 con 0x7feec0101df0 2024-09-12T02:11:59.143 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:11:59.143 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":12,"btime":"2024-09-12T02:11:56:513458+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/4021694968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":4021694968},{"type":"v1","addr":"172.21.15.110:6841","nonce":4021694968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2024-09-12T02:11:59.144 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 12 2024-09-12T02:11:59.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.146+0000 7feec6800640 1 -- 172.21.15.110:0/3573642936 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7feea40a2c00 msgr2=0x7feea40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:59.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.146+0000 7feec6800640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7feea40a2c00 0x7feea40a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7feec00fdd40 tx=0x7feea800b390 comp rx=0 tx=0).stop 2024-09-12T02:11:59.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.146+0000 7feec6800640 1 -- 172.21.15.110:0/3573642936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec0101df0 msgr2=0x7feec01983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:11:59.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.146+0000 7feec6800640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec0101df0 0x7feec01983d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feeb0004770 tx=0x7feeb0003c10 comp rx=0 tx=0).stop 2024-09-12T02:11:59.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.146+0000 7feec6800640 1 -- 172.21.15.110:0/3573642936 shutdown_connections 2024-09-12T02:11:59.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.146+0000 7feec6800640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7feea40a2c00 0x7feea40a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:59.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.146+0000 7feec6800640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feec0106f20 0x7feec019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:59.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.146+0000 7feec6800640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7feec01027a0 0x7feec0198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:59.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.146+0000 7feec6800640 1 --2- 172.21.15.110:0/3573642936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec0101df0 0x7feec01983d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:11:59.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.146+0000 7feec6800640 1 -- 172.21.15.110:0/3573642936 >> 172.21.15.110:0/3573642936 conn(0x7feec00fd8b0 msgr2=0x7feec00feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:11:59.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.147+0000 7feec6800640 1 -- 172.21.15.110:0/3573642936 shutdown_connections 2024-09-12T02:11:59.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:11:59.147+0000 7feec6800640 1 -- 172.21.15.110:0/3573642936 wait complete. 2024-09-12T02:11:59.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:11:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:59 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3573642936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:59.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:59 smithi115 ceph-mon[35351]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:59.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:59 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] up:boot 2024-09-12T02:11:59.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:59 smithi115 ceph-mon[35351]: fsmap 12 up:standby 2024-09-12T02:11:59.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:11:59 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:11:59.803 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.803 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.803 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.803 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.804 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.804 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:11:59.804 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:59 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3573642936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:59.804 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:59 smithi136 ceph-mon[35814]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:59.804 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:59 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] up:boot 2024-09-12T02:11:59.804 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:59 smithi136 ceph-mon[35814]: fsmap 12 up:standby 2024-09-12T02:11:59.805 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:11:59 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:11:59.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:11:59.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:11:59.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:59 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3573642936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:11:59.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:59 smithi110 ceph-mon[30548]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:11:59.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:59 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] up:boot 2024-09-12T02:11:59.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:59 smithi110 ceph-mon[30548]: fsmap 12 up:standby 2024-09-12T02:11:59.891 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:11:59 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:12:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:01 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:01 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:01 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:01.937 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:12:02.351 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:02.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:02 smithi115 ceph-mon[35351]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:02.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:02 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:02.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:02 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:02.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:02 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:12:02.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:02 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:12:02.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:02 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:02.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:02 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:12:02.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:02 smithi136 ceph-mon[35814]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:02.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:02 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:02.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:02 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:02.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:02 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:12:02.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:02 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:12:02.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:02 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:02.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:02 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:12:02.878 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:02 smithi110 ceph-mon[30548]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:02.878 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:02 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:02.878 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:02 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:02.878 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:02 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:12:02.878 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:02 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:12:02.878 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:02 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:02.878 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:02 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:12:03.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.735+0000 7f3d42800640 1 -- 172.21.15.110:0/3919644256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d3c1049a0 msgr2=0x7f3d3c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:03.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.735+0000 7f3d42800640 1 --2- 172.21.15.110:0/3919644256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d3c1049a0 0x7f3d3c1089f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009900 tx=0x7f3d2802a410 comp rx=0 tx=0).stop 2024-09-12T02:12:03.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.735+0000 7f3d42800640 1 -- 172.21.15.110:0/3919644256 shutdown_connections 2024-09-12T02:12:03.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.735+0000 7f3d42800640 1 --2- 172.21.15.110:0/3919644256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d3c109120 0x7f3d3c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:03.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.735+0000 7f3d42800640 1 --2- 172.21.15.110:0/3919644256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d3c1049a0 0x7f3d3c1089f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:03.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.735+0000 7f3d42800640 1 --2- 172.21.15.110:0/3919644256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c103ff0 0x7f3d3c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:03.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.735+0000 7f3d42800640 1 -- 172.21.15.110:0/3919644256 >> 172.21.15.110:0/3919644256 conn(0x7f3d3c0ffa90 msgr2=0x7f3d3c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:03.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.735+0000 7f3d42800640 1 -- 172.21.15.110:0/3919644256 shutdown_connections 2024-09-12T02:12:03.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.735+0000 7f3d42800640 1 -- 172.21.15.110:0/3919644256 wait complete. 2024-09-12T02:12:03.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.736+0000 7f3d42800640 1 Processor -- start 2024-09-12T02:12:03.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.736+0000 7f3d42800640 1 -- start start 2024-09-12T02:12:03.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d42800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d3c103ff0 0x7f3d3c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:03.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d42800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d3c1049a0 0x7f3d3c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:03.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d42800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c109120 0x7f3d3c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:03.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d42800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c114190 con 0x7f3d3c1049a0 2024-09-12T02:12:03.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d42800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c114010 con 0x7f3d3c103ff0 2024-09-12T02:12:03.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d42800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c114310 con 0x7f3d3c109120 2024-09-12T02:12:03.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d3aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d3c1049a0 0x7f3d3c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:03.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d3b400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d3c103ff0 0x7f3d3c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:03.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d3be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c109120 0x7f3d3c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:03.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d3aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d3c1049a0 0x7f3d3c19ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:36654/0 (socket says 172.21.15.110:36654) 2024-09-12T02:12:03.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d3aa00640 1 -- 172.21.15.110:0/1311492905 learned_addr learned my addr 172.21.15.110:0/1311492905 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:03.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d3b400640 1 -- 172.21.15.110:0/1311492905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c109120 msgr2=0x7f3d3c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:03.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d3b400640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c109120 0x7f3d3c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d3b400640 1 -- 172.21.15.110:0/1311492905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d3c1049a0 msgr2=0x7f3d3c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d3b400640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d3c1049a0 0x7f3d3c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d3b400640 1 -- 172.21.15.110:0/1311492905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3c19f5e0 con 0x7f3d3c103ff0 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d3be00640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c109120 0x7f3d3c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.737+0000 7f3d3aa00640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d3c1049a0 0x7f3d3c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.738+0000 7f3d3b400640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d3c103ff0 0x7f3d3c19a630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00e9f0 tx=0x7f3d2c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.738+0000 7f3d33e00640 1 -- 172.21.15.110:0/1311492905 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00ccc0 con 0x7f3d3c103ff0 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.738+0000 7f3d42800640 1 -- 172.21.15.110:0/1311492905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3c19f8d0 con 0x7f3d3c103ff0 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.738+0000 7f3d33e00640 1 -- 172.21.15.110:0/1311492905 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d2c005020 con 0x7f3d3c103ff0 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.738+0000 7f3d33e00640 1 -- 172.21.15.110:0/1311492905 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c004a00 con 0x7f3d3c103ff0 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.738+0000 7f3d42800640 1 -- 172.21.15.110:0/1311492905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d3c1a71b0 con 0x7f3d3c103ff0 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.739+0000 7f3d42800640 1 -- 172.21.15.110:0/1311492905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d3c1043d0 con 0x7f3d3c103ff0 2024-09-12T02:12:03.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.741+0000 7f3d33e00640 1 -- 172.21.15.110:0/1311492905 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3d2c0051d0 con 0x7f3d3c103ff0 2024-09-12T02:12:03.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.742+0000 7f3d33e00640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f3d200a2b80 0x7f3d200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:03.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.742+0000 7f3d33e00640 1 -- 172.21.15.110:0/1311492905 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f3d2c0ceb70 con 0x7f3d3c103ff0 2024-09-12T02:12:03.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.743+0000 7f3d3aa00640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f3d200a2b80 0x7f3d200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:03.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.743+0000 7f3d3aa00640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f3d200a2b80 0x7f3d200a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3d280096c0 tx=0x7f3d280046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:03.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.746+0000 7f3d33e00640 1 -- 172.21.15.110:0/1311492905 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d2c09bed0 con 0x7f3d3c103ff0 2024-09-12T02:12:03.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.976+0000 7f3d42800640 1 -- 172.21.15.110:0/1311492905 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d3c10c390 con 0x7f3d3c103ff0 2024-09-12T02:12:03.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.976+0000 7f3d33e00640 1 -- 172.21.15.110:0/1311492905 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10542 (secure 0 0 0) 0x7f3d2c09b7d0 con 0x7f3d3c103ff0 2024-09-12T02:12:03.977 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:12:03.977 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":13,"btime":"2024-09-12T02:11:59:527499+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/4021694968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":4021694968},{"type":"v1","addr":"172.21.15.110:6841","nonce":4021694968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24539,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6839/1796624254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1796624254},{"type":"v1","addr":"172.21.15.115:6839","nonce":1796624254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-12T02:12:03.978 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 13 2024-09-12T02:12:03.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.979+0000 7f3d42800640 1 -- 172.21.15.110:0/1311492905 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f3d200a2b80 msgr2=0x7f3d200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:03.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.979+0000 7f3d42800640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f3d200a2b80 0x7f3d200a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3d280096c0 tx=0x7f3d280046c0 comp rx=0 tx=0).stop 2024-09-12T02:12:03.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.979+0000 7f3d42800640 1 -- 172.21.15.110:0/1311492905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d3c103ff0 msgr2=0x7f3d3c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:03.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.979+0000 7f3d42800640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d3c103ff0 0x7f3d3c19a630 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00e9f0 tx=0x7f3d2c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:12:03.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.979+0000 7f3d42800640 1 -- 172.21.15.110:0/1311492905 shutdown_connections 2024-09-12T02:12:03.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.979+0000 7f3d42800640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f3d200a2b80 0x7f3d200a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:03.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.979+0000 7f3d42800640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d3c109120 0x7f3d3c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:03.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.979+0000 7f3d42800640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d3c1049a0 0x7f3d3c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:03.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.979+0000 7f3d42800640 1 --2- 172.21.15.110:0/1311492905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3d3c103ff0 0x7f3d3c19a630 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:03.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.979+0000 7f3d42800640 1 -- 172.21.15.110:0/1311492905 >> 172.21.15.110:0/1311492905 conn(0x7f3d3c0ffa90 msgr2=0x7f3d3c100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:03.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.979+0000 7f3d42800640 1 -- 172.21.15.110:0/1311492905 shutdown_connections 2024-09-12T02:12:03.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:03.979+0000 7f3d42800640 1 -- 172.21.15.110:0/1311492905 wait complete. 2024-09-12T02:12:04.334 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:04 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:04.334 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:04 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:04.334 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:04 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:04.334 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:04 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:04.334 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:04 smithi110 ceph-mon[30548]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:04.334 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:04 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1311492905' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:12:04.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:04 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:04.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:04 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:04.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:04 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:04.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:04 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:04.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:04 smithi136 ceph-mon[35814]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:04.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:04 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1311492905' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:12:04.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:04 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:04.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:04 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:04.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:04 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:04.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:04 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:04.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:04 smithi115 ceph-mon[35351]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:04.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:04 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1311492905' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:12:04.847 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-12T02:12:05.270 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:05.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.875+0000 7fddcc800640 1 -- 172.21.15.110:0/1512293594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddc41049a0 msgr2=0x7fddc41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:05.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.875+0000 7fddcc800640 1 --2- 172.21.15.110:0/1512293594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddc41049a0 0x7fddc41089f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009900 tx=0x7fddb402a410 comp rx=0 tx=0).stop 2024-09-12T02:12:05.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.875+0000 7fddcc800640 1 -- 172.21.15.110:0/1512293594 shutdown_connections 2024-09-12T02:12:05.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.875+0000 7fddcc800640 1 --2- 172.21.15.110:0/1512293594 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddc4109120 0x7fddc4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:05.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.875+0000 7fddcc800640 1 --2- 172.21.15.110:0/1512293594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddc41049a0 0x7fddc41089f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:05.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.875+0000 7fddcc800640 1 --2- 172.21.15.110:0/1512293594 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddc4103ff0 0x7fddc41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:05.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.875+0000 7fddcc800640 1 -- 172.21.15.110:0/1512293594 >> 172.21.15.110:0/1512293594 conn(0x7fddc40ffa90 msgr2=0x7fddc4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:05.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.875+0000 7fddcc800640 1 -- 172.21.15.110:0/1512293594 shutdown_connections 2024-09-12T02:12:05.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.875+0000 7fddcc800640 1 -- 172.21.15.110:0/1512293594 wait complete. 2024-09-12T02:12:05.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.876+0000 7fddcc800640 1 Processor -- start 2024-09-12T02:12:05.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.876+0000 7fddcc800640 1 -- start start 2024-09-12T02:12:05.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.876+0000 7fddcc800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddc4103ff0 0x7fddc419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:05.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.876+0000 7fddcc800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddc41049a0 0x7fddc419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:05.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.876+0000 7fddcc800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddc4109120 0x7fddc419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:05.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.876+0000 7fddcc800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fddc4114190 con 0x7fddc4109120 2024-09-12T02:12:05.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.876+0000 7fddcc800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fddc4114010 con 0x7fddc41049a0 2024-09-12T02:12:05.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.876+0000 7fddcc800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fddc4114310 con 0x7fddc4103ff0 2024-09-12T02:12:05.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.876+0000 7fddc9400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddc41049a0 0x7fddc419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:05.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.876+0000 7fddc9e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddc4103ff0 0x7fddc419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:05.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.876+0000 7fddca800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddc4109120 0x7fddc419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:05.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.877+0000 7fddc9400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddc41049a0 0x7fddc419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:43994/0 (socket says 172.21.15.110:43994) 2024-09-12T02:12:05.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.877+0000 7fddc9400640 1 -- 172.21.15.110:0/3371180307 learned_addr learned my addr 172.21.15.110:0/3371180307 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:05.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.877+0000 7fddc9e00640 1 -- 172.21.15.110:0/3371180307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddc41049a0 msgr2=0x7fddc419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:05.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.877+0000 7fddc9e00640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddc41049a0 0x7fddc419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:05.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.877+0000 7fddc9e00640 1 -- 172.21.15.110:0/3371180307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddc4109120 msgr2=0x7fddc419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:05.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.877+0000 7fddc9e00640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddc4109120 0x7fddc419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:05.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.877+0000 7fddc9e00640 1 -- 172.21.15.110:0/3371180307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc419f5a0 con 0x7fddc4103ff0 2024-09-12T02:12:05.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.877+0000 7fddc9400640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddc41049a0 0x7fddc419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:05.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.877+0000 7fddca800640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddc4109120 0x7fddc419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:05.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.877+0000 7fddc9e00640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddc4103ff0 0x7fddc419a5f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fddb800e9f0 tx=0x7fddb800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:05.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.878+0000 7fddbea00640 1 -- 172.21.15.110:0/3371180307 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb800ccc0 con 0x7fddc4103ff0 2024-09-12T02:12:05.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.878+0000 7fddcc800640 1 -- 172.21.15.110:0/3371180307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc419f890 con 0x7fddc4103ff0 2024-09-12T02:12:05.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.878+0000 7fddbea00640 1 -- 172.21.15.110:0/3371180307 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddb8010910 con 0x7fddc4103ff0 2024-09-12T02:12:05.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.878+0000 7fddbea00640 1 -- 172.21.15.110:0/3371180307 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb8018960 con 0x7fddc4103ff0 2024-09-12T02:12:05.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.878+0000 7fddcc800640 1 -- 172.21.15.110:0/3371180307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc41a7170 con 0x7fddc4103ff0 2024-09-12T02:12:05.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.879+0000 7fddcc800640 1 -- 172.21.15.110:0/3371180307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc41043d0 con 0x7fddc4103ff0 2024-09-12T02:12:05.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.881+0000 7fddbea00640 1 -- 172.21.15.110:0/3371180307 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fddb8010ac0 con 0x7fddc4103ff0 2024-09-12T02:12:05.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.882+0000 7fddbea00640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fddac0a2b80 0x7fddac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:05.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.882+0000 7fddbea00640 1 -- 172.21.15.110:0/3371180307 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fddb80cefd0 con 0x7fddc4103ff0 2024-09-12T02:12:05.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.882+0000 7fddc9400640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fddac0a2b80 0x7fddac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:05.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.883+0000 7fddc9400640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fddac0a2b80 0x7fddac0a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fddb40096c0 tx=0x7fddb40046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:05.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:05.886+0000 7fddbea00640 1 -- 172.21.15.110:0/3371180307 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fddb809bce0 con 0x7fddc4103ff0 2024-09-12T02:12:06.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.072+0000 7fddcc800640 1 -- 172.21.15.110:0/3371180307 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fddc41a7370 con 0x7fddc4103ff0 2024-09-12T02:12:06.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.073+0000 7fddbea00640 1 -- 172.21.15.110:0/3371180307 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) ==== 84+0+65 (secure 0 0 0) 0x7fddb809ffe0 con 0x7fddc4103ff0 2024-09-12T02:12:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:12:06.074 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2024-09-12T02:12:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:12:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 1, 2024-09-12T02:12:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": ".mgr" 2024-09-12T02:12:06.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:12:06.074 INFO:teuthology.orchestra.run.smithi110.stdout:] 2024-09-12T02:12:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.076+0000 7fddcc800640 1 -- 172.21.15.110:0/3371180307 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fddac0a2b80 msgr2=0x7fddac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.076+0000 7fddcc800640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fddac0a2b80 0x7fddac0a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fddb40096c0 tx=0x7fddb40046c0 comp rx=0 tx=0).stop 2024-09-12T02:12:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.076+0000 7fddcc800640 1 -- 172.21.15.110:0/3371180307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddc4103ff0 msgr2=0x7fddc419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.076+0000 7fddcc800640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddc4103ff0 0x7fddc419a5f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fddb800e9f0 tx=0x7fddb800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:12:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.076+0000 7fddcc800640 1 -- 172.21.15.110:0/3371180307 shutdown_connections 2024-09-12T02:12:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.076+0000 7fddcc800640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fddac0a2b80 0x7fddac0a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.076+0000 7fddcc800640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddc4109120 0x7fddc419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.076+0000 7fddcc800640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fddc41049a0 0x7fddc419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.076+0000 7fddcc800640 1 --2- 172.21.15.110:0/3371180307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddc4103ff0 0x7fddc419a5f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:06.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.076+0000 7fddcc800640 1 -- 172.21.15.110:0/3371180307 >> 172.21.15.110:0/3371180307 conn(0x7fddc40ffa90 msgr2=0x7fddc4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.076+0000 7fddcc800640 1 -- 172.21.15.110:0/3371180307 shutdown_connections 2024-09-12T02:12:06.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:06.076+0000 7fddcc800640 1 -- 172.21.15.110:0/3371180307 wait complete. 2024-09-12T02:12:06.424 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:06 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:06.425 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:06 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:06.425 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:06 smithi110 ceph-mon[30548]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:06.425 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:06 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:12:06.425 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:06 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:12:06.425 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:06 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:06.425 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:06 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3371180307' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:12:06.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:06 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:06.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:06 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:06.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:06 smithi115 ceph-mon[35351]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:06.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:06 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:12:06.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:06 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:12:06.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:06 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:06.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:06 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3371180307' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:12:06.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:06 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:06.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:06 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:06.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:06 smithi136 ceph-mon[35814]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:06.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:06 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:12:06.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:06 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:12:06.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:06 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:12:06.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:06 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3371180307' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-12T02:12:06.942 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T02:12:06.943 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T02:12:07.321 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:07.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.911+0000 7fc386c00640 1 -- 172.21.15.110:0/2597811939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc380112870 msgr2=0x7fc380114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:07.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.911+0000 7fc386c00640 1 --2- 172.21.15.110:0/2597811939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc380112870 0x7fc380114c60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc378009ca0 tx=0x7fc37802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:12:07.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.911+0000 7fc386c00640 1 -- 172.21.15.110:0/2597811939 shutdown_connections 2024-09-12T02:12:07.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.911+0000 7fc386c00640 1 --2- 172.21.15.110:0/2597811939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc380112870 0x7fc380114c60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:07.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.911+0000 7fc386c00640 1 --2- 172.21.15.110:0/2597811939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc380077040 0x7fc380112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:07.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.911+0000 7fc386c00640 1 --2- 172.21.15.110:0/2597811939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc380076720 0x7fc380076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:07.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.911+0000 7fc386c00640 1 -- 172.21.15.110:0/2597811939 >> 172.21.15.110:0/2597811939 conn(0x7fc3800ff8d0 msgr2=0x7fc380101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:07.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.911+0000 7fc386c00640 1 -- 172.21.15.110:0/2597811939 shutdown_connections 2024-09-12T02:12:07.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.911+0000 7fc386c00640 1 -- 172.21.15.110:0/2597811939 wait complete. 2024-09-12T02:12:07.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.912+0000 7fc386c00640 1 Processor -- start 2024-09-12T02:12:07.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.912+0000 7fc386c00640 1 -- start start 2024-09-12T02:12:07.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.912+0000 7fc386c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc380076720 0x7fc3801a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:07.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.912+0000 7fc386c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc380077040 0x7fc3801a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:07.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc386c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc380112870 0x7fc38019e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:07.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc386c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc380118410 con 0x7fc380112870 2024-09-12T02:12:07.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc386c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc380118290 con 0x7fc380077040 2024-09-12T02:12:07.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc386c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc380118590 con 0x7fc380076720 2024-09-12T02:12:07.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc384e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc380077040 0x7fc3801a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:07.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc385800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc380076720 0x7fc3801a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:07.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc386200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc380112870 0x7fc38019e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:07.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc384e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc380077040 0x7fc3801a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:44022/0 (socket says 172.21.15.110:44022) 2024-09-12T02:12:07.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc385800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc380076720 0x7fc3801a45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:37510/0 (socket says 172.21.15.110:37510) 2024-09-12T02:12:07.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc384e00640 1 -- 172.21.15.110:0/3278200782 learned_addr learned my addr 172.21.15.110:0/3278200782 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:07.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc384e00640 1 -- 172.21.15.110:0/3278200782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc380076720 msgr2=0x7fc3801a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:07.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc384e00640 1 --2- 172.21.15.110:0/3278200782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc380076720 0x7fc3801a45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:07.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc384e00640 1 -- 172.21.15.110:0/3278200782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc380112870 msgr2=0x7fc38019e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:07.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc384e00640 1 --2- 172.21.15.110:0/3278200782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc380112870 0x7fc38019e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:07.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc384e00640 1 -- 172.21.15.110:0/3278200782 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38019ef30 con 0x7fc380077040 2024-09-12T02:12:07.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.913+0000 7fc384e00640 1 --2- 172.21.15.110:0/3278200782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc380077040 0x7fc3801a4b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00ea60 tx=0x7fc36c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:07.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.914+0000 7fc37e000640 1 -- 172.21.15.110:0/3278200782 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c00cde0 con 0x7fc380077040 2024-09-12T02:12:07.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.914+0000 7fc386c00640 1 -- 172.21.15.110:0/3278200782 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc38019f220 con 0x7fc380077040 2024-09-12T02:12:07.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.914+0000 7fc37e000640 1 -- 172.21.15.110:0/3278200782 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc36c0035f0 con 0x7fc380077040 2024-09-12T02:12:07.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.914+0000 7fc37e000640 1 -- 172.21.15.110:0/3278200782 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c010670 con 0x7fc380077040 2024-09-12T02:12:07.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.914+0000 7fc386c00640 1 -- 172.21.15.110:0/3278200782 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3801ab570 con 0x7fc380077040 2024-09-12T02:12:07.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.915+0000 7fc386c00640 1 -- 172.21.15.110:0/3278200782 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc380077e60 con 0x7fc380077040 2024-09-12T02:12:07.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.917+0000 7fc37e000640 1 -- 172.21.15.110:0/3278200782 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fc36c0037a0 con 0x7fc380077040 2024-09-12T02:12:07.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.919+0000 7fc37e000640 1 --2- 172.21.15.110:0/3278200782 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc3680a2c00 0x7fc3680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:07.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.919+0000 7fc37e000640 1 -- 172.21.15.110:0/3278200782 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fc36c0ceee0 con 0x7fc380077040 2024-09-12T02:12:07.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.919+0000 7fc385800640 1 --2- 172.21.15.110:0/3278200782 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc3680a2c00 0x7fc3680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:07.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.920+0000 7fc385800640 1 --2- 172.21.15.110:0/3278200782 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc3680a2c00 0x7fc3680a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc374009bd0 tx=0x7fc374005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:07.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:07.920+0000 7fc37e000640 1 -- 172.21.15.110:0/3278200782 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc36c09c2d0 con 0x7fc380077040 2024-09-12T02:12:08.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.094+0000 7fc386c00640 1 -- 172.21.15.110:0/3278200782 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc38010da00 con 0x7fc380077040 2024-09-12T02:12:08.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.651+0000 7fc37e000640 1 -- 172.21.15.110:0/3278200782 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) ==== 138+0+0 (secure 0 0 0) 0x7fc36c09bbd0 con 0x7fc380077040 2024-09-12T02:12:08.652 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' created 2024-09-12T02:12:08.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.655+0000 7fc386c00640 1 -- 172.21.15.110:0/3278200782 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc3680a2c00 msgr2=0x7fc3680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:08.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.655+0000 7fc386c00640 1 --2- 172.21.15.110:0/3278200782 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc3680a2c00 0x7fc3680a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc374009bd0 tx=0x7fc374005f90 comp rx=0 tx=0).stop 2024-09-12T02:12:08.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.655+0000 7fc386c00640 1 -- 172.21.15.110:0/3278200782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc380077040 msgr2=0x7fc3801a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:08.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.655+0000 7fc386c00640 1 --2- 172.21.15.110:0/3278200782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc380077040 0x7fc3801a4b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00ea60 tx=0x7fc36c00ef20 comp rx=0 tx=0).stop 2024-09-12T02:12:08.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.655+0000 7fc386c00640 1 -- 172.21.15.110:0/3278200782 shutdown_connections 2024-09-12T02:12:08.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.655+0000 7fc386c00640 1 --2- 172.21.15.110:0/3278200782 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc3680a2c00 0x7fc3680a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:08.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.655+0000 7fc386c00640 1 --2- 172.21.15.110:0/3278200782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc380112870 0x7fc38019e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:08.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.655+0000 7fc386c00640 1 --2- 172.21.15.110:0/3278200782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc380077040 0x7fc3801a4b30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:08.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.655+0000 7fc386c00640 1 --2- 172.21.15.110:0/3278200782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc380076720 0x7fc3801a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:08.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.655+0000 7fc386c00640 1 -- 172.21.15.110:0/3278200782 >> 172.21.15.110:0/3278200782 conn(0x7fc3800ff8d0 msgr2=0x7fc380101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:08.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.656+0000 7fc386c00640 1 -- 172.21.15.110:0/3278200782 shutdown_connections 2024-09-12T02:12:08.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:08.656+0000 7fc386c00640 1 -- 172.21.15.110:0/3278200782 wait complete. 2024-09-12T02:12:08.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:08 smithi136 ceph-mon[35814]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:08 smithi110 ceph-mon[30548]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:09.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:08 smithi115 ceph-mon[35351]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:09.619 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-12T02:12:09.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:09 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3278200782' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:12:09.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:09 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:12:09.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:09 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:12:09.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:09 smithi136 ceph-mon[35814]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:12:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:09 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3278200782' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:12:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:09 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:12:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:09 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:12:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:09 smithi110 ceph-mon[30548]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:12:10.000 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:10.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:09 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3278200782' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:12:10.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:09 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-12T02:12:10.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:09 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-12T02:12:10.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:09 smithi115 ceph-mon[35351]: osdmap e80: 12 total, 12 up, 12 in 2024-09-12T02:12:10.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.624+0000 7ff812000640 1 -- 172.21.15.110:0/2889412855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff80c103e30 msgr2=0x7ff80c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:10.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.624+0000 7ff812000640 1 --2- 172.21.15.110:0/2889412855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff80c103e30 0x7ff80c104210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff800009900 tx=0x7ff80002a410 comp rx=0 tx=0).stop 2024-09-12T02:12:10.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.624+0000 7ff812000640 1 -- 172.21.15.110:0/2889412855 shutdown_connections 2024-09-12T02:12:10.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.624+0000 7ff812000640 1 --2- 172.21.15.110:0/2889412855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff80c108f60 0x7ff80c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:10.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.624+0000 7ff812000640 1 --2- 172.21.15.110:0/2889412855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff80c1047e0 0x7ff80c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:10.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.624+0000 7ff812000640 1 --2- 172.21.15.110:0/2889412855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff80c103e30 0x7ff80c104210 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:10.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.624+0000 7ff812000640 1 -- 172.21.15.110:0/2889412855 >> 172.21.15.110:0/2889412855 conn(0x7ff80c0ff8d0 msgr2=0x7ff80c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:10.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.624+0000 7ff812000640 1 -- 172.21.15.110:0/2889412855 shutdown_connections 2024-09-12T02:12:10.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.624+0000 7ff812000640 1 -- 172.21.15.110:0/2889412855 wait complete. 2024-09-12T02:12:10.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.625+0000 7ff812000640 1 Processor -- start 2024-09-12T02:12:10.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.625+0000 7ff812000640 1 -- start start 2024-09-12T02:12:10.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff812000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff80c103e30 0x7ff80c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:10.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff812000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff80c1047e0 0x7ff80c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:10.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff812000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff80c108f60 0x7ff80c19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:10.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff812000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c114010 con 0x7ff80c103e30 2024-09-12T02:12:10.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff812000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c113e90 con 0x7ff80c1047e0 2024-09-12T02:12:10.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff812000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c114190 con 0x7ff80c108f60 2024-09-12T02:12:10.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff810c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff80c103e30 0x7ff80c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:10.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff810c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff80c103e30 0x7ff80c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57054/0 (socket says 172.21.15.110:57054) 2024-09-12T02:12:10.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff810c00640 1 -- 172.21.15.110:0/3748508260 learned_addr learned my addr 172.21.15.110:0/3748508260 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:10.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff80be00640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff80c1047e0 0x7ff80c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:10.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff811600640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff80c108f60 0x7ff80c19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:10.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff810c00640 1 -- 172.21.15.110:0/3748508260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff80c108f60 msgr2=0x7ff80c19ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:10.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff810c00640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff80c108f60 0x7ff80c19ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:10.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff810c00640 1 -- 172.21.15.110:0/3748508260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff80c1047e0 msgr2=0x7ff80c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:10.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff810c00640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff80c1047e0 0x7ff80c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:10.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.626+0000 7ff810c00640 1 -- 172.21.15.110:0/3748508260 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80c19f460 con 0x7ff80c103e30 2024-09-12T02:12:10.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.627+0000 7ff811600640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff80c108f60 0x7ff80c19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:12:10.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.627+0000 7ff810c00640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff80c103e30 0x7ff80c19a4b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff800004770 tx=0x7ff800003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:10.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.627+0000 7ff809600640 1 -- 172.21.15.110:0/3748508260 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80003f070 con 0x7ff80c103e30 2024-09-12T02:12:10.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.627+0000 7ff809600640 1 -- 172.21.15.110:0/3748508260 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff800031ca0 con 0x7ff80c103e30 2024-09-12T02:12:10.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.627+0000 7ff812000640 1 -- 172.21.15.110:0/3748508260 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff80c19f6f0 con 0x7ff80c103e30 2024-09-12T02:12:10.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.627+0000 7ff809600640 1 -- 172.21.15.110:0/3748508260 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff800035030 con 0x7ff80c103e30 2024-09-12T02:12:10.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.627+0000 7ff812000640 1 -- 172.21.15.110:0/3748508260 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff80c1a7030 con 0x7ff80c103e30 2024-09-12T02:12:10.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.628+0000 7ff812000640 1 -- 172.21.15.110:0/3748508260 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff80c105310 con 0x7ff80c103e30 2024-09-12T02:12:10.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.630+0000 7ff809600640 1 -- 172.21.15.110:0/3748508260 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff800042070 con 0x7ff80c103e30 2024-09-12T02:12:10.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.632+0000 7ff809600640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff7f40a2b80 0x7ff7f40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:10.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.632+0000 7ff809600640 1 -- 172.21.15.110:0/3748508260 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7497+0+0 (secure 0 0 0) 0x7ff8000efaa0 con 0x7ff80c103e30 2024-09-12T02:12:10.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.632+0000 7ff80be00640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff7f40a2b80 0x7ff7f40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:10.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.633+0000 7ff80be00640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff7f40a2b80 0x7ff7f40a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0ffcf0 tx=0x7ff7f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:10.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.635+0000 7ff809600640 1 -- 172.21.15.110:0/3748508260 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff8000bcc90 con 0x7ff80c103e30 2024-09-12T02:12:10.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:10.813+0000 7ff812000640 1 -- 172.21.15.110:0/3748508260 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7ff80c10c140 con 0x7ff80c103e30 2024-09-12T02:12:10.814 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:10 smithi110 ceph-mon[30548]: pgmap v292: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:10.814 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:10 smithi110 ceph-mon[30548]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:12:10.814 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:10 smithi110 ceph-mon[30548]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:12:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:10 smithi136 ceph-mon[35814]: pgmap v292: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:10 smithi136 ceph-mon[35814]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:12:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:10 smithi136 ceph-mon[35814]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:10 smithi115 ceph-mon[35351]: pgmap v292: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:10 smithi115 ceph-mon[35351]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:12:11.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:10 smithi115 ceph-mon[35351]: osdmap e81: 12 total, 12 up, 12 in 2024-09-12T02:12:11.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.661+0000 7ff809600640 1 -- 172.21.15.110:0/3748508260 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v83) ==== 171+0+0 (secure 0 0 0) 0x7ff8000bc590 con 0x7ff80c103e30 2024-09-12T02:12:11.662 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' created 2024-09-12T02:12:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.665+0000 7ff812000640 1 -- 172.21.15.110:0/3748508260 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff7f40a2b80 msgr2=0x7ff7f40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.665+0000 7ff812000640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff7f40a2b80 0x7ff7f40a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0ffcf0 tx=0x7ff7f8005f90 comp rx=0 tx=0).stop 2024-09-12T02:12:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.665+0000 7ff812000640 1 -- 172.21.15.110:0/3748508260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff80c103e30 msgr2=0x7ff80c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.665+0000 7ff812000640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff80c103e30 0x7ff80c19a4b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff800004770 tx=0x7ff800003c10 comp rx=0 tx=0).stop 2024-09-12T02:12:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.665+0000 7ff812000640 1 -- 172.21.15.110:0/3748508260 shutdown_connections 2024-09-12T02:12:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.665+0000 7ff812000640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff7f40a2b80 0x7ff7f40a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.665+0000 7ff812000640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff80c108f60 0x7ff80c19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.665+0000 7ff812000640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff80c1047e0 0x7ff80c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.665+0000 7ff812000640 1 --2- 172.21.15.110:0/3748508260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff80c103e30 0x7ff80c19a4b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:11.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.665+0000 7ff812000640 1 -- 172.21.15.110:0/3748508260 >> 172.21.15.110:0/3748508260 conn(0x7ff80c0ff8d0 msgr2=0x7ff80c100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:11.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.667+0000 7ff812000640 1 -- 172.21.15.110:0/3748508260 shutdown_connections 2024-09-12T02:12:11.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:11.667+0000 7ff812000640 1 -- 172.21.15.110:0/3748508260 wait complete. 2024-09-12T02:12:11.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:11 smithi110 ceph-mon[30548]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:12:11.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:11 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3748508260' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:12:12.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:11 smithi115 ceph-mon[35351]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:12:12.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:11 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3748508260' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:12:12.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:11 smithi136 ceph-mon[35814]: osdmap e82: 12 total, 12 up, 12 in 2024-09-12T02:12:12.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:11 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3748508260' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-12T02:12:12.491 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T02:12:12.879 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:12 smithi110 ceph-mon[30548]: pgmap v295: 33 pgs: 23 unknown, 10 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:12 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3748508260' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T02:12:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:12 smithi110 ceph-mon[30548]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:12:13.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:12 smithi115 ceph-mon[35351]: pgmap v295: 33 pgs: 23 unknown, 10 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:13.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:12 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3748508260' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T02:12:13.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:12 smithi115 ceph-mon[35351]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:12:13.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:12 smithi136 ceph-mon[35814]: pgmap v295: 33 pgs: 23 unknown, 10 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:13.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:12 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3748508260' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-12T02:12:13.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:12 smithi136 ceph-mon[35814]: osdmap e83: 12 total, 12 up, 12 in 2024-09-12T02:12:13.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.471+0000 7f39f2a00640 1 -- 172.21.15.110:0/1054258054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ec106f10 msgr2=0x7f39ec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:13.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.471+0000 7f39f2a00640 1 --2- 172.21.15.110:0/1054258054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ec106f10 0x7f39ec10ea90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f39e4009ca0 tx=0x7f39e402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:12:13.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.471+0000 7f39f2a00640 1 -- 172.21.15.110:0/1054258054 shutdown_connections 2024-09-12T02:12:13.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.471+0000 7f39f2a00640 1 --2- 172.21.15.110:0/1054258054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ec106f10 0x7f39ec10ea90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:13.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.471+0000 7f39f2a00640 1 --2- 172.21.15.110:0/1054258054 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec102790 0x7f39ec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:13.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.471+0000 7f39f2a00640 1 --2- 172.21.15.110:0/1054258054 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39ec101de0 0x7f39ec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:13.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.471+0000 7f39f2a00640 1 -- 172.21.15.110:0/1054258054 >> 172.21.15.110:0/1054258054 conn(0x7f39ec0fd8c0 msgr2=0x7f39ec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:13.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.471+0000 7f39f2a00640 1 -- 172.21.15.110:0/1054258054 shutdown_connections 2024-09-12T02:12:13.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.471+0000 7f39f2a00640 1 -- 172.21.15.110:0/1054258054 wait complete. 2024-09-12T02:12:13.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.473+0000 7f39f2a00640 1 Processor -- start 2024-09-12T02:12:13.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.473+0000 7f39f2a00640 1 -- start start 2024-09-12T02:12:13.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.473+0000 7f39f2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ec101de0 0x7f39ec19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:13.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.473+0000 7f39f2a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec102790 0x7f39ec19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:13.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.473+0000 7f39f2a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39ec106f10 0x7f39ec19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:13.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.473+0000 7f39f2a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec075d20 con 0x7f39ec101de0 2024-09-12T02:12:13.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.473+0000 7f39f2a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec075ba0 con 0x7f39ec102790 2024-09-12T02:12:13.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.473+0000 7f39f2a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec075ea0 con 0x7f39ec106f10 2024-09-12T02:12:13.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39ebe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ec101de0 0x7f39ec19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:13.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39ebe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ec101de0 0x7f39ec19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57080/0 (socket says 172.21.15.110:57080) 2024-09-12T02:12:13.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39ebe00640 1 -- 172.21.15.110:0/124915040 learned_addr learned my addr 172.21.15.110:0/124915040 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:13.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39eb400640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec102790 0x7f39ec19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:13.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39f0a00640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39ec106f10 0x7f39ec19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:13.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39ebe00640 1 -- 172.21.15.110:0/124915040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39ec106f10 msgr2=0x7f39ec19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:13.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39ebe00640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39ec106f10 0x7f39ec19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:13.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39ebe00640 1 -- 172.21.15.110:0/124915040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec102790 msgr2=0x7f39ec19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39ebe00640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec102790 0x7f39ec19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39ebe00640 1 -- 172.21.15.110:0/124915040 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ec19f590 con 0x7f39ec101de0 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39f0a00640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39ec106f10 0x7f39ec19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39ebe00640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ec101de0 0x7f39ec19a5e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00e9f0 tx=0x7f39dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39e8c00640 1 -- 172.21.15.110:0/124915040 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc00cd80 con 0x7f39ec101de0 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39e8c00640 1 -- 172.21.15.110:0/124915040 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39dc005500 con 0x7f39ec101de0 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.474+0000 7f39e8c00640 1 -- 172.21.15.110:0/124915040 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc010690 con 0x7f39ec101de0 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.475+0000 7f39f2a00640 1 -- 172.21.15.110:0/124915040 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ec19f880 con 0x7f39ec101de0 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.475+0000 7f39f2a00640 1 -- 172.21.15.110:0/124915040 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ec1a7160 con 0x7f39ec101de0 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.476+0000 7f39f2a00640 1 -- 172.21.15.110:0/124915040 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ec1021c0 con 0x7f39ec101de0 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.478+0000 7f39e8c00640 1 -- 172.21.15.110:0/124915040 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f39dc0046c0 con 0x7f39ec101de0 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.480+0000 7f39e8c00640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f39d00a2c00 0x7f39d00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:13.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.480+0000 7f39e8c00640 1 -- 172.21.15.110:0/124915040 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7879+0+0 (secure 0 0 0) 0x7f39dc0cf540 con 0x7f39ec101de0 2024-09-12T02:12:13.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.480+0000 7f39eb400640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f39d00a2c00 0x7f39d00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:13.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.481+0000 7f39eb400640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f39d00a2c00 0x7f39d00a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0fdff0 tx=0x7f39d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:13.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.483+0000 7f39e8c00640 1 -- 172.21.15.110:0/124915040 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39dc0541b0 con 0x7f39ec101de0 2024-09-12T02:12:13.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:13.696+0000 7f39f2a00640 1 -- 172.21.15.110:0/124915040 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f39ec19b940 con 0x7f39ec101de0 2024-09-12T02:12:13.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:13 smithi110 ceph-mon[30548]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:12:13.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:13 smithi110 ceph-mon[30548]: pgmap v298: 97 pgs: 23 creating+peering, 39 unknown, 35 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:14.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:13 smithi115 ceph-mon[35351]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:12:14.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:13 smithi115 ceph-mon[35351]: pgmap v298: 97 pgs: 23 creating+peering, 39 unknown, 35 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:14.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:13 smithi136 ceph-mon[35814]: osdmap e84: 12 total, 12 up, 12 in 2024-09-12T02:12:14.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:13 smithi136 ceph-mon[35814]: pgmap v298: 97 pgs: 23 creating+peering, 39 unknown, 35 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:14.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.680+0000 7f39e8c00640 1 -- 172.21.15.110:0/124915040 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f39dc09c5b0 con 0x7f39ec101de0 2024-09-12T02:12:14.681 INFO:teuthology.orchestra.run.smithi110.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T02:12:14.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.683+0000 7f39f2a00640 1 -- 172.21.15.110:0/124915040 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f39d00a2c00 msgr2=0x7f39d00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:14.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.683+0000 7f39f2a00640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f39d00a2c00 0x7f39d00a50c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0fdff0 tx=0x7f39d8005f90 comp rx=0 tx=0).stop 2024-09-12T02:12:14.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.683+0000 7f39f2a00640 1 -- 172.21.15.110:0/124915040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ec101de0 msgr2=0x7f39ec19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:14.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.683+0000 7f39f2a00640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ec101de0 0x7f39ec19a5e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00e9f0 tx=0x7f39dc00edf0 comp rx=0 tx=0).stop 2024-09-12T02:12:14.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.684+0000 7f39f2a00640 1 -- 172.21.15.110:0/124915040 shutdown_connections 2024-09-12T02:12:14.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.684+0000 7f39f2a00640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f39d00a2c00 0x7f39d00a50c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:14.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.684+0000 7f39f2a00640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39ec106f10 0x7f39ec19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:14.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.684+0000 7f39f2a00640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f39ec102790 0x7f39ec19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:14.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.684+0000 7f39f2a00640 1 --2- 172.21.15.110:0/124915040 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39ec101de0 0x7f39ec19a5e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:14.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.684+0000 7f39f2a00640 1 -- 172.21.15.110:0/124915040 >> 172.21.15.110:0/124915040 conn(0x7f39ec0fd8c0 msgr2=0x7f39ec0fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:14.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.684+0000 7f39f2a00640 1 -- 172.21.15.110:0/124915040 shutdown_connections 2024-09-12T02:12:14.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:14.684+0000 7f39f2a00640 1 -- 172.21.15.110:0/124915040 wait complete. 2024-09-12T02:12:14.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:14 smithi110 ceph-mon[30548]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:12:14.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:14 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/124915040' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:12:14.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:14 smithi110 ceph-mon[30548]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:12:15.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:14 smithi115 ceph-mon[35351]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:12:15.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:14 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/124915040' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:12:15.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:14 smithi115 ceph-mon[35351]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:12:15.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:14 smithi136 ceph-mon[35814]: osdmap e85: 12 total, 12 up, 12 in 2024-09-12T02:12:15.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:14 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/124915040' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-12T02:12:15.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:14 smithi136 ceph-mon[35814]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-12T02:12:15.677 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-12T02:12:15.677 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-12T02:12:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:15 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/124915040' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:12:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:15 smithi110 ceph-mon[30548]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:12:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:15 smithi110 ceph-mon[30548]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:12:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:15 smithi110 ceph-mon[30548]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:12:15.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:15 smithi110 ceph-mon[30548]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:12:15.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:15 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] up:active 2024-09-12T02:12:15.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:15 smithi110 ceph-mon[30548]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:12:15.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:15 smithi110 ceph-mon[30548]: pgmap v301: 97 pgs: 23 creating+peering, 28 unknown, 46 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:16.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:15 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/124915040' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:12:16.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:15 smithi115 ceph-mon[35351]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:12:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:15 smithi115 ceph-mon[35351]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:12:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:15 smithi115 ceph-mon[35351]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:12:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:15 smithi115 ceph-mon[35351]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:12:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:15 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] up:active 2024-09-12T02:12:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:15 smithi115 ceph-mon[35351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:12:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:15 smithi115 ceph-mon[35351]: pgmap v301: 97 pgs: 23 creating+peering, 28 unknown, 46 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:16.048 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:16.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:15 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/124915040' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-12T02:12:16.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:15 smithi136 ceph-mon[35814]: osdmap e86: 12 total, 12 up, 12 in 2024-09-12T02:12:16.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:15 smithi136 ceph-mon[35814]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-12T02:12:16.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:15 smithi136 ceph-mon[35814]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-12T02:12:16.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:15 smithi136 ceph-mon[35814]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:12:16.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:15 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] up:active 2024-09-12T02:12:16.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:15 smithi136 ceph-mon[35814]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:12:16.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:15 smithi136 ceph-mon[35814]: pgmap v301: 97 pgs: 23 creating+peering, 28 unknown, 46 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.656+0000 7f4f60400640 1 -- 172.21.15.110:0/4160183662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f58074ee0 msgr2=0x7f4f5810def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.656+0000 7f4f60400640 1 --2- 172.21.15.110:0/4160183662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f58074ee0 0x7f4f5810def0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009900 tx=0x7f4f4402a480 comp rx=0 tx=0).stop 2024-09-12T02:12:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.656+0000 7f4f60400640 1 -- 172.21.15.110:0/4160183662 shutdown_connections 2024-09-12T02:12:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.656+0000 7f4f60400640 1 --2- 172.21.15.110:0/4160183662 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f5810e430 0x7f4f58110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.656+0000 7f4f60400640 1 --2- 172.21.15.110:0/4160183662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f58074ee0 0x7f4f5810def0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.656+0000 7f4f60400640 1 --2- 172.21.15.110:0/4160183662 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f580745c0 0x7f4f580749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.656+0000 7f4f60400640 1 -- 172.21.15.110:0/4160183662 >> 172.21.15.110:0/4160183662 conn(0x7f4f580fd8b0 msgr2=0x7f4f580ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.656+0000 7f4f60400640 1 -- 172.21.15.110:0/4160183662 shutdown_connections 2024-09-12T02:12:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.656+0000 7f4f60400640 1 -- 172.21.15.110:0/4160183662 wait complete. 2024-09-12T02:12:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f60400640 1 Processor -- start 2024-09-12T02:12:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f60400640 1 -- start start 2024-09-12T02:12:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f60400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f580745c0 0x7f4f5819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f60400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f58074ee0 0x7f4f5819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f60400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f5810e430 0x7f4f5819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f60400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4f581141c0 con 0x7f4f580745c0 2024-09-12T02:12:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f60400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4f58114040 con 0x7f4f5810e430 2024-09-12T02:12:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f60400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4f58114340 con 0x7f4f58074ee0 2024-09-12T02:12:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f5da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f580745c0 0x7f4f5819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f5e400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f5810e430 0x7f4f5819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f5da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f580745c0 0x7f4f5819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57096/0 (socket says 172.21.15.110:57096) 2024-09-12T02:12:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f5da00640 1 -- 172.21.15.110:0/630505328 learned_addr learned my addr 172.21.15.110:0/630505328 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.657+0000 7f4f5d000640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f58074ee0 0x7f4f5819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.658+0000 7f4f5da00640 1 -- 172.21.15.110:0/630505328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f58074ee0 msgr2=0x7f4f5819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.658+0000 7f4f5da00640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f58074ee0 0x7f4f5819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.658+0000 7f4f5da00640 1 -- 172.21.15.110:0/630505328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f5810e430 msgr2=0x7f4f5819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.658+0000 7f4f5da00640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f5810e430 0x7f4f5819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.658+0000 7f4f5da00640 1 -- 172.21.15.110:0/630505328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5819f5d0 con 0x7f4f580745c0 2024-09-12T02:12:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.658+0000 7f4f5da00640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f580745c0 0x7f4f5819a620 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00d950 tx=0x7f4f4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.658+0000 7f4f56000640 1 -- 172.21.15.110:0/630505328 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c017070 con 0x7f4f580745c0 2024-09-12T02:12:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.658+0000 7f4f56000640 1 -- 172.21.15.110:0/630505328 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f4c009c30 con 0x7f4f580745c0 2024-09-12T02:12:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.658+0000 7f4f60400640 1 -- 172.21.15.110:0/630505328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5819f8c0 con 0x7f4f580745c0 2024-09-12T02:12:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.658+0000 7f4f56000640 1 -- 172.21.15.110:0/630505328 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00f6b0 con 0x7f4f580745c0 2024-09-12T02:12:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.659+0000 7f4f60400640 1 -- 172.21.15.110:0/630505328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f581a71a0 con 0x7f4f580745c0 2024-09-12T02:12:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.660+0000 7f4f60400640 1 -- 172.21.15.110:0/630505328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f580749a0 con 0x7f4f580745c0 2024-09-12T02:12:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.662+0000 7f4f56000640 1 -- 172.21.15.110:0/630505328 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f4f4c0109d0 con 0x7f4f580745c0 2024-09-12T02:12:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.663+0000 7f4f56000640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f4f400a2c00 0x7f4f400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.663+0000 7f4f56000640 1 -- 172.21.15.110:0/630505328 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f4f4c0cead0 con 0x7f4f580745c0 2024-09-12T02:12:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.663+0000 7f4f5d000640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f4f400a2c00 0x7f4f400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:16.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.664+0000 7f4f5d000640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f4f400a2c00 0x7f4f400a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f44000c00 tx=0x7f4f44005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:16.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.667+0000 7f4f56000640 1 -- 172.21.15.110:0/630505328 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4f4c009de0 con 0x7f4f580745c0 2024-09-12T02:12:16.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:16.852+0000 7f4f60400640 1 -- 172.21.15.110:0/630505328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f4f5802d7c0 con 0x7f4f580745c0 2024-09-12T02:12:16.853 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:16 smithi110 ceph-mon[30548]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:12:16.853 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:16 smithi110 ceph-mon[30548]: Cluster is now healthy 2024-09-12T02:12:17.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:16 smithi115 ceph-mon[35351]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:12:17.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:16 smithi115 ceph-mon[35351]: Cluster is now healthy 2024-09-12T02:12:17.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:16 smithi136 ceph-mon[35814]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-12T02:12:17.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:16 smithi136 ceph-mon[35814]: Cluster is now healthy 2024-09-12T02:12:17.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.694+0000 7f4f56000640 1 -- 172.21.15.110:0/630505328 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v87) ==== 157+0+0 (secure 0 0 0) 0x7f4f4c09b490 con 0x7f4f580745c0 2024-09-12T02:12:17.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.697+0000 7f4f60400640 1 -- 172.21.15.110:0/630505328 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f4f400a2c00 msgr2=0x7f4f400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.697+0000 7f4f60400640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f4f400a2c00 0x7f4f400a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f44000c00 tx=0x7f4f44005b50 comp rx=0 tx=0).stop 2024-09-12T02:12:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.697+0000 7f4f60400640 1 -- 172.21.15.110:0/630505328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f580745c0 msgr2=0x7f4f5819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.697+0000 7f4f60400640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f580745c0 0x7f4f5819a620 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00d950 tx=0x7f4f4c00de10 comp rx=0 tx=0).stop 2024-09-12T02:12:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.697+0000 7f4f60400640 1 -- 172.21.15.110:0/630505328 shutdown_connections 2024-09-12T02:12:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.697+0000 7f4f60400640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f4f400a2c00 0x7f4f400a50c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.697+0000 7f4f60400640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f5810e430 0x7f4f5819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.697+0000 7f4f60400640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f58074ee0 0x7f4f5819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.697+0000 7f4f60400640 1 --2- 172.21.15.110:0/630505328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f580745c0 0x7f4f5819a620 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.697+0000 7f4f60400640 1 -- 172.21.15.110:0/630505328 >> 172.21.15.110:0/630505328 conn(0x7f4f580fd8b0 msgr2=0x7f4f580fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.697+0000 7f4f60400640 1 -- 172.21.15.110:0/630505328 shutdown_connections 2024-09-12T02:12:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:17.697+0000 7f4f60400640 1 -- 172.21.15.110:0/630505328 wait complete. 2024-09-12T02:12:18.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:17 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/630505328' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:12:18.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:17 smithi115 ceph-mon[35351]: pgmap v302: 97 pgs: 17 creating+peering, 80 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-12T02:12:18.090 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:17 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/630505328' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:12:18.090 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:17 smithi110 ceph-mon[30548]: pgmap v302: 97 pgs: 17 creating+peering, 80 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-12T02:12:18.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:17 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/630505328' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-12T02:12:18.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:17 smithi136 ceph-mon[35814]: pgmap v302: 97 pgs: 17 creating+peering, 80 active+clean; 577 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-12T02:12:18.646 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T02:12:18.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:18 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/630505328' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T02:12:18.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:18 smithi110 ceph-mon[30548]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T02:12:19.017 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:19.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:18 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/630505328' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T02:12:19.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:18 smithi115 ceph-mon[35351]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T02:12:19.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:18 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/630505328' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-12T02:12:19.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:18 smithi136 ceph-mon[35814]: osdmap e87: 12 total, 12 up, 12 in 2024-09-12T02:12:19.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.620+0000 7f20eb000640 1 -- 172.21.15.110:0/29811176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20e4074590 msgr2=0x7f20e4074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:19.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.620+0000 7f20eb000640 1 --2- 172.21.15.110:0/29811176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20e4074590 0x7f20e4074970 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f20d4009ca0 tx=0x7f20d402a950 comp rx=0 tx=0).stop 2024-09-12T02:12:19.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.620+0000 7f20eb000640 1 -- 172.21.15.110:0/29811176 shutdown_connections 2024-09-12T02:12:19.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.620+0000 7f20eb000640 1 --2- 172.21.15.110:0/29811176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e4112b90 0x7f20e4114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:19.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.620+0000 7f20eb000640 1 --2- 172.21.15.110:0/29811176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20e4074eb0 0x7f20e4112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:19.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.620+0000 7f20eb000640 1 --2- 172.21.15.110:0/29811176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20e4074590 0x7f20e4074970 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:19.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.620+0000 7f20eb000640 1 -- 172.21.15.110:0/29811176 >> 172.21.15.110:0/29811176 conn(0x7f20e40fd8c0 msgr2=0x7f20e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:19.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.620+0000 7f20eb000640 1 -- 172.21.15.110:0/29811176 shutdown_connections 2024-09-12T02:12:19.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.620+0000 7f20eb000640 1 -- 172.21.15.110:0/29811176 wait complete. 2024-09-12T02:12:19.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.622+0000 7f20eb000640 1 Processor -- start 2024-09-12T02:12:19.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.622+0000 7f20eb000640 1 -- start start 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.622+0000 7f20eb000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20e4074590 0x7f20e41a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.622+0000 7f20eb000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20e4074eb0 0x7f20e41a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.622+0000 7f20eb000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e4112b90 0x7f20e419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.622+0000 7f20eb000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4118570 con 0x7f20e4074590 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.622+0000 7f20eb000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f20e41183f0 con 0x7f20e4112b90 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.622+0000 7f20eb000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f20e41186f0 con 0x7f20e4074eb0 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.622+0000 7f20e9000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e4112b90 0x7f20e419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.622+0000 7f20e3400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20e4074eb0 0x7f20e41a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e9000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e4112b90 0x7f20e419e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:52228/0 (socket says 172.21.15.110:52228) 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e3400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20e4074eb0 0x7f20e41a4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:45378/0 (socket says 172.21.15.110:45378) 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e9000640 1 -- 172.21.15.110:0/1854086580 learned_addr learned my addr 172.21.15.110:0/1854086580 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e3e00640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20e4074590 0x7f20e41a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:19.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e9000640 1 -- 172.21.15.110:0/1854086580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20e4074eb0 msgr2=0x7f20e41a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:19.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e9000640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20e4074eb0 0x7f20e41a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:19.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e9000640 1 -- 172.21.15.110:0/1854086580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20e4074590 msgr2=0x7f20e41a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:19.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e9000640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20e4074590 0x7f20e41a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:19.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e9000640 1 -- 172.21.15.110:0/1854086580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e419f010 con 0x7f20e4112b90 2024-09-12T02:12:19.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e3400640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20e4074eb0 0x7f20e41a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:19.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e9000640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e4112b90 0x7f20e419e8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00d720 tx=0x7f20dc00dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:19.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e0c00640 1 -- 172.21.15.110:0/1854086580 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc017070 con 0x7f20e4112b90 2024-09-12T02:12:19.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20eb000640 1 -- 172.21.15.110:0/1854086580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e419f300 con 0x7f20e4112b90 2024-09-12T02:12:19.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.623+0000 7f20e0c00640 1 -- 172.21.15.110:0/1854086580 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20dc00de30 con 0x7f20e4112b90 2024-09-12T02:12:19.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.624+0000 7f20e0c00640 1 -- 172.21.15.110:0/1854086580 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc004d90 con 0x7f20e4112b90 2024-09-12T02:12:19.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.624+0000 7f20eb000640 1 -- 172.21.15.110:0/1854086580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e41ab5f0 con 0x7f20e4112b90 2024-09-12T02:12:19.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.625+0000 7f20eb000640 1 -- 172.21.15.110:0/1854086580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e4074970 con 0x7f20e4112b90 2024-09-12T02:12:19.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.627+0000 7f20e0c00640 1 -- 172.21.15.110:0/1854086580 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f20dc004f30 con 0x7f20e4112b90 2024-09-12T02:12:19.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.628+0000 7f20e0c00640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f20c80a2b80 0x7f20c80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:19.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.628+0000 7f20e0c00640 1 -- 172.21.15.110:0/1854086580 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8277+0+0 (secure 0 0 0) 0x7f20dc0ced10 con 0x7f20e4112b90 2024-09-12T02:12:19.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.628+0000 7f20e3e00640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f20c80a2b80 0x7f20c80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:19.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.629+0000 7f20e3e00640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f20c80a2b80 0x7f20c80a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f20d4000f80 tx=0x7f20d4004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:19.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.630+0000 7f20e0c00640 1 -- 172.21.15.110:0/1854086580 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f20dc09b590 con 0x7f20e4112b90 2024-09-12T02:12:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:19 smithi115 ceph-mon[35351]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T02:12:19.795 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:12:19 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b[65150]: 2024-09-12T02:12:19.535+0000 7f3c599a6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T02:12:19.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:19.809+0000 7f20eb000640 1 -- 172.21.15.110:0/1854086580 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f20e402d7c0 con 0x7f20e4112b90 2024-09-12T02:12:19.809 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:19 smithi110 ceph-mon[30548]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T02:12:20.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:19 smithi136 ceph-mon[35814]: pgmap v304: 97 pgs: 97 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-12T02:12:21.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:20 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1854086580' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:12:21.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:20 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:12:21.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:20 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1854086580' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:12:21.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:20 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:12:21.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:20 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1854086580' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:12:21.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:20 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-12T02:12:21.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.718+0000 7f20e0c00640 1 -- 172.21.15.110:0/1854086580 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v89) ==== 228+0+0 (secure 0 0 0) 0x7f20dc09f890 con 0x7f20e4112b90 2024-09-12T02:12:21.719 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data_ec' created 2024-09-12T02:12:21.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.723+0000 7f20eb000640 1 -- 172.21.15.110:0/1854086580 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f20c80a2b80 msgr2=0x7f20c80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:21.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.723+0000 7f20eb000640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f20c80a2b80 0x7f20c80a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f20d4000f80 tx=0x7f20d4004a60 comp rx=0 tx=0).stop 2024-09-12T02:12:21.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.723+0000 7f20eb000640 1 -- 172.21.15.110:0/1854086580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e4112b90 msgr2=0x7f20e419e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:21.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.723+0000 7f20eb000640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e4112b90 0x7f20e419e8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00d720 tx=0x7f20dc00dbe0 comp rx=0 tx=0).stop 2024-09-12T02:12:21.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.723+0000 7f20eb000640 1 -- 172.21.15.110:0/1854086580 shutdown_connections 2024-09-12T02:12:21.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.723+0000 7f20eb000640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f20c80a2b80 0x7f20c80a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:21.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.723+0000 7f20eb000640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f20e4112b90 0x7f20e419e8e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:21.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.723+0000 7f20eb000640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f20e4074eb0 0x7f20e41a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:21.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.723+0000 7f20eb000640 1 --2- 172.21.15.110:0/1854086580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20e4074590 0x7f20e41a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:21.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.723+0000 7f20eb000640 1 -- 172.21.15.110:0/1854086580 >> 172.21.15.110:0/1854086580 conn(0x7f20e40fd8c0 msgr2=0x7f20e40ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:21.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.724+0000 7f20eb000640 1 -- 172.21.15.110:0/1854086580 shutdown_connections 2024-09-12T02:12:21.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:21.724+0000 7f20eb000640 1 -- 172.21.15.110:0/1854086580 wait complete. 2024-09-12T02:12:22.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:21 smithi115 ceph-mon[35351]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T02:12:22.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:21 smithi115 ceph-mon[35351]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-12T02:12:22.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:21 smithi136 ceph-mon[35814]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T02:12:22.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:21 smithi136 ceph-mon[35814]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-12T02:12:22.167 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:21 smithi110 ceph-mon[30548]: osdmap e88: 12 total, 12 up, 12 in 2024-09-12T02:12:22.167 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:21 smithi110 ceph-mon[30548]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-12T02:12:22.669 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-12T02:12:22.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:22 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:12:22.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:22 smithi110 ceph-mon[30548]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T02:12:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:22 smithi110 ceph-mon[30548]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T02:12:23.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:22 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:12:23.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:22 smithi115 ceph-mon[35351]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T02:12:23.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:22 smithi115 ceph-mon[35351]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T02:12:23.051 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:23.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:22 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-12T02:12:23.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:22 smithi136 ceph-mon[35814]: osdmap e89: 12 total, 12 up, 12 in 2024-09-12T02:12:23.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:22 smithi136 ceph-mon[35814]: osdmap e90: 12 total, 12 up, 12 in 2024-09-12T02:12:23.742 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:23 smithi110 ceph-mon[30548]: pgmap v309: 129 pgs: 7 creating+peering, 21 unknown, 101 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 356 B/s wr, 1 op/s 2024-09-12T02:12:23.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.741+0000 7f2e4a800640 1 -- 172.21.15.110:0/1442619162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e44100940 msgr2=0x7f2e44100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:23.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.741+0000 7f2e4a800640 1 --2- 172.21.15.110:0/1442619162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e44100940 0x7f2e44100d20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009900 tx=0x7f2e3402a410 comp rx=0 tx=0).stop 2024-09-12T02:12:23.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.741+0000 7f2e4a800640 1 -- 172.21.15.110:0/1442619162 shutdown_connections 2024-09-12T02:12:23.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.742+0000 7f2e4a800640 1 --2- 172.21.15.110:0/1442619162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e4410e4f0 0x7f2e441108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:23.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.742+0000 7f2e4a800640 1 --2- 172.21.15.110:0/1442619162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e441012f0 0x7f2e4410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:23.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.742+0000 7f2e4a800640 1 --2- 172.21.15.110:0/1442619162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e44100940 0x7f2e44100d20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:23.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.742+0000 7f2e4a800640 1 -- 172.21.15.110:0/1442619162 >> 172.21.15.110:0/1442619162 conn(0x7f2e440fc790 msgr2=0x7f2e440febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:23.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.742+0000 7f2e4a800640 1 -- 172.21.15.110:0/1442619162 shutdown_connections 2024-09-12T02:12:23.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.742+0000 7f2e4a800640 1 -- 172.21.15.110:0/1442619162 wait complete. 2024-09-12T02:12:23.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.743+0000 7f2e4a800640 1 Processor -- start 2024-09-12T02:12:23.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.743+0000 7f2e4a800640 1 -- start start 2024-09-12T02:12:23.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.743+0000 7f2e4a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e44100940 0x7f2e4419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:23.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.743+0000 7f2e4a800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e441012f0 0x7f2e4419ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:23.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.743+0000 7f2e4a800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e4410e4f0 0x7f2e4419dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:23.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.743+0000 7f2e4a800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2e441141f0 con 0x7f2e44100940 2024-09-12T02:12:23.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.743+0000 7f2e4a800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2e44114070 con 0x7f2e441012f0 2024-09-12T02:12:23.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.743+0000 7f2e4a800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2e44114370 con 0x7f2e4410e4f0 2024-09-12T02:12:23.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.743+0000 7f2e43e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e4410e4f0 0x7f2e4419dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:23.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.743+0000 7f2e43400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e44100940 0x7f2e4419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:23.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.743+0000 7f2e3be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e441012f0 0x7f2e4419ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:23.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e43e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e4410e4f0 0x7f2e4419dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:45390/0 (socket says 172.21.15.110:45390) 2024-09-12T02:12:23.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e43e00640 1 -- 172.21.15.110:0/850575961 learned_addr learned my addr 172.21.15.110:0/850575961 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:23.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e43e00640 1 -- 172.21.15.110:0/850575961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e441012f0 msgr2=0x7f2e4419ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:23.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e43e00640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e441012f0 0x7f2e4419ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:23.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e43e00640 1 -- 172.21.15.110:0/850575961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e44100940 msgr2=0x7f2e4419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:23.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e43e00640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e44100940 0x7f2e4419a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:23.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e43e00640 1 -- 172.21.15.110:0/850575961 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4419e6f0 con 0x7f2e4410e4f0 2024-09-12T02:12:23.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e3be00640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e441012f0 0x7f2e4419ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:23.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e43e00640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e4410e4f0 0x7f2e4419dfc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00eb10 tx=0x7f2e3c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:23.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e40c00640 1 -- 172.21.15.110:0/850575961 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c004b20 con 0x7f2e4410e4f0 2024-09-12T02:12:23.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e4a800640 1 -- 172.21.15.110:0/850575961 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e4419e9e0 con 0x7f2e4410e4f0 2024-09-12T02:12:23.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e40c00640 1 -- 172.21.15.110:0/850575961 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e3c004cc0 con 0x7f2e4410e4f0 2024-09-12T02:12:23.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.744+0000 7f2e40c00640 1 -- 172.21.15.110:0/850575961 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c010790 con 0x7f2e4410e4f0 2024-09-12T02:12:23.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.745+0000 7f2e4a800640 1 -- 172.21.15.110:0/850575961 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e441a7350 con 0x7f2e4410e4f0 2024-09-12T02:12:23.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.746+0000 7f2e4a800640 1 -- 172.21.15.110:0/850575961 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e44100d20 con 0x7f2e4410e4f0 2024-09-12T02:12:23.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.747+0000 7f2e40c00640 1 -- 172.21.15.110:0/850575961 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2e3c005020 con 0x7f2e4410e4f0 2024-09-12T02:12:23.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.748+0000 7f2e40c00640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e280a2c00 0x7f2e280a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:23.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.749+0000 7f2e40c00640 1 -- 172.21.15.110:0/850575961 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8770+0+0 (secure 0 0 0) 0x7f2e3c0cf940 con 0x7f2e4410e4f0 2024-09-12T02:12:23.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.749+0000 7f2e43400640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e280a2c00 0x7f2e280a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:23.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.749+0000 7f2e43400640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e280a2c00 0x7f2e280a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2e34000c00 tx=0x7f2e34005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:23.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.753+0000 7f2e40c00640 1 -- 172.21.15.110:0/850575961 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e3c09c620 con 0x7f2e4410e4f0 2024-09-12T02:12:23.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:23.928+0000 7f2e4a800640 1 -- 172.21.15.110:0/850575961 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f2e44109680 con 0x7f2e4410e4f0 2024-09-12T02:12:24.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:23 smithi115 ceph-mon[35351]: pgmap v309: 129 pgs: 7 creating+peering, 21 unknown, 101 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 356 B/s wr, 1 op/s 2024-09-12T02:12:24.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:23 smithi136 ceph-mon[35814]: pgmap v309: 129 pgs: 7 creating+peering, 21 unknown, 101 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 356 B/s wr, 1 op/s 2024-09-12T02:12:24.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.745+0000 7f2e40c00640 1 -- 172.21.15.110:0/850575961 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v92) ==== 169+0+0 (secure 0 0 0) 0x7f2e3c09bf20 con 0x7f2e4410e4f0 2024-09-12T02:12:24.745 INFO:teuthology.orchestra.run.smithi110.stderr:set pool 4 allow_ec_overwrites to true 2024-09-12T02:12:24.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.748+0000 7f2e4a800640 1 -- 172.21.15.110:0/850575961 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e280a2c00 msgr2=0x7f2e280a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:24.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.748+0000 7f2e4a800640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e280a2c00 0x7f2e280a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2e34000c00 tx=0x7f2e34005b50 comp rx=0 tx=0).stop 2024-09-12T02:12:24.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.748+0000 7f2e4a800640 1 -- 172.21.15.110:0/850575961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e4410e4f0 msgr2=0x7f2e4419dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:24.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.748+0000 7f2e4a800640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e4410e4f0 0x7f2e4419dfc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00eb10 tx=0x7f2e3c00c2d0 comp rx=0 tx=0).stop 2024-09-12T02:12:24.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.748+0000 7f2e4a800640 1 -- 172.21.15.110:0/850575961 shutdown_connections 2024-09-12T02:12:24.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.748+0000 7f2e4a800640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e280a2c00 0x7f2e280a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:24.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.748+0000 7f2e4a800640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e4410e4f0 0x7f2e4419dfc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:24.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.748+0000 7f2e4a800640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e441012f0 0x7f2e4419ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:24.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.748+0000 7f2e4a800640 1 --2- 172.21.15.110:0/850575961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e44100940 0x7f2e4419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:24.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.748+0000 7f2e4a800640 1 -- 172.21.15.110:0/850575961 >> 172.21.15.110:0/850575961 conn(0x7f2e440fc790 msgr2=0x7f2e440feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:24.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.748+0000 7f2e4a800640 1 -- 172.21.15.110:0/850575961 shutdown_connections 2024-09-12T02:12:24.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:24.748+0000 7f2e4a800640 1 -- 172.21.15.110:0/850575961 wait complete. 2024-09-12T02:12:25.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:24 smithi115 ceph-mon[35351]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:24 smithi115 ceph-mon[35351]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:24 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/850575961' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:12:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:24 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:12:25.079 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:24 smithi110 ceph-mon[30548]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:12:25.079 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:24 smithi110 ceph-mon[30548]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T02:12:25.080 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:24 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/850575961' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:12:25.080 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:24 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:12:25.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:24 smithi136 ceph-mon[35814]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T02:12:25.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:24 smithi136 ceph-mon[35814]: osdmap e91: 12 total, 12 up, 12 in 2024-09-12T02:12:25.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:24 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/850575961' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:12:25.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:24 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-12T02:12:25.562 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-12T02:12:25.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:25 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T02:12:25.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:25 smithi110 ceph-mon[30548]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T02:12:25.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:25 smithi110 ceph-mon[30548]: pgmap v312: 129 pgs: 7 creating+peering, 20 unknown, 102 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:25.937 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:26.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:25 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:25 smithi115 ceph-mon[35351]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T02:12:26.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:25 smithi115 ceph-mon[35351]: pgmap v312: 129 pgs: 7 creating+peering, 20 unknown, 102 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:26.059 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:25 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-12T02:12:26.060 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:25 smithi136 ceph-mon[35814]: osdmap e92: 12 total, 12 up, 12 in 2024-09-12T02:12:26.060 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:25 smithi136 ceph-mon[35814]: pgmap v312: 129 pgs: 7 creating+peering, 20 unknown, 102 active+clean; 579 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:26.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.528+0000 7fde75a00640 1 -- 172.21.15.110:0/3435180349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde70109120 msgr2=0x7fde70110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:26.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.528+0000 7fde75a00640 1 --2- 172.21.15.110:0/3435180349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde70109120 0x7fde70110ca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fde68009ca0 tx=0x7fde6802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:12:26.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.528+0000 7fde75a00640 1 -- 172.21.15.110:0/3435180349 shutdown_connections 2024-09-12T02:12:26.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.528+0000 7fde75a00640 1 --2- 172.21.15.110:0/3435180349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde70109120 0x7fde70110ca0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:26.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.528+0000 7fde75a00640 1 --2- 172.21.15.110:0/3435180349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde701049a0 0x7fde701089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:26.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.528+0000 7fde75a00640 1 --2- 172.21.15.110:0/3435180349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde70103ff0 0x7fde701043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:26.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.528+0000 7fde75a00640 1 -- 172.21.15.110:0/3435180349 >> 172.21.15.110:0/3435180349 conn(0x7fde700ffa90 msgr2=0x7fde70101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:26.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.528+0000 7fde75a00640 1 -- 172.21.15.110:0/3435180349 shutdown_connections 2024-09-12T02:12:26.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.528+0000 7fde75a00640 1 -- 172.21.15.110:0/3435180349 wait complete. 2024-09-12T02:12:26.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde75a00640 1 Processor -- start 2024-09-12T02:12:26.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde75a00640 1 -- start start 2024-09-12T02:12:26.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde75a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde70103ff0 0x7fde7019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:26.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde75a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde701049a0 0x7fde7019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:26.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde75a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde70109120 0x7fde7019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:26.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde75a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fde701141a0 con 0x7fde70103ff0 2024-09-12T02:12:26.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde75a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fde70114020 con 0x7fde70109120 2024-09-12T02:12:26.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde75a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fde70114320 con 0x7fde701049a0 2024-09-12T02:12:26.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde6ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde70103ff0 0x7fde7019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:26.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde6e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde701049a0 0x7fde7019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:26.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde6ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde70103ff0 0x7fde7019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57318/0 (socket says 172.21.15.110:57318) 2024-09-12T02:12:26.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde6e000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde701049a0 0x7fde7019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:45402/0 (socket says 172.21.15.110:45402) 2024-09-12T02:12:26.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.529+0000 7fde6ea00640 1 -- 172.21.15.110:0/295012119 learned_addr learned my addr 172.21.15.110:0/295012119 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:26.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.530+0000 7fde6f400640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde70109120 0x7fde7019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:26.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.530+0000 7fde6e000640 1 -- 172.21.15.110:0/295012119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde70109120 msgr2=0x7fde7019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:26.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.530+0000 7fde6e000640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde70109120 0x7fde7019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:26.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.530+0000 7fde6e000640 1 -- 172.21.15.110:0/295012119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde70103ff0 msgr2=0x7fde7019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:26.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.530+0000 7fde6e000640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde70103ff0 0x7fde7019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:26.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.530+0000 7fde6e000640 1 -- 172.21.15.110:0/295012119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde7019f610 con 0x7fde701049a0 2024-09-12T02:12:26.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.530+0000 7fde6f400640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde70109120 0x7fde7019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:12:26.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.530+0000 7fde6e000640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde701049a0 0x7fde7019aba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00e9f0 tx=0x7fde5c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:26.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.530+0000 7fde67400640 1 -- 172.21.15.110:0/295012119 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c00ccc0 con 0x7fde701049a0 2024-09-12T02:12:26.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.530+0000 7fde67400640 1 -- 172.21.15.110:0/295012119 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde5c010910 con 0x7fde701049a0 2024-09-12T02:12:26.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.530+0000 7fde75a00640 1 -- 172.21.15.110:0/295012119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde7019f900 con 0x7fde701049a0 2024-09-12T02:12:26.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.530+0000 7fde67400640 1 -- 172.21.15.110:0/295012119 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c018960 con 0x7fde701049a0 2024-09-12T02:12:26.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.531+0000 7fde75a00640 1 -- 172.21.15.110:0/295012119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde701a71e0 con 0x7fde701049a0 2024-09-12T02:12:26.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.532+0000 7fde75a00640 1 -- 172.21.15.110:0/295012119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde701043d0 con 0x7fde701049a0 2024-09-12T02:12:26.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.533+0000 7fde67400640 1 -- 172.21.15.110:0/295012119 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fde5c010ac0 con 0x7fde701049a0 2024-09-12T02:12:26.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.535+0000 7fde67400640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fde540a2b80 0x7fde540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:26.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.535+0000 7fde67400640 1 -- 172.21.15.110:0/295012119 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8770+0+0 (secure 0 0 0) 0x7fde5c0cf690 con 0x7fde701049a0 2024-09-12T02:12:26.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.535+0000 7fde6ea00640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fde540a2b80 0x7fde540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:26.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.535+0000 7fde6ea00640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fde540a2b80 0x7fde540a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fde60009cd0 tx=0x7fde60005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:26.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.539+0000 7fde67400640 1 -- 172.21.15.110:0/295012119 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde5c09c370 con 0x7fde701049a0 2024-09-12T02:12:26.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.754+0000 7fde75a00640 1 -- 172.21.15.110:0/295012119 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fde701a7440 con 0x7fde701049a0 2024-09-12T02:12:26.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.810+0000 7fde67400640 1 -- 172.21.15.110:0/295012119 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v16) ==== 137+0+0 (secure 0 0 0) 0x7fde5c09bc70 con 0x7fde701049a0 2024-09-12T02:12:26.811 INFO:teuthology.orchestra.run.smithi110.stderr:added data pool 4 to fsmap 2024-09-12T02:12:26.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.813+0000 7fde75a00640 1 -- 172.21.15.110:0/295012119 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fde540a2b80 msgr2=0x7fde540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:26.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.813+0000 7fde75a00640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fde540a2b80 0x7fde540a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fde60009cd0 tx=0x7fde60005f90 comp rx=0 tx=0).stop 2024-09-12T02:12:26.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.813+0000 7fde75a00640 1 -- 172.21.15.110:0/295012119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde701049a0 msgr2=0x7fde7019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:26.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.813+0000 7fde75a00640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde701049a0 0x7fde7019aba0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00e9f0 tx=0x7fde5c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:12:26.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.813+0000 7fde75a00640 1 -- 172.21.15.110:0/295012119 shutdown_connections 2024-09-12T02:12:26.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.813+0000 7fde75a00640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fde540a2b80 0x7fde540a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:26.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.813+0000 7fde75a00640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde70109120 0x7fde7019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:26.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.813+0000 7fde75a00640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde701049a0 0x7fde7019aba0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:26.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.813+0000 7fde75a00640 1 --2- 172.21.15.110:0/295012119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde70103ff0 0x7fde7019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:26.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.813+0000 7fde75a00640 1 -- 172.21.15.110:0/295012119 >> 172.21.15.110:0/295012119 conn(0x7fde700ffa90 msgr2=0x7fde70100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:26.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.813+0000 7fde75a00640 1 -- 172.21.15.110:0/295012119 shutdown_connections 2024-09-12T02:12:26.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:26.813+0000 7fde75a00640 1 -- 172.21.15.110:0/295012119 wait complete. 2024-09-12T02:12:27.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:26 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/295012119' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T02:12:27.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:26 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T02:12:27.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:26 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/295012119' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T02:12:27.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:26 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T02:12:27.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:26 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/295012119' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T02:12:27.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:26 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-12T02:12:27.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:12:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:27 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T02:12:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:27 smithi110 ceph-mon[30548]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T02:12:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:27 smithi110 ceph-mon[30548]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:12:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:27 smithi110 ceph-mon[30548]: pgmap v314: 129 pgs: 6 creating+peering, 123 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:28.071 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:28.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:27 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T02:12:28.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:27 smithi136 ceph-mon[35814]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T02:12:28.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:27 smithi136 ceph-mon[35814]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:12:28.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:27 smithi136 ceph-mon[35814]: pgmap v314: 129 pgs: 6 creating+peering, 123 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:28.195 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:27 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-12T02:12:28.196 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:27 smithi115 ceph-mon[35351]: osdmap e93: 12 total, 12 up, 12 in 2024-09-12T02:12:28.196 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:27 smithi115 ceph-mon[35351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:12:28.196 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:27 smithi115 ceph-mon[35351]: pgmap v314: 129 pgs: 6 creating+peering, 123 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:28.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.676+0000 7fe7da800640 1 -- 172.21.15.110:0/1365066286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d4103ff0 msgr2=0x7fe7d41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:28.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.676+0000 7fe7da800640 1 --2- 172.21.15.110:0/1365066286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d4103ff0 0x7fe7d41043d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009900 tx=0x7fe7c402a410 comp rx=0 tx=0).stop 2024-09-12T02:12:28.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.676+0000 7fe7da800640 1 -- 172.21.15.110:0/1365066286 shutdown_connections 2024-09-12T02:12:28.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.676+0000 7fe7da800640 1 --2- 172.21.15.110:0/1365066286 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d4109120 0x7fe7d4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:28.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.676+0000 7fe7da800640 1 --2- 172.21.15.110:0/1365066286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d41049a0 0x7fe7d41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:28.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.676+0000 7fe7da800640 1 --2- 172.21.15.110:0/1365066286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d4103ff0 0x7fe7d41043d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:28.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.676+0000 7fe7da800640 1 -- 172.21.15.110:0/1365066286 >> 172.21.15.110:0/1365066286 conn(0x7fe7d40ffa90 msgr2=0x7fe7d4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:28.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.676+0000 7fe7da800640 1 -- 172.21.15.110:0/1365066286 shutdown_connections 2024-09-12T02:12:28.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.676+0000 7fe7da800640 1 -- 172.21.15.110:0/1365066286 wait complete. 2024-09-12T02:12:28.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.677+0000 7fe7da800640 1 Processor -- start 2024-09-12T02:12:28.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.677+0000 7fe7da800640 1 -- start start 2024-09-12T02:12:28.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7da800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d4103ff0 0x7fe7d4076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:28.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7da800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d41049a0 0x7fe7d4076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:28.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7da800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d4109120 0x7fe7d4077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:28.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7da800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4114150 con 0x7fe7d41049a0 2024-09-12T02:12:28.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7da800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4113fd0 con 0x7fe7d4103ff0 2024-09-12T02:12:28.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7da800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41142d0 con 0x7fe7d4109120 2024-09-12T02:12:28.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7d3400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d4103ff0 0x7fe7d4076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:28.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7d3400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d4103ff0 0x7fe7d4076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:52292/0 (socket says 172.21.15.110:52292) 2024-09-12T02:12:28.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7d3400640 1 -- 172.21.15.110:0/2731884525 learned_addr learned my addr 172.21.15.110:0/2731884525 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:28.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7d2a00640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d41049a0 0x7fe7d4076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:28.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7d3e00640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d4109120 0x7fe7d4077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:28.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7d3400640 1 -- 172.21.15.110:0/2731884525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d4109120 msgr2=0x7fe7d4077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:28.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7d3400640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d4109120 0x7fe7d4077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:28.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7d3400640 1 -- 172.21.15.110:0/2731884525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d41049a0 msgr2=0x7fe7d4076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:28.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7d3400640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d41049a0 0x7fe7d4076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:28.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.678+0000 7fe7d3400640 1 -- 172.21.15.110:0/2731884525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d41aac90 con 0x7fe7d4103ff0 2024-09-12T02:12:28.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.679+0000 7fe7d3400640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d4103ff0 0x7fe7d4076700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009a20 tx=0x7fe7c4004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:28.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.679+0000 7fe7cbe00640 1 -- 172.21.15.110:0/2731884525 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c403f030 con 0x7fe7d4103ff0 2024-09-12T02:12:28.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.679+0000 7fe7cbe00640 1 -- 172.21.15.110:0/2731884525 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7c4003ad0 con 0x7fe7d4103ff0 2024-09-12T02:12:28.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.679+0000 7fe7cbe00640 1 -- 172.21.15.110:0/2731884525 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4035070 con 0x7fe7d4103ff0 2024-09-12T02:12:28.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.679+0000 7fe7da800640 1 -- 172.21.15.110:0/2731884525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d41aaf20 con 0x7fe7d4103ff0 2024-09-12T02:12:28.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.679+0000 7fe7da800640 1 -- 172.21.15.110:0/2731884525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d41ab3d0 con 0x7fe7d4103ff0 2024-09-12T02:12:28.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.680+0000 7fe7da800640 1 -- 172.21.15.110:0/2731884525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d41054d0 con 0x7fe7d4103ff0 2024-09-12T02:12:28.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.683+0000 7fe7cbe00640 1 -- 172.21.15.110:0/2731884525 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fe7c4042030 con 0x7fe7d4103ff0 2024-09-12T02:12:28.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.684+0000 7fe7cbe00640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe7b80a2c00 0x7fe7b80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:28.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.685+0000 7fe7cbe00640 1 -- 172.21.15.110:0/2731884525 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8802+0+0 (secure 0 0 0) 0x7fe7c40ef730 con 0x7fe7d4103ff0 2024-09-12T02:12:28.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.685+0000 7fe7d2a00640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe7b80a2c00 0x7fe7b80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:28.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.686+0000 7fe7d2a00640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe7b80a2c00 0x7fe7b80a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4077ec0 tx=0x7fe7c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:28.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.686+0000 7fe7cbe00640 1 -- 172.21.15.110:0/2731884525 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7c40bbda0 con 0x7fe7d4103ff0 2024-09-12T02:12:28.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.899+0000 7fe7da800640 1 -- 172.21.15.110:0/2731884525 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7d4077c30 con 0x7fe7d4103ff0 2024-09-12T02:12:28.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.900+0000 7fe7cbe00640 1 -- 172.21.15.110:0/2731884525 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11860 (secure 0 0 0) 0x7fe7c40c00a0 con 0x7fe7d4103ff0 2024-09-12T02:12:28.901 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:12:28.901 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":16,"btime":"2024-09-12T02:12:26:806338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/4021694968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":4021694968},{"type":"v1","addr":"172.21.15.110:6841","nonce":4021694968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:12:13.698489+0000","modified":"2024-09-12T02:12:26.756200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6839/1796624254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1796624254},{"type":"v1","addr":"172.21.15.115:6839","nonce":1796624254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24539,"qdb_cluster":[24539]},"id":1}]} 2024-09-12T02:12:28.901 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-12T02:12:28.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.902+0000 7fe7da800640 1 -- 172.21.15.110:0/2731884525 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe7b80a2c00 msgr2=0x7fe7b80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:28.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.902+0000 7fe7da800640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe7b80a2c00 0x7fe7b80a50c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4077ec0 tx=0x7fe7c0005f90 comp rx=0 tx=0).stop 2024-09-12T02:12:28.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.902+0000 7fe7da800640 1 -- 172.21.15.110:0/2731884525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d4103ff0 msgr2=0x7fe7d4076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:28.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.902+0000 7fe7da800640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d4103ff0 0x7fe7d4076700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009a20 tx=0x7fe7c4004040 comp rx=0 tx=0).stop 2024-09-12T02:12:28.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.902+0000 7fe7da800640 1 -- 172.21.15.110:0/2731884525 shutdown_connections 2024-09-12T02:12:28.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.902+0000 7fe7da800640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe7b80a2c00 0x7fe7b80a50c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:28.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.902+0000 7fe7da800640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7d4109120 0x7fe7d4077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:28.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.902+0000 7fe7da800640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d41049a0 0x7fe7d4076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:28.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.902+0000 7fe7da800640 1 --2- 172.21.15.110:0/2731884525 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe7d4103ff0 0x7fe7d4076700 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:28.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.902+0000 7fe7da800640 1 -- 172.21.15.110:0/2731884525 >> 172.21.15.110:0/2731884525 conn(0x7fe7d40ffa90 msgr2=0x7fe7d4100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:28.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.902+0000 7fe7da800640 1 -- 172.21.15.110:0/2731884525 shutdown_connections 2024-09-12T02:12:28.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:28.902+0000 7fe7da800640 1 -- 172.21.15.110:0/2731884525 wait complete. 2024-09-12T02:12:29.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:28 smithi136 ceph-mon[35814]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T02:12:29.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:28 smithi136 ceph-mon[35814]: Cluster is now healthy 2024-09-12T02:12:29.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:28 smithi110 ceph-mon[30548]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T02:12:29.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:28 smithi110 ceph-mon[30548]: Cluster is now healthy 2024-09-12T02:12:29.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:28 smithi115 ceph-mon[35351]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T02:12:29.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:28 smithi115 ceph-mon[35351]: Cluster is now healthy 2024-09-12T02:12:29.710 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:12:29.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:29 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2731884525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:12:29.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:29 smithi110 ceph-mon[30548]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:30.080 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:30.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:29 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2731884525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:12:30.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:29 smithi136 ceph-mon[35814]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:30.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:29 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2731884525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:12:30.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:29 smithi115 ceph-mon[35351]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:30.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.687+0000 7f112b600640 1 -- 172.21.15.110:0/1740616239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1124112b90 msgr2=0x7f1124114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:30.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.687+0000 7f112b600640 1 --2- 172.21.15.110:0/1740616239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1124112b90 0x7f1124114f80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f111c009ca0 tx=0x7f111c02a950 comp rx=0 tx=0).stop 2024-09-12T02:12:30.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.687+0000 7f112b600640 1 -- 172.21.15.110:0/1740616239 shutdown_connections 2024-09-12T02:12:30.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.687+0000 7f112b600640 1 --2- 172.21.15.110:0/1740616239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1124112b90 0x7f1124114f80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:30.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.687+0000 7f112b600640 1 --2- 172.21.15.110:0/1740616239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1124074eb0 0x7f1124112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:30.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.687+0000 7f112b600640 1 --2- 172.21.15.110:0/1740616239 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1124074590 0x7f1124074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:30.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.687+0000 7f112b600640 1 -- 172.21.15.110:0/1740616239 >> 172.21.15.110:0/1740616239 conn(0x7f11240fd8c0 msgr2=0x7f11240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:30.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.687+0000 7f112b600640 1 -- 172.21.15.110:0/1740616239 shutdown_connections 2024-09-12T02:12:30.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.688+0000 7f112b600640 1 -- 172.21.15.110:0/1740616239 wait complete. 2024-09-12T02:12:30.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f112b600640 1 Processor -- start 2024-09-12T02:12:30.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f112b600640 1 -- start start 2024-09-12T02:12:30.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f112b600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1124074590 0x7f112419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:30.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f112b600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1124074eb0 0x7f112419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:30.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f112b600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1124112b90 0x7f11241a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:30.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f112b600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1124118570 con 0x7f1124074eb0 2024-09-12T02:12:30.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f112b600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f11241183f0 con 0x7f1124112b90 2024-09-12T02:12:30.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f112b600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f11241186f0 con 0x7f1124074590 2024-09-12T02:12:30.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f1123e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1124074eb0 0x7f112419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:30.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f1129600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1124112b90 0x7f11241a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:30.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f1123e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1124074eb0 0x7f112419f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57380/0 (socket says 172.21.15.110:57380) 2024-09-12T02:12:30.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f1129600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1124112b90 0x7f11241a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:59700/0 (socket says 172.21.15.110:59700) 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f1123e00640 1 -- 172.21.15.110:0/3288761124 learned_addr learned my addr 172.21.15.110:0/3288761124 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.689+0000 7f1128c00640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1124074590 0x7f112419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.690+0000 7f1129600640 1 -- 172.21.15.110:0/3288761124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1124074590 msgr2=0x7f112419eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.690+0000 7f1129600640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1124074590 0x7f112419eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.690+0000 7f1129600640 1 -- 172.21.15.110:0/3288761124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1124074eb0 msgr2=0x7f112419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.690+0000 7f1129600640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1124074eb0 0x7f112419f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.690+0000 7f1129600640 1 -- 172.21.15.110:0/3288761124 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11241a3af0 con 0x7f1124112b90 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.690+0000 7f1123e00640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1124074eb0 0x7f112419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.690+0000 7f1129600640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1124112b90 0x7f11241a33c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f111c02ae70 tx=0x7f111c02f420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.690+0000 7f1121600640 1 -- 172.21.15.110:0/3288761124 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c034040 con 0x7f1124112b90 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.690+0000 7f112b600640 1 -- 172.21.15.110:0/3288761124 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11241a3d80 con 0x7f1124112b90 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.690+0000 7f1121600640 1 -- 172.21.15.110:0/3288761124 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f111c030920 con 0x7f1124112b90 2024-09-12T02:12:30.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.690+0000 7f1121600640 1 -- 172.21.15.110:0/3288761124 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c004610 con 0x7f1124112b90 2024-09-12T02:12:30.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.691+0000 7f112b600640 1 -- 172.21.15.110:0/3288761124 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11241ab670 con 0x7f1124112b90 2024-09-12T02:12:30.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.691+0000 7f112b600640 1 -- 172.21.15.110:0/3288761124 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1124075cd0 con 0x7f1124112b90 2024-09-12T02:12:30.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.694+0000 7f1121600640 1 -- 172.21.15.110:0/3288761124 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f111c037020 con 0x7f1124112b90 2024-09-12T02:12:30.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.695+0000 7f1121600640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f110c0a2b80 0x7f110c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:30.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.695+0000 7f1121600640 1 -- 172.21.15.110:0/3288761124 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8802+0+0 (secure 0 0 0) 0x7f111c0effe0 con 0x7f1124112b90 2024-09-12T02:12:30.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.695+0000 7f1128c00640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f110c0a2b80 0x7f110c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:30.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.696+0000 7f1128c00640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f110c0a2b80 0x7f110c0a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1118005d00 tx=0x7f111800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:30.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.697+0000 7f1121600640 1 -- 172.21.15.110:0/3288761124 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f111c0bcd00 con 0x7f1124112b90 2024-09-12T02:12:30.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.876+0000 7f112b600640 1 -- 172.21.15.110:0/3288761124 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1124104fd0 con 0x7f1124112b90 2024-09-12T02:12:30.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.878+0000 7f1121600640 1 -- 172.21.15.110:0/3288761124 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24295 (secure 0 0 0) 0x7f111c0bc600 con 0x7f1124112b90 2024-09-12T02:12:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:12:30.878 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":93,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:12:26.756042+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:12:08.596125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:12:11.312393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:12:21.215161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:12:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.881+0000 7f112b600640 1 -- 172.21.15.110:0/3288761124 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f110c0a2b80 msgr2=0x7f110c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.881+0000 7f112b600640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f110c0a2b80 0x7f110c0a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1118005d00 tx=0x7f111800b410 comp rx=0 tx=0).stop 2024-09-12T02:12:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.881+0000 7f112b600640 1 -- 172.21.15.110:0/3288761124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1124112b90 msgr2=0x7f11241a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.881+0000 7f112b600640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1124112b90 0x7f11241a33c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f111c02ae70 tx=0x7f111c02f420 comp rx=0 tx=0).stop 2024-09-12T02:12:30.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.881+0000 7f112b600640 1 -- 172.21.15.110:0/3288761124 shutdown_connections 2024-09-12T02:12:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.881+0000 7f112b600640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f110c0a2b80 0x7f110c0a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.882+0000 7f112b600640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1124112b90 0x7f11241a33c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.882+0000 7f112b600640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1124074eb0 0x7f112419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.882+0000 7f112b600640 1 --2- 172.21.15.110:0/3288761124 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1124074590 0x7f112419eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.882+0000 7f112b600640 1 -- 172.21.15.110:0/3288761124 >> 172.21.15.110:0/3288761124 conn(0x7f11240fd8c0 msgr2=0x7f11240ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.882+0000 7f112b600640 1 -- 172.21.15.110:0/3288761124 shutdown_connections 2024-09-12T02:12:30.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:30.882+0000 7f112b600640 1 -- 172.21.15.110:0/3288761124 wait complete. 2024-09-12T02:12:31.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:30 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3288761124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:31.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:30 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3288761124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:31.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:30 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3288761124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:31.862 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:12:32.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:31 smithi110 ceph-mon[30548]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:32.231 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:32.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:31 smithi115 ceph-mon[35351]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:32.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:31 smithi136 ceph-mon[35814]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:32.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.860+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1658053348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4077040 msgr2=0x7f0bb4112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:32.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.860+0000 7f0bb9e00640 1 --2- 172.21.15.110:0/1658053348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4077040 0x7f0bb4112330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009900 tx=0x7f0ba002a410 comp rx=0 tx=0).stop 2024-09-12T02:12:32.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.860+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1658053348 shutdown_connections 2024-09-12T02:12:32.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.860+0000 7f0bb9e00640 1 --2- 172.21.15.110:0/1658053348 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bb4112870 0x7f0bb4114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:32.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.860+0000 7f0bb9e00640 1 --2- 172.21.15.110:0/1658053348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4077040 0x7f0bb4112330 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:32.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.860+0000 7f0bb9e00640 1 --2- 172.21.15.110:0/1658053348 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bb4076720 0x7f0bb4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:32.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.860+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1658053348 >> 172.21.15.110:0/1658053348 conn(0x7f0bb40ff8d0 msgr2=0x7f0bb4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:32.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.861+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1658053348 shutdown_connections 2024-09-12T02:12:32.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.861+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1658053348 wait complete. 2024-09-12T02:12:32.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.861+0000 7f0bb9e00640 1 Processor -- start 2024-09-12T02:12:32.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.862+0000 7f0bb9e00640 1 -- start start 2024-09-12T02:12:32.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.862+0000 7f0bb9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bb4076720 0x7f0bb41a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:32.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.862+0000 7f0bb9e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4077040 0x7f0bb41a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:32.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.862+0000 7f0bb9e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bb4112870 0x7f0bb419e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:32.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.862+0000 7f0bb9e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb4118440 con 0x7f0bb4077040 2024-09-12T02:12:32.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.862+0000 7f0bb9e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb41182c0 con 0x7f0bb4076720 2024-09-12T02:12:32.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.862+0000 7f0bb9e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb41185c0 con 0x7f0bb4112870 2024-09-12T02:12:32.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.862+0000 7f0bb3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4077040 0x7f0bb41a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:32.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.862+0000 7f0bb3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4077040 0x7f0bb41a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57394/0 (socket says 172.21.15.110:57394) 2024-09-12T02:12:32.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.862+0000 7f0bb3e00640 1 -- 172.21.15.110:0/1403636203 learned_addr learned my addr 172.21.15.110:0/1403636203 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:32.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.862+0000 7f0bb9400640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bb4112870 0x7f0bb419e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:32.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.862+0000 7f0bb8a00640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bb4076720 0x7f0bb41a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:32.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.863+0000 7f0bb3e00640 1 -- 172.21.15.110:0/1403636203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bb4112870 msgr2=0x7f0bb419e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:32.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.863+0000 7f0bb3e00640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bb4112870 0x7f0bb419e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:32.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.863+0000 7f0bb3e00640 1 -- 172.21.15.110:0/1403636203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bb4076720 msgr2=0x7f0bb41a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:32.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.863+0000 7f0bb3e00640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bb4076720 0x7f0bb41a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:32.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.863+0000 7f0bb3e00640 1 -- 172.21.15.110:0/1403636203 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb419efa0 con 0x7f0bb4077040 2024-09-12T02:12:32.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.863+0000 7f0bb3e00640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4077040 0x7f0bb41a4ba0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0004770 tx=0x7f0ba0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:32.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.863+0000 7f0bb1600640 1 -- 172.21.15.110:0/1403636203 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba003f070 con 0x7f0bb4077040 2024-09-12T02:12:32.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.863+0000 7f0bb1600640 1 -- 172.21.15.110:0/1403636203 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ba0031ca0 con 0x7f0bb4077040 2024-09-12T02:12:32.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.863+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1403636203 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb419f230 con 0x7f0bb4077040 2024-09-12T02:12:32.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.863+0000 7f0bb1600640 1 -- 172.21.15.110:0/1403636203 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0035030 con 0x7f0bb4077040 2024-09-12T02:12:32.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.863+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1403636203 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb41ab410 con 0x7f0bb4077040 2024-09-12T02:12:32.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.864+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1403636203 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb4077e60 con 0x7f0bb4077040 2024-09-12T02:12:32.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.866+0000 7f0bb1600640 1 -- 172.21.15.110:0/1403636203 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f0ba0042070 con 0x7f0bb4077040 2024-09-12T02:12:32.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.867+0000 7f0bb1600640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0b9c0a2b80 0x7f0b9c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:32.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.868+0000 7f0bb1600640 1 -- 172.21.15.110:0/1403636203 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8802+0+0 (secure 0 0 0) 0x7f0ba00ef8c0 con 0x7f0bb4077040 2024-09-12T02:12:32.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.868+0000 7f0bb8a00640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0b9c0a2b80 0x7f0b9c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:32.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.868+0000 7f0bb8a00640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0b9c0a2b80 0x7f0b9c0a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009bd0 tx=0x7f0ba8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:32.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:32.872+0000 7f0bb1600640 1 -- 172.21.15.110:0/1403636203 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ba00bbff0 con 0x7f0bb4077040 2024-09-12T02:12:33.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.051+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1403636203 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0bb410da00 con 0x7f0bb4077040 2024-09-12T02:12:33.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.052+0000 7f0bb1600640 1 -- 172.21.15.110:0/1403636203 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24295 (secure 0 0 0) 0x7f0ba00c02f0 con 0x7f0bb4077040 2024-09-12T02:12:33.052 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:12:33.052 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":93,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:12:26.756042+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:12:08.596125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:12:11.312393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:12:21.215161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:12:33.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.054+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1403636203 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0b9c0a2b80 msgr2=0x7f0b9c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:33.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.054+0000 7f0bb9e00640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0b9c0a2b80 0x7f0b9c0a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009bd0 tx=0x7f0ba8005f90 comp rx=0 tx=0).stop 2024-09-12T02:12:33.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.055+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1403636203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4077040 msgr2=0x7f0bb41a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:33.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.055+0000 7f0bb9e00640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4077040 0x7f0bb41a4ba0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0004770 tx=0x7f0ba0003c10 comp rx=0 tx=0).stop 2024-09-12T02:12:33.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.055+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1403636203 shutdown_connections 2024-09-12T02:12:33.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.055+0000 7f0bb9e00640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f0b9c0a2b80 0x7f0b9c0a5040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:33.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.055+0000 7f0bb9e00640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bb4112870 0x7f0bb419e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:33.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.055+0000 7f0bb9e00640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4077040 0x7f0bb41a4ba0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:33.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.055+0000 7f0bb9e00640 1 --2- 172.21.15.110:0/1403636203 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0bb4076720 0x7f0bb41a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:33.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.055+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1403636203 >> 172.21.15.110:0/1403636203 conn(0x7f0bb40ff8d0 msgr2=0x7f0bb4113470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:33.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.055+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1403636203 shutdown_connections 2024-09-12T02:12:33.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:33.055+0000 7f0bb9e00640 1 -- 172.21.15.110:0/1403636203 wait complete. 2024-09-12T02:12:33.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:33 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1403636203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:33.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:33 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1403636203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:33.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:33 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1403636203' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:34.045 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:12:34.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:34 smithi136 ceph-mon[35814]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:34.411 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:34.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:34 smithi110 ceph-mon[30548]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:34.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:34 smithi115 ceph-mon[35351]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:35.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.961+0000 7f185fe00640 1 -- 172.21.15.110:0/4213127364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18601047e0 msgr2=0x7f1860108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:35.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.961+0000 7f185fe00640 1 --2- 172.21.15.110:0/4213127364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18601047e0 0x7f1860108830 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f184c009900 tx=0x7f184c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:12:35.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.962+0000 7f185fe00640 1 -- 172.21.15.110:0/4213127364 shutdown_connections 2024-09-12T02:12:35.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.962+0000 7f185fe00640 1 --2- 172.21.15.110:0/4213127364 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1860108f60 0x7f1860110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:35.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.962+0000 7f185fe00640 1 --2- 172.21.15.110:0/4213127364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18601047e0 0x7f1860108830 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:35.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.962+0000 7f185fe00640 1 --2- 172.21.15.110:0/4213127364 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1860103e30 0x7f1860104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:35.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.962+0000 7f185fe00640 1 -- 172.21.15.110:0/4213127364 >> 172.21.15.110:0/4213127364 conn(0x7f18600ff8d0 msgr2=0x7f1860101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:35.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.962+0000 7f185fe00640 1 -- 172.21.15.110:0/4213127364 shutdown_connections 2024-09-12T02:12:35.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.962+0000 7f185fe00640 1 -- 172.21.15.110:0/4213127364 wait complete. 2024-09-12T02:12:35.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185fe00640 1 Processor -- start 2024-09-12T02:12:35.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185fe00640 1 -- start start 2024-09-12T02:12:35.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1860103e30 0x7f186019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:35.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18601047e0 0x7f186019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:35.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1860108f60 0x7f186019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:35.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1860113fd0 con 0x7f18601047e0 2024-09-12T02:12:35.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185fe00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1860113e50 con 0x7f1860108f60 2024-09-12T02:12:35.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185fe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1860114150 con 0x7f1860103e30 2024-09-12T02:12:35.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18601047e0 0x7f186019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:35.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18601047e0 0x7f186019a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57420/0 (socket says 172.21.15.110:57420) 2024-09-12T02:12:35.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185e000640 1 -- 172.21.15.110:0/128030597 learned_addr learned my addr 172.21.15.110:0/128030597 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:35.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185ea00640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1860103e30 0x7f186019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:35.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.963+0000 7f185f400640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1860108f60 0x7f186019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:35.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.964+0000 7f185e000640 1 -- 172.21.15.110:0/128030597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1860103e30 msgr2=0x7f186019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:35.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.964+0000 7f185e000640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1860103e30 0x7f186019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:35.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.964+0000 7f185e000640 1 -- 172.21.15.110:0/128030597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1860108f60 msgr2=0x7f186019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:35.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.964+0000 7f185e000640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1860108f60 0x7f186019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:35.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.964+0000 7f185e000640 1 -- 172.21.15.110:0/128030597 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186019f440 con 0x7f18601047e0 2024-09-12T02:12:35.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.964+0000 7f185e000640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18601047e0 0x7f186019a9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f184c004770 tx=0x7f184c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:35.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.964+0000 7f1864a00640 1 -- 172.21.15.110:0/128030597 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c03f070 con 0x7f18601047e0 2024-09-12T02:12:35.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.964+0000 7f1864a00640 1 -- 172.21.15.110:0/128030597 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f184c031ca0 con 0x7f18601047e0 2024-09-12T02:12:35.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.964+0000 7f185fe00640 1 -- 172.21.15.110:0/128030597 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186019f6d0 con 0x7f18601047e0 2024-09-12T02:12:35.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.964+0000 7f1864a00640 1 -- 172.21.15.110:0/128030597 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c035030 con 0x7f18601047e0 2024-09-12T02:12:35.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.964+0000 7f185fe00640 1 -- 172.21.15.110:0/128030597 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18601a7010 con 0x7f18601047e0 2024-09-12T02:12:35.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.965+0000 7f185fe00640 1 -- 172.21.15.110:0/128030597 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1860105310 con 0x7f18601047e0 2024-09-12T02:12:35.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.967+0000 7f1864a00640 1 -- 172.21.15.110:0/128030597 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f184c042070 con 0x7f18601047e0 2024-09-12T02:12:35.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.968+0000 7f1864a00640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f18440a2b80 0x7f18440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:35.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.969+0000 7f1864a00640 1 -- 172.21.15.110:0/128030597 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8802+0+0 (secure 0 0 0) 0x7f184c0ef9c0 con 0x7f18601047e0 2024-09-12T02:12:35.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.969+0000 7f185ea00640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f18440a2b80 0x7f18440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:35.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.969+0000 7f185ea00640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f18440a2b80 0x7f18440a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1850005fd0 tx=0x7f1850009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:35.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:34.972+0000 7f1864a00640 1 -- 172.21.15.110:0/128030597 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f184c0f1e20 con 0x7f18601047e0 2024-09-12T02:12:35.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.182+0000 7f185fe00640 1 -- 172.21.15.110:0/128030597 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1860104210 con 0x7f18601047e0 2024-09-12T02:12:35.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.183+0000 7f1864a00640 1 -- 172.21.15.110:0/128030597 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+11860 (secure 0 0 0) 0x7f184c0bc090 con 0x7f18601047e0 2024-09-12T02:12:35.183 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:12:35.184 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 16 2024-09-12T02:12:35.184 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":16,"btime":"2024-09-12T02:12:26:806338+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24493,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24517,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24538,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6841/4021694968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":4021694968},{"type":"v1","addr":"172.21.15.110:6841","nonce":4021694968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T02:12:13.698489+0000","modified":"2024-09-12T02:12:26.756200+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24539},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6839/1796624254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1796624254},{"type":"v1","addr":"172.21.15.115:6839","nonce":1796624254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24539,"qdb_cluster":[24539]},"id":1}]} 2024-09-12T02:12:35.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.185+0000 7f185fe00640 1 -- 172.21.15.110:0/128030597 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f18440a2b80 msgr2=0x7f18440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:35.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.185+0000 7f185fe00640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f18440a2b80 0x7f18440a5040 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1850005fd0 tx=0x7f1850009680 comp rx=0 tx=0).stop 2024-09-12T02:12:35.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.185+0000 7f185fe00640 1 -- 172.21.15.110:0/128030597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18601047e0 msgr2=0x7f186019a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:35.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.185+0000 7f185fe00640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18601047e0 0x7f186019a9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f184c004770 tx=0x7f184c003c10 comp rx=0 tx=0).stop 2024-09-12T02:12:35.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.185+0000 7f185fe00640 1 -- 172.21.15.110:0/128030597 shutdown_connections 2024-09-12T02:12:35.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.185+0000 7f185fe00640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f18440a2b80 0x7f18440a5040 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:35.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.185+0000 7f185fe00640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1860108f60 0x7f186019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:35.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.185+0000 7f185fe00640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18601047e0 0x7f186019a9d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:35.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.185+0000 7f185fe00640 1 --2- 172.21.15.110:0/128030597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1860103e30 0x7f186019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:35.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.185+0000 7f185fe00640 1 -- 172.21.15.110:0/128030597 >> 172.21.15.110:0/128030597 conn(0x7f18600ff8d0 msgr2=0x7f1860100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:35.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.185+0000 7f185fe00640 1 -- 172.21.15.110:0/128030597 shutdown_connections 2024-09-12T02:12:35.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:35.185+0000 7f185fe00640 1 -- 172.21.15.110:0/128030597 wait complete. 2024-09-12T02:12:35.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:35 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/128030597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:12:35.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:35 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/128030597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:12:35.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:35 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/128030597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:12:36.113 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:12:36.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:36 smithi110 ceph-mon[30548]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:36.478 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:36.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:36 smithi115 ceph-mon[35351]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:36.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:36 smithi136 ceph-mon[35814]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:37.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.059+0000 7ff74dc00640 1 -- 172.21.15.110:0/4013670208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff748074590 msgr2=0x7ff748074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.059+0000 7ff74dc00640 1 --2- 172.21.15.110:0/4013670208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff748074590 0x7ff748074970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff738009900 tx=0x7ff73802a480 comp rx=0 tx=0).stop 2024-09-12T02:12:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.059+0000 7ff74dc00640 1 -- 172.21.15.110:0/4013670208 shutdown_connections 2024-09-12T02:12:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.059+0000 7ff74dc00640 1 --2- 172.21.15.110:0/4013670208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff748112b90 0x7ff748114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.059+0000 7ff74dc00640 1 --2- 172.21.15.110:0/4013670208 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748074eb0 0x7ff748112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.059+0000 7ff74dc00640 1 --2- 172.21.15.110:0/4013670208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff748074590 0x7ff748074970 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.059+0000 7ff74dc00640 1 -- 172.21.15.110:0/4013670208 >> 172.21.15.110:0/4013670208 conn(0x7ff7480fd8c0 msgr2=0x7ff7480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.060+0000 7ff74dc00640 1 -- 172.21.15.110:0/4013670208 shutdown_connections 2024-09-12T02:12:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.060+0000 7ff74dc00640 1 -- 172.21.15.110:0/4013670208 wait complete. 2024-09-12T02:12:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff74dc00640 1 Processor -- start 2024-09-12T02:12:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff74dc00640 1 -- start start 2024-09-12T02:12:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff74dc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff748074590 0x7ff7481a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:37.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff74dc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748074eb0 0x7ff7481a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:37.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff74dc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff748112b90 0x7ff74819e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:37.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff74dc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff7481185c0 con 0x7ff748074590 2024-09-12T02:12:37.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff74dc00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff748118440 con 0x7ff748074eb0 2024-09-12T02:12:37.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff74dc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff748118740 con 0x7ff748112b90 2024-09-12T02:12:37.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff746a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff748074590 0x7ff7481a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:37.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff746a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff748074590 0x7ff7481a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57428/0 (socket says 172.21.15.110:57428) 2024-09-12T02:12:37.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff746a00640 1 -- 172.21.15.110:0/786765431 learned_addr learned my addr 172.21.15.110:0/786765431 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:37.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff73e000640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748074eb0 0x7ff7481a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:37.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.061+0000 7ff747400640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff748112b90 0x7ff74819e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:37.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.062+0000 7ff746a00640 1 -- 172.21.15.110:0/786765431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff748112b90 msgr2=0x7ff74819e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:37.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.062+0000 7ff746a00640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff748112b90 0x7ff74819e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.062+0000 7ff746a00640 1 -- 172.21.15.110:0/786765431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748074eb0 msgr2=0x7ff7481a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.062+0000 7ff746a00640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748074eb0 0x7ff7481a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.062+0000 7ff746a00640 1 -- 172.21.15.110:0/786765431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74819efe0 con 0x7ff748074590 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.062+0000 7ff746a00640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff748074590 0x7ff7481a46f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff738004770 tx=0x7ff738003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.062+0000 7ff73fe00640 1 -- 172.21.15.110:0/786765431 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73803f070 con 0x7ff748074590 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.062+0000 7ff73fe00640 1 -- 172.21.15.110:0/786765431 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff738031ca0 con 0x7ff748074590 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.062+0000 7ff74dc00640 1 -- 172.21.15.110:0/786765431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74819f270 con 0x7ff748074590 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.062+0000 7ff73fe00640 1 -- 172.21.15.110:0/786765431 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738035030 con 0x7ff748074590 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.063+0000 7ff74dc00640 1 -- 172.21.15.110:0/786765431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7481ab5c0 con 0x7ff748074590 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.064+0000 7ff74dc00640 1 -- 172.21.15.110:0/786765431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff748074970 con 0x7ff748074590 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.065+0000 7ff73fe00640 1 -- 172.21.15.110:0/786765431 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff738042070 con 0x7ff748074590 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.067+0000 7ff73fe00640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff72c0a2c00 0x7ff72c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.067+0000 7ff73fe00640 1 -- 172.21.15.110:0/786765431 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8802+0+0 (secure 0 0 0) 0x7ff7380efed0 con 0x7ff748074590 2024-09-12T02:12:37.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.067+0000 7ff73e000640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff72c0a2c00 0x7ff72c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:37.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.067+0000 7ff73e000640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff72c0a2c00 0x7ff72c0a50c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff7480fff50 tx=0x7ff73000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:37.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.069+0000 7ff73fe00640 1 -- 172.21.15.110:0/786765431 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7380bc540 con 0x7ff748074590 2024-09-12T02:12:37.247 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.246+0000 7ff74dc00640 1 -- 172.21.15.110:0/786765431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7481ab790 con 0x7ff748074590 2024-09-12T02:12:37.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.248+0000 7ff73fe00640 1 -- 172.21.15.110:0/786765431 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+24295 (secure 0 0 0) 0x7ff7380c0840 con 0x7ff748074590 2024-09-12T02:12:37.249 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:12:37.249 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":93,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:12:26.756042+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:12:08.596125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:12:11.312393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:12:21.215161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:12:37.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.250+0000 7ff74dc00640 1 -- 172.21.15.110:0/786765431 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff72c0a2c00 msgr2=0x7ff72c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:37.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.250+0000 7ff74dc00640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff72c0a2c00 0x7ff72c0a50c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff7480fff50 tx=0x7ff73000b410 comp rx=0 tx=0).stop 2024-09-12T02:12:37.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.250+0000 7ff74dc00640 1 -- 172.21.15.110:0/786765431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff748074590 msgr2=0x7ff7481a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:37.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.250+0000 7ff74dc00640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff748074590 0x7ff7481a46f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff738004770 tx=0x7ff738003c10 comp rx=0 tx=0).stop 2024-09-12T02:12:37.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.250+0000 7ff74dc00640 1 -- 172.21.15.110:0/786765431 shutdown_connections 2024-09-12T02:12:37.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.250+0000 7ff74dc00640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff72c0a2c00 0x7ff72c0a50c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:37.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.250+0000 7ff74dc00640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff748112b90 0x7ff74819e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:37.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.250+0000 7ff74dc00640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748074eb0 0x7ff7481a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:37.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.250+0000 7ff74dc00640 1 --2- 172.21.15.110:0/786765431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff748074590 0x7ff7481a46f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:37.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.250+0000 7ff74dc00640 1 -- 172.21.15.110:0/786765431 >> 172.21.15.110:0/786765431 conn(0x7ff7480fd8c0 msgr2=0x7ff7480fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:37.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.250+0000 7ff74dc00640 1 -- 172.21.15.110:0/786765431 shutdown_connections 2024-09-12T02:12:37.253 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:37.250+0000 7ff74dc00640 1 -- 172.21.15.110:0/786765431 wait complete. 2024-09-12T02:12:37.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:37 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/786765431' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:37.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:37 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/786765431' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:37.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:37 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/786765431' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:38.053 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T02:12:13.698489+0000', 'modified': '2024-09-12T02:12:26.756200+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24539}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24539': {'gid': 24539, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.115:6839/1796624254', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6838', 'nonce': 1796624254}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 1796624254}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24539, 'qdb_cluster': [24539]} 2024-09-12T02:12:38.053 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T02:12:38.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:12:38.454 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:38.592 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:38 smithi110 ceph-mon[30548]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:38.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:38 smithi136 ceph-mon[35814]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:38.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:38 smithi115 ceph-mon[35351]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:39.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.036+0000 7fa17dc00640 1 -- 172.21.15.110:0/3091581904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1781129e0 msgr2=0x7fa178114dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:39.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.036+0000 7fa17dc00640 1 --2- 172.21.15.110:0/3091581904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1781129e0 0x7fa178114dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa170009ca0 tx=0x7fa17002a950 comp rx=0 tx=0).stop 2024-09-12T02:12:39.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.036+0000 7fa17dc00640 1 -- 172.21.15.110:0/3091581904 shutdown_connections 2024-09-12T02:12:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.036+0000 7fa17dc00640 1 --2- 172.21.15.110:0/3091581904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1781129e0 0x7fa178114dd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.036+0000 7fa17dc00640 1 --2- 172.21.15.110:0/3091581904 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa178074eb0 0x7fa1781124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.036+0000 7fa17dc00640 1 --2- 172.21.15.110:0/3091581904 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa178074590 0x7fa178074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.036+0000 7fa17dc00640 1 -- 172.21.15.110:0/3091581904 >> 172.21.15.110:0/3091581904 conn(0x7fa1780fd710 msgr2=0x7fa1780ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.036+0000 7fa17dc00640 1 -- 172.21.15.110:0/3091581904 shutdown_connections 2024-09-12T02:12:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.036+0000 7fa17dc00640 1 -- 172.21.15.110:0/3091581904 wait complete. 2024-09-12T02:12:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.037+0000 7fa17dc00640 1 Processor -- start 2024-09-12T02:12:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.037+0000 7fa17dc00640 1 -- start start 2024-09-12T02:12:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.037+0000 7fa17dc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa178074590 0x7fa1781a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.037+0000 7fa17dc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa178074eb0 0x7fa1781a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.037+0000 7fa17dc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1781129e0 0x7fa17819e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.037+0000 7fa17dc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fa1781183a0 con 0x7fa178074590 2024-09-12T02:12:39.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.037+0000 7fa17dc00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa178118220 con 0x7fa178074eb0 2024-09-12T02:12:39.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.037+0000 7fa17dc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa178118520 con 0x7fa1781129e0 2024-09-12T02:12:39.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.037+0000 7fa16fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa178074eb0 0x7fa1781a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.037+0000 7fa177e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa178074590 0x7fa1781a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.037+0000 7fa16fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa178074eb0 0x7fa1781a4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:34746/0 (socket says 172.21.15.110:34746) 2024-09-12T02:12:39.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.038+0000 7fa16fe00640 1 -- 172.21.15.110:0/2952826586 learned_addr learned my addr 172.21.15.110:0/2952826586 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:39.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.038+0000 7fa17d200640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1781129e0 0x7fa17819e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.038+0000 7fa16fe00640 1 -- 172.21.15.110:0/2952826586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1781129e0 msgr2=0x7fa17819e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:39.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.038+0000 7fa16fe00640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1781129e0 0x7fa17819e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.038+0000 7fa16fe00640 1 -- 172.21.15.110:0/2952826586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa178074590 msgr2=0x7fa1781a45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:39.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.038+0000 7fa16fe00640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa178074590 0x7fa1781a45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.038+0000 7fa16fe00640 1 -- 172.21.15.110:0/2952826586 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17819eee0 con 0x7fa178074eb0 2024-09-12T02:12:39.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.038+0000 7fa177e00640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa178074590 0x7fa1781a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:39.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.038+0000 7fa16fe00640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa178074eb0 0x7fa1781a4ae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa16000d950 tx=0x7fa16000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:39.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.038+0000 7fa175600640 1 -- 172.21.15.110:0/2952826586 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160017070 con 0x7fa178074eb0 2024-09-12T02:12:39.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.038+0000 7fa175600640 1 -- 172.21.15.110:0/2952826586 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa160009c30 con 0x7fa178074eb0 2024-09-12T02:12:39.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.038+0000 7fa175600640 1 -- 172.21.15.110:0/2952826586 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16000f6b0 con 0x7fa178074eb0 2024-09-12T02:12:39.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.039+0000 7fa17dc00640 1 -- 172.21.15.110:0/2952826586 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17819f1d0 con 0x7fa178074eb0 2024-09-12T02:12:39.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.039+0000 7fa17dc00640 1 -- 172.21.15.110:0/2952826586 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1781ab350 con 0x7fa178074eb0 2024-09-12T02:12:39.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.042+0000 7fa181c0f740 1 Processor -- start 2024-09-12T02:12:39.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.042+0000 7fa181c0f740 1 -- start start 2024-09-12T02:12:39.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.042+0000 7fa175600640 1 -- 172.21.15.110:0/2952826586 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa1600109d0 con 0x7fa178074eb0 2024-09-12T02:12:39.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.042+0000 7fa181c0f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859ae4e0 0x55fb859ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.042+0000 7fa181c0f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 0x55fb859b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.042+0000 7fa181c0f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859b96c0 0x55fb859bbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.042+0000 7fa181c0f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55fb859140b0 con 0x55fb859aee00 2024-09-12T02:12:39.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.042+0000 7fa181c0f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55fb858bbab0 con 0x55fb859ae4e0 2024-09-12T02:12:39.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.042+0000 7fa181c0f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fb85910070 con 0x55fb859b96c0 2024-09-12T02:12:39.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.042+0000 7fa177e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 0x55fb859b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.043+0000 7fa177e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 0x55fb859b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56760/0 (socket says 172.21.15.110:56760) 2024-09-12T02:12:39.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.043+0000 7fa177e00640 1 -- 172.21.15.110:0/2232720757 learned_addr learned my addr 172.21.15.110:0/2232720757 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:39.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.043+0000 7fa17d200640 1 --2- 172.21.15.110:0/2232720757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859ae4e0 0x55fb859ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.043+0000 7fa16fe00640 1 --2- 172.21.15.110:0/2232720757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859b96c0 0x55fb859bbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.043+0000 7fa177e00640 1 -- 172.21.15.110:0/2232720757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859b96c0 msgr2=0x55fb859bbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:12:39.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.043+0000 7fa177e00640 1 --2- 172.21.15.110:0/2232720757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859b96c0 0x55fb859bbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.043+0000 7fa177e00640 1 -- 172.21.15.110:0/2232720757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859ae4e0 msgr2=0x55fb859ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.043+0000 7fa177e00640 1 --2- 172.21.15.110:0/2232720757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859ae4e0 0x55fb859ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.043+0000 7fa177e00640 1 -- 172.21.15.110:0/2232720757 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb858c84a0 con 0x55fb859aee00 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.043+0000 7fa177e00640 1 --2- 172.21.15.110:0/2232720757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 0x55fb859b9180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa168010480 tx=0x7fa168010940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d263badfda43aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.044+0000 7fa175600640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa15c0a2b80 0x7fa15c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.044+0000 7fa16d600640 1 -- 172.21.15.110:0/2232720757 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168011760 con 0x55fb859aee00 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.044+0000 7fa16d600640 1 -- 172.21.15.110:0/2232720757 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa168011de0 con 0x55fb859aee00 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.044+0000 7fa16d600640 1 -- 172.21.15.110:0/2232720757 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16800e430 con 0x55fb859aee00 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.044+0000 7fa175600640 1 -- 172.21.15.110:0/2952826586 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8802+0+0 (secure 0 0 0) 0x7fa1600cedc0 con 0x7fa178074eb0 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.044+0000 7fa17d200640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa15c0a2b80 0x7fa15c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.044+0000 7fa181c0f740 1 -- 172.21.15.110:0/2232720757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 msgr2=0x55fb859b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.044+0000 7fa181c0f740 1 --2- 172.21.15.110:0/2232720757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 0x55fb859b9180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa168010480 tx=0x7fa168010940 comp rx=0 tx=0).stop 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.045+0000 7fa181c0f740 1 -- 172.21.15.110:0/2232720757 shutdown_connections 2024-09-12T02:12:39.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.045+0000 7fa181c0f740 1 --2- 172.21.15.110:0/2232720757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859b96c0 0x55fb859bbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.045+0000 7fa181c0f740 1 --2- 172.21.15.110:0/2232720757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 0x55fb859b9180 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.045+0000 7fa181c0f740 1 --2- 172.21.15.110:0/2232720757 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859ae4e0 0x55fb859ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.045+0000 7fa181c0f740 1 -- 172.21.15.110:0/2232720757 >> 172.21.15.110:0/2232720757 conn(0x55fb859aaa70 msgr2=0x55fb859aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.045+0000 7fa17d200640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa15c0a2b80 0x7fa15c0a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa170005e30 tx=0x7fa170005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.045+0000 7fa181c0f740 1 -- 172.21.15.110:0/2232720757 shutdown_connections 2024-09-12T02:12:39.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.045+0000 7fa181c0f740 1 -- 172.21.15.110:0/2232720757 wait complete. 2024-09-12T02:12:39.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.045+0000 7fa181c0f740 1 -- start start 2024-09-12T02:12:39.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.045+0000 7fa181c0f740 1 Processor -- start 2024-09-12T02:12:39.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.046+0000 7fa181c0f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859ae4e0 0x55fb859b6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.046+0000 7fa181c0f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859aee00 0x55fb859b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.046+0000 7fa181c0f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 0x55fb859b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.046+0000 7fa181c0f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55fb859bc330 con 0x55fb859b96c0 2024-09-12T02:12:39.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.046+0000 7fa181c0f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55fb8589c920 con 0x55fb859ae4e0 2024-09-12T02:12:39.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.046+0000 7fa181c0f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fb859bc4b0 con 0x55fb859aee00 2024-09-12T02:12:39.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.046+0000 7fa181c0f740 10 client.0 _ll_register_callbacks cb 0x55fb858c08a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:12:39.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.046+0000 7fa17d200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 0x55fb859b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.046+0000 7fa17d200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 0x55fb859b6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56764/0 (socket says 172.21.15.110:56764) 2024-09-12T02:12:39.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.046+0000 7fa17d200640 1 -- 172.21.15.110:0/829033868 learned_addr learned my addr 172.21.15.110:0/829033868 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:39.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.046+0000 7fa177e00640 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859ae4e0 0x55fb859b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.046+0000 7fa16fe00640 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859aee00 0x55fb859b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.047+0000 7fa177e00640 1 -- 172.21.15.110:0/829033868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859aee00 msgr2=0x55fb859b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.047+0000 7fa177e00640 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859aee00 0x55fb859b6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.047+0000 7fa177e00640 1 -- 172.21.15.110:0/829033868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 msgr2=0x55fb859b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.047+0000 7fa177e00640 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 0x55fb859b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.047+0000 7fa177e00640 1 -- 172.21.15.110:0/829033868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb856852b0 con 0x55fb859ae4e0 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.047+0000 7fa17d200640 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 0x55fb859b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.047+0000 7fa177e00640 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859ae4e0 0x55fb859b6570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa168010450 tx=0x7fa16801c690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c85d215c1301169b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.047+0000 7fa166000640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.047+0000 7fa166000640 1 -- 172.21.15.110:0/829033868 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16802a060 con 0x55fb859ae4e0 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.047+0000 7fa166000640 1 -- 172.21.15.110:0/829033868 <== mon.2 v2:172.21.15.115:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8802+0+0 (secure 0 0 0) 0x7fa168011770 con 0x55fb859ae4e0 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.047+0000 7fa181c0f740 1 -- 172.21.15.110:0/829033868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa168011de0 con 0x55fb859ae4e0 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.048+0000 7fa166000640 1 -- 172.21.15.110:0/829033868 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fa168031050 con 0x55fb859ae4e0 2024-09-12T02:12:39.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.048+0000 7fa181c0f740 10 client.24641 fetch_fsmap learned FSMap version 16 2024-09-12T02:12:39.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.048+0000 7fa181c0f740 1 -- 172.21.15.110:0/829033868 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x55fb859c7fb0 con 0x55fb859ae4e0 2024-09-12T02:12:39.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.048+0000 7fa166000640 1 -- 172.21.15.110:0/829033868 <== mon.2 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa168011de0 con 0x55fb859ae4e0 2024-09-12T02:12:39.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.048+0000 7fa166000640 1 -- 172.21.15.110:0/829033868 <== mon.2 v2:172.21.15.115:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7fa16800e9d0 con 0x55fb859ae4e0 2024-09-12T02:12:39.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.048+0000 7fa181c0f740 10 client.24641 fetch_fsmap finished waiting for FSMap version 16 2024-09-12T02:12:39.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.048+0000 7fa181c0f740 10 client.24641 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:12:39.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.048+0000 7fa181c0f740 20 client.24641 populate_metadata read hostname 'smithi110' 2024-09-12T02:12:39.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.048+0000 7fa181c0f740 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55fb859ca240 0x55fb859cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.048+0000 7fa181c0f740 4 client.24641 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:12:39.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.048+0000 7fa181c0f740 1 -- 172.21.15.110:0/829033868 --> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb85921620 con 0x55fb859ca240 2024-09-12T02:12:39.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.049+0000 7fa16fe00640 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55fb859ca240 0x55fb859cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.049+0000 7fa16fe00640 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55fb859ca240 0x55fb859cb6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8e9210fbf51897d server_cookie=62904356d02a67d9 in_seq=0 out_seq=0 2024-09-12T02:12:39.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.049+0000 7fa166000640 10 client.24641 ms_handle_connect on v2:172.21.15.115:6838/1796624254 2024-09-12T02:12:39.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.050+0000 7fa166000640 1 -- 172.21.15.110:0/829033868 <== mds.0 v2:172.21.15.115:6838/1796624254 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb85921620 con 0x55fb859ca240 2024-09-12T02:12:39.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.050+0000 7fa166000640 10 client.24641 handle_command_reply: tid=0 2024-09-12T02:12:39.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.050+0000 7fa181c0f740 1 client.24641 shutdown 2024-09-12T02:12:39.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.050+0000 7fa181c0f740 1 -- 172.21.15.110:0/829033868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859ae4e0 msgr2=0x55fb859b6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:39.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.050+0000 7fa181c0f740 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859ae4e0 0x55fb859b6570 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa168010450 tx=0x7fa16801c690 comp rx=0 tx=0).stop 2024-09-12T02:12:39.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.050+0000 7fa181c0f740 1 -- 172.21.15.110:0/829033868 shutdown_connections 2024-09-12T02:12:39.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.050+0000 7fa181c0f740 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 0x55fb859b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.050+0000 7fa181c0f740 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55fb859ca240 0x55fb859cb6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.050+0000 7fa181c0f740 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859aee00 0x55fb859b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.050+0000 7fa181c0f740 1 --2- 172.21.15.110:0/829033868 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859ae4e0 0x55fb859b6570 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.050+0000 7fa166000640 0 client.24641 ms_handle_reset on v2:172.21.15.115:6838/1796624254 2024-09-12T02:12:39.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.050+0000 7fa181c0f740 1 -- 172.21.15.110:0/829033868 >> 172.21.15.110:0/829033868 conn(0x55fb859aaa70 msgr2=0x55fb859a9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:39.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.051+0000 7fa181c0f740 1 -- 172.21.15.110:0/829033868 shutdown_connections 2024-09-12T02:12:39.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.051+0000 7fa181c0f740 1 -- 172.21.15.110:0/829033868 wait complete. 2024-09-12T02:12:39.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.051+0000 7fa181c0f740 20 client.24641 trim_cache size 0 max 16384 2024-09-12T02:12:39.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.069+0000 7fa181c0f740 1 Processor -- start 2024-09-12T02:12:39.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.069+0000 7fa181c0f740 1 -- start start 2024-09-12T02:12:39.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.069+0000 7fa181c0f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859ae4e0 0x55fb859b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.069+0000 7fa181c0f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859aee00 0x55fb859c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.069+0000 7fa181c0f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 0x55fb859d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.069+0000 7fa181c0f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55fb859c99f0 con 0x55fb859b96c0 2024-09-12T02:12:39.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.069+0000 7fa181c0f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55fb859ca0c0 con 0x55fb859aee00 2024-09-12T02:12:39.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.069+0000 7fa181c0f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fb859ca790 con 0x55fb859ae4e0 2024-09-12T02:12:39.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa16fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859aee00 0x55fb859c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa16fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859aee00 0x55fb859c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:34788/0 (socket says 172.21.15.110:34788) 2024-09-12T02:12:39.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa16fe00640 1 -- 172.21.15.110:0/2239219270 learned_addr learned my addr 172.21.15.110:0/2239219270 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:39.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa17d200640 1 --2- 172.21.15.110:0/2239219270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 0x55fb859d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa177e00640 1 --2- 172.21.15.110:0/2239219270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859ae4e0 0x55fb859b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa16fe00640 1 -- 172.21.15.110:0/2239219270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859ae4e0 msgr2=0x55fb859b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:12:39.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa16fe00640 1 --2- 172.21.15.110:0/2239219270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859ae4e0 0x55fb859b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa16fe00640 1 -- 172.21.15.110:0/2239219270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 msgr2=0x55fb859d3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:12:39.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa16fe00640 1 --2- 172.21.15.110:0/2239219270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 0x55fb859d3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa16fe00640 1 -- 172.21.15.110:0/2239219270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb859ae310 con 0x55fb859aee00 2024-09-12T02:12:39.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa17d200640 1 --2- 172.21.15.110:0/2239219270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 0x55fb859d3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:12:39.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa16fe00640 1 --2- 172.21.15.110:0/2239219270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859aee00 0x55fb859c4e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa160009610 tx=0x7fa160097040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b41c5d58940d46b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:39.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa16cc00640 1 -- 172.21.15.110:0/2239219270 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa160020040 con 0x55fb859aee00 2024-09-12T02:12:39.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa16cc00640 1 -- 172.21.15.110:0/2239219270 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa160009de0 con 0x55fb859aee00 2024-09-12T02:12:39.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.070+0000 7fa16cc00640 1 -- 172.21.15.110:0/2239219270 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1600cc730 con 0x55fb859aee00 2024-09-12T02:12:39.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.071+0000 7fa181c0f740 1 -- 172.21.15.110:0/2239219270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859aee00 msgr2=0x55fb859c4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:39.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.071+0000 7fa181c0f740 1 --2- 172.21.15.110:0/2239219270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859aee00 0x55fb859c4e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa160009610 tx=0x7fa160097040 comp rx=0 tx=0).stop 2024-09-12T02:12:39.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.071+0000 7fa181c0f740 1 -- 172.21.15.110:0/2239219270 shutdown_connections 2024-09-12T02:12:39.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.071+0000 7fa181c0f740 1 --2- 172.21.15.110:0/2239219270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859b96c0 0x55fb859d3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.071+0000 7fa181c0f740 1 --2- 172.21.15.110:0/2239219270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859aee00 0x55fb859c4e10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.071+0000 7fa181c0f740 1 --2- 172.21.15.110:0/2239219270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859ae4e0 0x55fb859b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.071+0000 7fa181c0f740 1 -- 172.21.15.110:0/2239219270 >> 172.21.15.110:0/2239219270 conn(0x55fb859aaa70 msgr2=0x55fb859c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:39.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.071+0000 7fa181c0f740 1 -- 172.21.15.110:0/2239219270 shutdown_connections 2024-09-12T02:12:39.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.071+0000 7fa181c0f740 1 -- 172.21.15.110:0/2239219270 wait complete. 2024-09-12T02:12:39.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.071+0000 7fa181c0f740 1 -- start start 2024-09-12T02:12:39.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa181c0f740 1 Processor -- start 2024-09-12T02:12:39.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa181c0f740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859ae4e0 0x55fb859cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa181c0f740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 0x55fb859cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa181c0f740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859b96c0 0x55fb859ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa181c0f740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55fb859cb530 con 0x55fb859aee00 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa181c0f740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55fb859cae60 con 0x55fb859b96c0 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa181c0f740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55fb859cbc00 con 0x55fb859ae4e0 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa181c0f740 10 client.0 _ll_register_callbacks cb 0x7fa16800bef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa16fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 0x55fb859cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa16fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 0x55fb859cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56774/0 (socket says 172.21.15.110:56774) 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa16fe00640 1 -- 172.21.15.110:0/848691105 learned_addr learned my addr 172.21.15.110:0/848691105 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa177e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859ae4e0 0x55fb859cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.072+0000 7fa17d200640 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859b96c0 0x55fb859ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.073+0000 7fa16fe00640 1 -- 172.21.15.110:0/848691105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859ae4e0 msgr2=0x55fb859cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.073+0000 7fa16fe00640 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859ae4e0 0x55fb859cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.073+0000 7fa16fe00640 1 -- 172.21.15.110:0/848691105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859b96c0 msgr2=0x55fb859ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:12:39.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.073+0000 7fa16fe00640 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859b96c0 0x55fb859ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.073+0000 7fa16fe00640 1 -- 172.21.15.110:0/848691105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb859d2050 con 0x55fb859aee00 2024-09-12T02:12:39.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.073+0000 7fa177e00640 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859ae4e0 0x55fb859cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:39.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.073+0000 7fa16fe00640 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 0x55fb859cdcf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa160097890 tx=0x7fa160000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7efdb02686b66ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:39.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.073+0000 7fa166000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-12T02:12:39.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.073+0000 7fa166000640 1 -- 172.21.15.110:0/848691105 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1600b4060 con 0x55fb859aee00 2024-09-12T02:12:39.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.073+0000 7fa166000640 1 -- 172.21.15.110:0/848691105 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8802+0+0 (secure 0 0 0) 0x7fa1600b4200 con 0x55fb859aee00 2024-09-12T02:12:39.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.073+0000 7fa181c0f740 1 -- 172.21.15.110:0/848691105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa160009de0 con 0x55fb859aee00 2024-09-12T02:12:39.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.074+0000 7fa166000640 1 -- 172.21.15.110:0/848691105 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fa160020070 con 0x55fb859aee00 2024-09-12T02:12:39.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.074+0000 7fa181c0f740 10 client.14628 fetch_fsmap learned FSMap version 16 2024-09-12T02:12:39.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.074+0000 7fa181c0f740 1 -- 172.21.15.110:0/848691105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=4+}) -- 0x55fb85a34d40 con 0x55fb859aee00 2024-09-12T02:12:39.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.074+0000 7fa166000640 1 -- 172.21.15.110:0/848691105 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa160009de0 con 0x55fb859aee00 2024-09-12T02:12:39.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.074+0000 7fa166000640 1 -- 172.21.15.110:0/848691105 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 16) ==== 8350+0+0 (secure 0 0 0) 0x7fa16009a880 con 0x55fb859aee00 2024-09-12T02:12:39.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.074+0000 7fa181c0f740 10 client.14628 fetch_fsmap finished waiting for FSMap version 16 2024-09-12T02:12:39.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.074+0000 7fa181c0f740 10 client.14628 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:12:39.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.074+0000 7fa181c0f740 20 client.14628 populate_metadata read hostname 'smithi110' 2024-09-12T02:12:39.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.074+0000 7fa181c0f740 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55fb85a393e0 0x55fb85a380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:39.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.074+0000 7fa181c0f740 4 client.14628 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:12:39.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.074+0000 7fa181c0f740 1 -- 172.21.15.110:0/848691105 --> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] -- command(tid 0: {"prefix": "status"}) -- 0x55fb8591bb30 con 0x55fb85a393e0 2024-09-12T02:12:39.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.075+0000 7fa177e00640 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55fb85a393e0 0x55fb85a380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:39.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.075+0000 7fa177e00640 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55fb85a393e0 0x55fb85a380f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16aec898ff2ca025 server_cookie=88a184492563efcb in_seq=0 out_seq=0 2024-09-12T02:12:39.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.075+0000 7fa166000640 10 client.14628 ms_handle_connect on v2:172.21.15.115:6838/1796624254 2024-09-12T02:12:39.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.075+0000 7fa166000640 1 -- 172.21.15.110:0/848691105 <== mds.0 v2:172.21.15.115:6838/1796624254 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fb8591bb30 con 0x55fb85a393e0 2024-09-12T02:12:39.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.075+0000 7fa166000640 10 client.14628 handle_command_reply: tid=0 2024-09-12T02:12:39.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.075+0000 7fa181c0f740 1 client.14628 shutdown 2024-09-12T02:12:39.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.075+0000 7fa181c0f740 1 -- 172.21.15.110:0/848691105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 msgr2=0x55fb859cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:39.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.075+0000 7fa181c0f740 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 0x55fb859cdcf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa160097890 tx=0x7fa160000bc0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.075+0000 7fa181c0f740 1 -- 172.21.15.110:0/848691105 shutdown_connections 2024-09-12T02:12:39.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.075+0000 7fa181c0f740 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55fb859b96c0 0x55fb859ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.075+0000 7fa181c0f740 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55fb859aee00 0x55fb859cdcf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.075+0000 7fa181c0f740 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55fb85a393e0 0x55fb85a380f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.076+0000 7fa181c0f740 1 --2- 172.21.15.110:0/848691105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fb859ae4e0 0x55fb859cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.076+0000 7fa181c0f740 1 -- 172.21.15.110:0/848691105 >> 172.21.15.110:0/848691105 conn(0x55fb859aaa70 msgr2=0x55fb859c4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:39.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.076+0000 7fa166000640 0 client.14628 ms_handle_reset on v2:172.21.15.115:6838/1796624254 2024-09-12T02:12:39.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.076+0000 7fa181c0f740 1 -- 172.21.15.110:0/848691105 shutdown_connections 2024-09-12T02:12:39.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.076+0000 7fa181c0f740 1 -- 172.21.15.110:0/848691105 wait complete. 2024-09-12T02:12:39.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.076+0000 7fa181c0f740 20 client.14628 trim_cache size 0 max 16384 2024-09-12T02:12:39.082 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:12:39.082 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "10ead734-70ab-11ef-bcea-c7b262605968", 2024-09-12T02:12:39.082 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 0, 2024-09-12T02:12:39.082 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24539, 2024-09-12T02:12:39.082 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-09-12T02:12:39.082 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-09-12T02:12:39.082 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-09-12T02:12:39.082 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 24.393384689000001, 2024-09-12T02:12:39.082 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 16, 2024-09-12T02:12:39.082 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 93, 2024-09-12T02:12:39.082 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 92, 2024-09-12T02:12:39.082 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 40.444967771000002 2024-09-12T02:12:39.083 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:12:39.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.077+0000 7fa17dc00640 1 -- 172.21.15.110:0/2952826586 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa15c0a2b80 msgr2=0x7fa15c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:39.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.077+0000 7fa17dc00640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa15c0a2b80 0x7fa15c0a5040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa170005e30 tx=0x7fa170005c50 comp rx=0 tx=0).stop 2024-09-12T02:12:39.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.077+0000 7fa17dc00640 1 -- 172.21.15.110:0/2952826586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa178074eb0 msgr2=0x7fa1781a4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:39.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.077+0000 7fa17dc00640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa178074eb0 0x7fa1781a4ae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa16000d950 tx=0x7fa16000de10 comp rx=0 tx=0).stop 2024-09-12T02:12:39.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.077+0000 7fa17dc00640 1 -- 172.21.15.110:0/2952826586 shutdown_connections 2024-09-12T02:12:39.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.077+0000 7fa17dc00640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fa15c0a2b80 0x7fa15c0a5040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.077+0000 7fa17dc00640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1781129e0 0x7fa17819e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.077+0000 7fa17dc00640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa178074eb0 0x7fa1781a4ae0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.077+0000 7fa17dc00640 1 --2- 172.21.15.110:0/2952826586 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa178074590 0x7fa1781a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:39.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.077+0000 7fa17dc00640 1 -- 172.21.15.110:0/2952826586 >> 172.21.15.110:0/2952826586 conn(0x7fa1780fd710 msgr2=0x7fa1780ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:39.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.077+0000 7fa17dc00640 1 -- 172.21.15.110:0/2952826586 shutdown_connections 2024-09-12T02:12:39.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:39.077+0000 7fa17dc00640 1 -- 172.21.15.110:0/2952826586 wait complete. 2024-09-12T02:12:40.024 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:12:40.024 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:12:40.024 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T02:12:40.392 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:40.767 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:40 smithi110 ceph-mon[30548]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:40.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:40 smithi115 ceph-mon[35351]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:40.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:40 smithi136 ceph-mon[35814]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:41.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.023+0000 7fb26d600640 1 -- 172.21.15.110:0/4056074593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2681027a0 msgr2=0x7fb2681067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:41.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.023+0000 7fb26d600640 1 --2- 172.21.15.110:0/4056074593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2681027a0 0x7fb2681067f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb250009900 tx=0x7fb25002a410 comp rx=0 tx=0).stop 2024-09-12T02:12:41.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.023+0000 7fb26d600640 1 -- 172.21.15.110:0/4056074593 shutdown_connections 2024-09-12T02:12:41.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.023+0000 7fb26d600640 1 --2- 172.21.15.110:0/4056074593 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb268106f20 0x7fb26810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:41.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.023+0000 7fb26d600640 1 --2- 172.21.15.110:0/4056074593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2681027a0 0x7fb2681067f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:41.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.023+0000 7fb26d600640 1 --2- 172.21.15.110:0/4056074593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb268101df0 0x7fb2681021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:41.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.023+0000 7fb26d600640 1 -- 172.21.15.110:0/4056074593 >> 172.21.15.110:0/4056074593 conn(0x7fb2680fd8b0 msgr2=0x7fb2680ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:41.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.023+0000 7fb26d600640 1 -- 172.21.15.110:0/4056074593 shutdown_connections 2024-09-12T02:12:41.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.023+0000 7fb26d600640 1 -- 172.21.15.110:0/4056074593 wait complete. 2024-09-12T02:12:41.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.024+0000 7fb26d600640 1 Processor -- start 2024-09-12T02:12:41.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.024+0000 7fb26d600640 1 -- start start 2024-09-12T02:12:41.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb26d600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268101df0 0x7fb26819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:41.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb26d600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2681027a0 0x7fb26819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:41.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb26d600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb268106f20 0x7fb26819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:41.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb26d600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb268111fd0 con 0x7fb268101df0 2024-09-12T02:12:41.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb26d600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb268111e50 con 0x7fb268106f20 2024-09-12T02:12:41.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb26d600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb268112150 con 0x7fb2681027a0 2024-09-12T02:12:41.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb266a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268101df0 0x7fb26819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:41.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb266a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268101df0 0x7fb26819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56788/0 (socket says 172.21.15.110:56788) 2024-09-12T02:12:41.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb266a00640 1 -- 172.21.15.110:0/3009947460 learned_addr learned my addr 172.21.15.110:0/3009947460 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:41.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb25e000640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2681027a0 0x7fb26819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:41.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb267400640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb268106f20 0x7fb26819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:41.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb266a00640 1 -- 172.21.15.110:0/3009947460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2681027a0 msgr2=0x7fb26819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:41.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb266a00640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2681027a0 0x7fb26819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:41.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb266a00640 1 -- 172.21.15.110:0/3009947460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb268106f20 msgr2=0x7fb26819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:41.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb266a00640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb268106f20 0x7fb26819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:41.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.025+0000 7fb266a00640 1 -- 172.21.15.110:0/3009947460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26819f5c0 con 0x7fb268101df0 2024-09-12T02:12:41.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.026+0000 7fb266a00640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268101df0 0x7fb26819a610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb25800eb90 tx=0x7fb25800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:41.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.026+0000 7fb25fe00640 1 -- 172.21.15.110:0/3009947460 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258004d20 con 0x7fb268101df0 2024-09-12T02:12:41.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.026+0000 7fb25fe00640 1 -- 172.21.15.110:0/3009947460 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb25800ee90 con 0x7fb268101df0 2024-09-12T02:12:41.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.026+0000 7fb26d600640 1 -- 172.21.15.110:0/3009947460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26819f8b0 con 0x7fb268101df0 2024-09-12T02:12:41.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.026+0000 7fb25fe00640 1 -- 172.21.15.110:0/3009947460 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258010830 con 0x7fb268101df0 2024-09-12T02:12:41.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.026+0000 7fb26d600640 1 -- 172.21.15.110:0/3009947460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2681a7190 con 0x7fb268101df0 2024-09-12T02:12:41.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.027+0000 7fb26d600640 1 -- 172.21.15.110:0/3009947460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2681021d0 con 0x7fb268101df0 2024-09-12T02:12:41.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.029+0000 7fb25fe00640 1 -- 172.21.15.110:0/3009947460 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fb258005020 con 0x7fb268101df0 2024-09-12T02:12:41.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.030+0000 7fb25fe00640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb24c0a2b80 0x7fb24c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:41.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.031+0000 7fb25fe00640 1 -- 172.21.15.110:0/3009947460 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8802+0+0 (secure 0 0 0) 0x7fb2580cf920 con 0x7fb268101df0 2024-09-12T02:12:41.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.031+0000 7fb25e000640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb24c0a2b80 0x7fb24c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:41.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.031+0000 7fb25e000640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb24c0a2b80 0x7fb24c0a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb250000c00 tx=0x7fb250005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:41.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.035+0000 7fb25fe00640 1 -- 172.21.15.110:0/3009947460 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb25809c5e0 con 0x7fb268101df0 2024-09-12T02:12:41.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.246+0000 7fb26d600640 1 -- 172.21.15.110:0/3009947460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb2681a7360 con 0x7fb268101df0 2024-09-12T02:12:41.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.246+0000 7fb25fe00640 1 -- 172.21.15.110:0/3009947460 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+88 (secure 0 0 0) 0x7fb25809bee0 con 0x7fb268101df0 2024-09-12T02:12:41.247 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:12:41.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.248+0000 7fb26d600640 1 -- 172.21.15.110:0/3009947460 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb24c0a2b80 msgr2=0x7fb24c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:41.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.248+0000 7fb26d600640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb24c0a2b80 0x7fb24c0a5040 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb250000c00 tx=0x7fb250005b50 comp rx=0 tx=0).stop 2024-09-12T02:12:41.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.248+0000 7fb26d600640 1 -- 172.21.15.110:0/3009947460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268101df0 msgr2=0x7fb26819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:41.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.248+0000 7fb26d600640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268101df0 0x7fb26819a610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb25800eb90 tx=0x7fb25800c6a0 comp rx=0 tx=0).stop 2024-09-12T02:12:41.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.248+0000 7fb26d600640 1 -- 172.21.15.110:0/3009947460 shutdown_connections 2024-09-12T02:12:41.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.248+0000 7fb26d600640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb24c0a2b80 0x7fb24c0a5040 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:41.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.248+0000 7fb26d600640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb268106f20 0x7fb26819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:41.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.248+0000 7fb26d600640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2681027a0 0x7fb26819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:41.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.248+0000 7fb26d600640 1 --2- 172.21.15.110:0/3009947460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb268101df0 0x7fb26819a610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:41.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.248+0000 7fb26d600640 1 -- 172.21.15.110:0/3009947460 >> 172.21.15.110:0/3009947460 conn(0x7fb2680fd8b0 msgr2=0x7fb2680fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:41.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.249+0000 7fb26d600640 1 -- 172.21.15.110:0/3009947460 shutdown_connections 2024-09-12T02:12:41.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:41.249+0000 7fb26d600640 1 -- 172.21.15.110:0/3009947460 wait complete. 2024-09-12T02:12:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:41 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3009947460' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:12:41.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:41 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3009947460' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:12:41.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:41 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3009947460' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:12:42.066 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T02:12:42.066 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:12:42.066 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-09-12T02:12:42.066 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-12T02:12:42.066 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:12:42.066 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T02:12:42.066 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:12:42.066 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:12:42.066 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T02:12:42.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:42.067 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-09-12T02:12:42.102 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:12:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:12:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:12:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:12:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-09-12T02:12:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:12:42.103 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:12:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:12:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-09-12T02:12:42.103 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:12:42.103 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:12:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-09-12T02:12:42.104 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:12:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:12:42.104 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:12:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:12:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:12:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42189sec preferred_lft 42189sec 2024-09-12T02:12:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link noprefixroute 2024-09-12T02:12:42.104 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:12:42.105 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:12:42.105 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:12:42.105 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-12T02:12:42.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:12:42.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2024-09-12T02:12:42.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2024-09-12T02:12:42.106 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:12:42.106 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-12T02:12:42.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:12:42.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:12:42.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:42.526 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:12:42.582 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-09-12T02:12:42.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:42.585 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-09-12T02:12:42.636 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-09-12T02:12:42.636 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:12:42.636 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:12:42.636 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:12:42.636 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:12:42.637 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:12:42.637 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-12T02:12:42.637 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:12:42.637 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:12:42.637 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:12:42.637 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-12T02:12:42.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:12:42.732 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:42 smithi110 ceph-mon[30548]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:42.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:42 smithi115 ceph-mon[35351]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:42.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:42 smithi136 ceph-mon[35814]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:43.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:12:43.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:43.297 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-09-12T02:12:43.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:43.333 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2024-09-12T02:12:43.409 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:12:43.409 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-12T02:12:43.409 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:12:43.409 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-12T02:12:43.409 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-12T02:12:43.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:12:43.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:12:43.590 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-12T02:12:43.591 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:12:43.591 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-12T02:12:43.591 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-12T02:12:43.591 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:12:43.591 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-12T02:12:43.591 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-12T02:12:43.591 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-12T02:12:43.591 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-12T02:12:43.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:12:43.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:12:43.840 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:12:43.840 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-12T02:12:43.840 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-09-12T02:12:43.840 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:12:43.840 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-12T02:12:43.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:12:43.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:12:44.007 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-12T02:12:44.007 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:12:44.007 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:12:44.042 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-12T02:12:44.042 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:12:44.042 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:12:44.117 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-09-12T02:12:44.216 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:12:44.252 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-09-12T02:12:44.252 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-09-12T02:12:44.252 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-09-12T02:12:44.252 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-09-12T02:12:44.252 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-09-12T02:12:44.252 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-09-12T02:12:44.252 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-09-12T02:12:44.252 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-09-12T02:12:44.252 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-09-12T02:12:44.252 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-09-12T02:12:44.252 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-09-12T02:12:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/selinux 2024-09-12T02:12:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:12:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-09-12T02:12:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-09-12T02:12:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-09-12T02:12:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-09-12T02:12:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-09-12T02:12:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-09-12T02:12:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:12:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:12:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:12:44.253 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/5fb9d870782f95a334a2450b22aa41f786898ee763e667a3e79eaa9d4c83500c/merged 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/03f2e1deae07bb3aa2fafde879b91a99f299c4cf43322d88f362b5863793d497/merged 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/0 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/77aa8862f0fbc8027495cd078a39bdf211f5cb11526763abb4ae26c3e7ddd6b6/merged 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/86893e5e785ea6b84ba260bdedeabe521ebf73917101cb673090372ba0df5ec0/merged 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/1fe89cf6a7ab20e5e3b37e87a311f94e35a0c58c6081cb2e9f12a22af1292ac5/merged 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/13bf2fb3fd360abbc2afa8e476a0a79f2eb7015cda2363c9bd610f461db62b32/merged 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/7c1ceed0cbfbb9ce97e9ec368abcbd0c27b7ddceb95471664045c7fd89bb9e6f/merged 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/361d219011b5381f939b95d2b51ba186d2420b893cb61dbee3005ff0cad8d4e4/merged 2024-09-12T02:12:44.254 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/20997fcc4dc462af8a439f710930ee5d37119001b32ee501741b7c01aa25cf74/merged 2024-09-12T02:12:44.255 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/d2487f61a22326d86d7d10943e0cca6159f6c4cee58ce880734563f41f957cca/merged 2024-09-12T02:12:44.255 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-09-12T02:12:44.255 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:12:44.255 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:12:44.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:44.256 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-09-12T02:12:44.332 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-12T02:12:44.333 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-12T02:12:44.377 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-09-12T02:12:44.434 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:12:44.470 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-09-12T02:12:44.471 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-09-12T02:12:44.471 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-09-12T02:12:44.471 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-09-12T02:12:44.471 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-09-12T02:12:44.471 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-09-12T02:12:44.471 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-09-12T02:12:44.471 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-09-12T02:12:44.471 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-09-12T02:12:44.471 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-09-12T02:12:44.471 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-09-12T02:12:44.471 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/selinux 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-09-12T02:12:44.472 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/5fb9d870782f95a334a2450b22aa41f786898ee763e667a3e79eaa9d4c83500c/merged 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/03f2e1deae07bb3aa2fafde879b91a99f299c4cf43322d88f362b5863793d497/merged 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/0 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/77aa8862f0fbc8027495cd078a39bdf211f5cb11526763abb4ae26c3e7ddd6b6/merged 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/86893e5e785ea6b84ba260bdedeabe521ebf73917101cb673090372ba0df5ec0/merged 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/1fe89cf6a7ab20e5e3b37e87a311f94e35a0c58c6081cb2e9f12a22af1292ac5/merged 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/13bf2fb3fd360abbc2afa8e476a0a79f2eb7015cda2363c9bd610f461db62b32/merged 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/7c1ceed0cbfbb9ce97e9ec368abcbd0c27b7ddceb95471664045c7fd89bb9e6f/merged 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/361d219011b5381f939b95d2b51ba186d2420b893cb61dbee3005ff0cad8d4e4/merged 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/20997fcc4dc462af8a439f710930ee5d37119001b32ee501741b7c01aa25cf74/merged 2024-09-12T02:12:44.473 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/d2487f61a22326d86d7d10943e0cca6159f6c4cee58ce880734563f41f957cca/merged 2024-09-12T02:12:44.474 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-09-12T02:12:44.474 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:12:44.474 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:12:44.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:44.475 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-09-12T02:12:44.571 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi110.stderr:2024-09-12T02:12:44.570+0000 7f70e351c480 -1 init, newargv = 0x557736f81430 newargc=15 2024-09-12T02:12:44.571 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi110.stderr:ceph-fuse[75428]: starting ceph client 2024-09-12T02:12:44.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi110.stderr:ceph-fuse[75428]: starting fuse 2024-09-12T02:12:44.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:44 smithi115 ceph-mon[35351]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:44.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:44 smithi136 ceph-mon[35814]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:44.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:44 smithi110 ceph-mon[30548]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:45.654 DEBUG:teuthology.orchestra.run.smithi110:> sudo modprobe fuse 2024-09-12T02:12:45.714 DEBUG:teuthology.orchestra.run.smithi110:> cat /proc/self/mounts | awk '{print $2}' 2024-09-12T02:12:45.751 INFO:teuthology.orchestra.run.smithi110.stdout:/proc 2024-09-12T02:12:45.751 INFO:teuthology.orchestra.run.smithi110.stdout:/sys 2024-09-12T02:12:45.751 INFO:teuthology.orchestra.run.smithi110.stdout:/dev 2024-09-12T02:12:45.751 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/security 2024-09-12T02:12:45.751 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/shm 2024-09-12T02:12:45.751 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/pts 2024-09-12T02:12:45.752 INFO:teuthology.orchestra.run.smithi110.stdout:/run 2024-09-12T02:12:45.752 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/cgroup 2024-09-12T02:12:45.752 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/pstore 2024-09-12T02:12:45.752 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/bpf 2024-09-12T02:12:45.752 INFO:teuthology.orchestra.run.smithi110.stdout:/ 2024-09-12T02:12:45.752 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/selinux 2024-09-12T02:12:45.752 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:12:45.752 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/hugepages 2024-09-12T02:12:45.752 INFO:teuthology.orchestra.run.smithi110.stdout:/dev/mqueue 2024-09-12T02:12:45.752 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/debug 2024-09-12T02:12:45.752 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/tracing 2024-09-12T02:12:45.752 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/fs/fuse/connections 2024-09-12T02:12:45.753 INFO:teuthology.orchestra.run.smithi110.stdout:/sys/kernel/config 2024-09-12T02:12:45.753 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-sysctl.service 2024-09-12T02:12:45.753 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-12T02:12:45.753 INFO:teuthology.orchestra.run.smithi110.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-12T02:12:45.753 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/nfs/rpc_pipefs 2024-09-12T02:12:45.753 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/1000 2024-09-12T02:12:45.753 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/ceph 2024-09-12T02:12:45.753 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay 2024-09-12T02:12:45.753 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/5fb9d870782f95a334a2450b22aa41f786898ee763e667a3e79eaa9d4c83500c/merged 2024-09-12T02:12:45.753 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/03f2e1deae07bb3aa2fafde879b91a99f299c4cf43322d88f362b5863793d497/merged 2024-09-12T02:12:45.753 INFO:teuthology.orchestra.run.smithi110.stdout:/run/user/0 2024-09-12T02:12:45.753 INFO:teuthology.orchestra.run.smithi110.stdout:/proc/sys/fs/binfmt_misc 2024-09-12T02:12:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/77aa8862f0fbc8027495cd078a39bdf211f5cb11526763abb4ae26c3e7ddd6b6/merged 2024-09-12T02:12:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/86893e5e785ea6b84ba260bdedeabe521ebf73917101cb673090372ba0df5ec0/merged 2024-09-12T02:12:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/1fe89cf6a7ab20e5e3b37e87a311f94e35a0c58c6081cb2e9f12a22af1292ac5/merged 2024-09-12T02:12:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/13bf2fb3fd360abbc2afa8e476a0a79f2eb7015cda2363c9bd610f461db62b32/merged 2024-09-12T02:12:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/7c1ceed0cbfbb9ce97e9ec368abcbd0c27b7ddceb95471664045c7fd89bb9e6f/merged 2024-09-12T02:12:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/361d219011b5381f939b95d2b51ba186d2420b893cb61dbee3005ff0cad8d4e4/merged 2024-09-12T02:12:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/20997fcc4dc462af8a439f710930ee5d37119001b32ee501741b7c01aa25cf74/merged 2024-09-12T02:12:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:/var/lib/containers/storage/overlay/d2487f61a22326d86d7d10943e0cca6159f6c4cee58ce880734563f41f957cca/merged 2024-09-12T02:12:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns 2024-09-12T02:12:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:12:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:12:45.754 INFO:teuthology.orchestra.run.smithi110.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-12T02:12:45.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:45.755 DEBUG:teuthology.orchestra.run.smithi110:> ls /sys/fs/fuse/connections 2024-09-12T02:12:45.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]: dispatch 2024-09-12T02:12:45.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-12T02:12:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-12T02:12:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-12T02:12:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-12T02:12:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-09-12T02:12:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-09-12T02:12:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-09-12T02:12:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-12T02:12:45.833 INFO:teuthology.orchestra.run.smithi110.stdout:120 2024-09-12T02:12:45.833 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-12T02:12:45.834 DEBUG:teuthology.orchestra.run.smithi110:> sudo stdin-killer -- python3 -c ' 2024-09-12T02:12:45.834 DEBUG:teuthology.orchestra.run.smithi110:> import glob 2024-09-12T02:12:45.834 DEBUG:teuthology.orchestra.run.smithi110:> import re 2024-09-12T02:12:45.834 DEBUG:teuthology.orchestra.run.smithi110:> import os 2024-09-12T02:12:45.834 DEBUG:teuthology.orchestra.run.smithi110:> import subprocess 2024-09-12T02:12:45.835 DEBUG:teuthology.orchestra.run.smithi110:> 2024-09-12T02:12:45.835 DEBUG:teuthology.orchestra.run.smithi110:> def _find_admin_socket(client_name): 2024-09-12T02:12:45.835 DEBUG:teuthology.orchestra.run.smithi110:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-12T02:12:45.835 DEBUG:teuthology.orchestra.run.smithi110:> files = glob.glob(asok_path) 2024-09-12T02:12:45.835 DEBUG:teuthology.orchestra.run.smithi110:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-12T02:12:45.836 DEBUG:teuthology.orchestra.run.smithi110:> 2024-09-12T02:12:45.836 DEBUG:teuthology.orchestra.run.smithi110:> # Given a non-glob path, it better be there 2024-09-12T02:12:45.836 DEBUG:teuthology.orchestra.run.smithi110:> if "*" not in asok_path: 2024-09-12T02:12:45.836 DEBUG:teuthology.orchestra.run.smithi110:> assert(len(files) == 1) 2024-09-12T02:12:45.836 DEBUG:teuthology.orchestra.run.smithi110:> return files[0] 2024-09-12T02:12:45.836 DEBUG:teuthology.orchestra.run.smithi110:> 2024-09-12T02:12:45.837 DEBUG:teuthology.orchestra.run.smithi110:> for f in files: 2024-09-12T02:12:45.837 DEBUG:teuthology.orchestra.run.smithi110:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-12T02:12:45.837 DEBUG:teuthology.orchestra.run.smithi110:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-12T02:12:45.837 DEBUG:teuthology.orchestra.run.smithi110:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-12T02:12:45.837 DEBUG:teuthology.orchestra.run.smithi110:> contents = proc_f.read() 2024-09-12T02:12:45.838 DEBUG:teuthology.orchestra.run.smithi110:> if mountpoint in contents: 2024-09-12T02:12:45.838 DEBUG:teuthology.orchestra.run.smithi110:> return f 2024-09-12T02:12:45.838 DEBUG:teuthology.orchestra.run.smithi110:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-12T02:12:45.838 DEBUG:teuthology.orchestra.run.smithi110:> 2024-09-12T02:12:45.838 DEBUG:teuthology.orchestra.run.smithi110:> print(_find_admin_socket("client.admin")) 2024-09-12T02:12:45.839 DEBUG:teuthology.orchestra.run.smithi110:> ' 2024-09-12T02:12:45.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]: dispatch 2024-09-12T02:12:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-12T02:12:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-12T02:12:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-12T02:12:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-12T02:12:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-09-12T02:12:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-09-12T02:12:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-09-12T02:12:45.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-12T02:12:45.921 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]: dispatch 2024-09-12T02:12:45.921 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-12T02:12:45.921 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-12T02:12:45.921 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-12T02:12:45.921 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-12T02:12:45.921 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]: dispatch 2024-09-12T02:12:45.921 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]: dispatch 2024-09-12T02:12:45.922 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-09-12T02:12:45.922 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-09-12T02:12:45.995 INFO:teuthology.orchestra.run.smithi110.stdout:/var/run/ceph/ceph-client.admin.75428.asok 2024-09-12T02:12:45.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:12:46.009 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75428.asok 2024-09-12T02:12:46.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:46.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75428.asok status 2024-09-12T02:12:46.190 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:12:46.190 INFO:teuthology.orchestra.run.smithi110.stdout: "metadata": { 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: "entity_id": "admin", 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: "hostname": "smithi110", 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: "pid": "75428", 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: "root": "/" 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_count": 0, 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: "dentry_pinned_count": 0, 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 14640, 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: "inst": { 2024-09-12T02:12:46.191 INFO:teuthology.orchestra.run.smithi110.stdout: "name": { 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "client", 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: "num": 14640 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 3533774309 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": { 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "192.168.0.1:0", 2024-09-12T02:12:46.192 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 3533774309 2024-09-12T02:12:46.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:12:46.193 INFO:teuthology.orchestra.run.smithi110.stdout: "inst_str": "client.14640 192.168.0.1:0/3533774309", 2024-09-12T02:12:46.193 INFO:teuthology.orchestra.run.smithi110.stdout: "addr_str": "192.168.0.1:0/3533774309", 2024-09-12T02:12:46.193 INFO:teuthology.orchestra.run.smithi110.stdout: "inode_count": 1, 2024-09-12T02:12:46.193 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_epoch": 16, 2024-09-12T02:12:46.193 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch": 93, 2024-09-12T02:12:46.193 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_epoch_barrier": 0, 2024-09-12T02:12:46.193 INFO:teuthology.orchestra.run.smithi110.stdout: "blocklisted": false, 2024-09-12T02:12:46.193 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs" 2024-09-12T02:12:46.193 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:12:46.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:46.204 DEBUG:teuthology.orchestra.run.smithi110:> stat --file-system '--printf=%T 2024-09-12T02:12:46.204 DEBUG:teuthology.orchestra.run.smithi110:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:12:46.240 INFO:teuthology.orchestra.run.smithi110.stdout:fuseblk 2024-09-12T02:12:46.241 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:12:46.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:46.241 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:12:46.338 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-12T02:12:46.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:12:46.446 INFO:teuthology.orchestra.run.smithi110.stdout:# file: . 2024-09-12T02:12:46.446 INFO:teuthology.orchestra.run.smithi110.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-12T02:12:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:12:46.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:12:46.454 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:12:46.454 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:12:46.491 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:12:46.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:46 smithi115 ceph-mon[35351]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:46.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]': finished 2024-09-12T02:12:46.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-12T02:12:46.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-12T02:12:46.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-12T02:12:46.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-12T02:12:46.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-12T02:12:46.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-12T02:12:46.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-12T02:12:46.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-12T02:12:46.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:46 smithi115 ceph-mon[35351]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T02:12:46.904 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:46.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:46 smithi136 ceph-mon[35814]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:46.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]': finished 2024-09-12T02:12:46.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-12T02:12:46.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-12T02:12:46.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-12T02:12:46.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-12T02:12:46.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-12T02:12:46.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-12T02:12:46.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-12T02:12:46.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-12T02:12:46.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:46 smithi136 ceph-mon[35814]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T02:12:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:46 smithi110 ceph-mon[30548]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]': finished 2024-09-12T02:12:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-12T02:12:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-12T02:12:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-12T02:12:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-12T02:12:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-12T02:12:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-12T02:12:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-12T02:12:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-09-12T02:12:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:46 smithi110 ceph-mon[30548]: osdmap e94: 12 total, 12 up, 12 in 2024-09-12T02:12:47.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.460+0000 7f8a09e00640 1 -- 172.21.15.110:0/341293941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a04112a30 msgr2=0x7f8a04114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:47.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.460+0000 7f8a09e00640 1 --2- 172.21.15.110:0/341293941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a04112a30 0x7f8a04114e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009ca0 tx=0x7f89fc02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:12:47.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.460+0000 7f8a09e00640 1 -- 172.21.15.110:0/341293941 shutdown_connections 2024-09-12T02:12:47.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.460+0000 7f8a09e00640 1 --2- 172.21.15.110:0/341293941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a04112a30 0x7f8a04114e20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:47.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.460+0000 7f8a09e00640 1 --2- 172.21.15.110:0/341293941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a04077040 0x7f8a041124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:47.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.460+0000 7f8a09e00640 1 --2- 172.21.15.110:0/341293941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a04076720 0x7f8a04076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:47.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.460+0000 7f8a09e00640 1 -- 172.21.15.110:0/341293941 >> 172.21.15.110:0/341293941 conn(0x7f8a040ffa90 msgr2=0x7f8a04101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:47.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.460+0000 7f8a09e00640 1 -- 172.21.15.110:0/341293941 shutdown_connections 2024-09-12T02:12:47.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.460+0000 7f8a09e00640 1 -- 172.21.15.110:0/341293941 wait complete. 2024-09-12T02:12:47.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.461+0000 7f8a09e00640 1 Processor -- start 2024-09-12T02:12:47.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.461+0000 7f8a09e00640 1 -- start start 2024-09-12T02:12:47.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a09e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a04076720 0x7f8a041a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:47.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a09e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a04077040 0x7f8a041a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:47.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a09e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a04112a30 0x7f8a0419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:47.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a09e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8a04118570 con 0x7f8a04076720 2024-09-12T02:12:47.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a09e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8a041183f0 con 0x7f8a04077040 2024-09-12T02:12:47.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a09e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8a041186f0 con 0x7f8a04112a30 2024-09-12T02:12:47.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a02a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a04076720 0x7f8a041a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:47.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a02a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a04076720 0x7f8a041a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56806/0 (socket says 172.21.15.110:56806) 2024-09-12T02:12:47.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a02a00640 1 -- 172.21.15.110:0/3691279002 learned_addr learned my addr 172.21.15.110:0/3691279002 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:47.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a02000640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a04077040 0x7f8a041a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:47.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a03400640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a04112a30 0x7f8a0419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:47.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a02a00640 1 -- 172.21.15.110:0/3691279002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a04112a30 msgr2=0x7f8a0419e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:47.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a02a00640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a04112a30 0x7f8a0419e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:47.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a02a00640 1 -- 172.21.15.110:0/3691279002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a04077040 msgr2=0x7f8a041a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:47.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a02a00640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a04077040 0x7f8a041a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:47.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a02a00640 1 -- 172.21.15.110:0/3691279002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0419efb0 con 0x7f8a04076720 2024-09-12T02:12:47.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.462+0000 7f8a02000640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a04077040 0x7f8a041a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:12:47.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.463+0000 7f8a02a00640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a04076720 0x7f8a041a46c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f89f400d950 tx=0x7f89f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:47.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.463+0000 7f8a08a00640 1 -- 172.21.15.110:0/3691279002 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f4017070 con 0x7f8a04076720 2024-09-12T02:12:47.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.463+0000 7f8a08a00640 1 -- 172.21.15.110:0/3691279002 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89f4009c30 con 0x7f8a04076720 2024-09-12T02:12:47.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.463+0000 7f8a08a00640 1 -- 172.21.15.110:0/3691279002 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f400f6b0 con 0x7f8a04076720 2024-09-12T02:12:47.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.463+0000 7f8a09e00640 1 -- 172.21.15.110:0/3691279002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0419f2a0 con 0x7f8a04076720 2024-09-12T02:12:47.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.463+0000 7f8a09e00640 1 -- 172.21.15.110:0/3691279002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a041ab590 con 0x7f8a04076720 2024-09-12T02:12:47.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.464+0000 7f8a09e00640 1 -- 172.21.15.110:0/3691279002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a04076b00 con 0x7f8a04076720 2024-09-12T02:12:47.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.466+0000 7f8a08a00640 1 -- 172.21.15.110:0/3691279002 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f89f40109d0 con 0x7f8a04076720 2024-09-12T02:12:47.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.467+0000 7f8a08a00640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f89e80a2c00 0x7f89e80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:47.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.467+0000 7f8a08a00640 1 -- 172.21.15.110:0/3691279002 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f89f40cf080 con 0x7f8a04076720 2024-09-12T02:12:47.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.468+0000 7f8a02000640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f89e80a2c00 0x7f89e80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:47.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.468+0000 7f8a02000640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f89e80a2c00 0x7f89e80a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f89f0005fd0 tx=0x7f89f0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:47.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.472+0000 7f8a08a00640 1 -- 172.21.15.110:0/3691279002 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89f4009de0 con 0x7f8a04076720 2024-09-12T02:12:47.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.666+0000 7f8a09e00640 1 -- 172.21.15.110:0/3691279002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8a0419fdb0 con 0x7f8a04076720 2024-09-12T02:12:47.667 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:47 smithi110 ceph-mon[30548]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T02:12:47.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.667+0000 7f8a08a00640 1 -- 172.21.15.110:0/3691279002 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v95) ==== 81+0+601 (secure 0 0 0) 0x7f89f409bc40 con 0x7f8a04076720 2024-09-12T02:12:47.668 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3490929121 2024-09-13T02:04:45.356605+0000 2024-09-12T02:12:47.668 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/2826731707 2024-09-13T02:04:45.356605+0000 2024-09-12T02:12:47.668 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/2413734786 2024-09-13T02:04:45.356605+0000 2024-09-12T02:12:47.668 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/3137576010 2024-09-13T02:04:45.356605+0000 2024-09-12T02:12:47.668 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/3137576010 2024-09-13T02:04:45.356605+0000 2024-09-12T02:12:47.668 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/3368055532 2024-09-13T02:04:17.987172+0000 2024-09-12T02:12:47.668 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/667674244 2024-09-13T02:04:17.987172+0000 2024-09-12T02:12:47.668 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/3368055532 2024-09-13T02:04:17.987172+0000 2024-09-12T02:12:47.668 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3644360562 2024-09-13T02:04:17.987172+0000 2024-09-12T02:12:47.669 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3947837481 2024-09-13T02:04:17.987172+0000 2024-09-12T02:12:47.669 INFO:teuthology.orchestra.run.smithi110.stderr:listed 10 entries 2024-09-12T02:12:47.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.669+0000 7f8a09e00640 1 -- 172.21.15.110:0/3691279002 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f89e80a2c00 msgr2=0x7f89e80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:47.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.669+0000 7f8a09e00640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f89e80a2c00 0x7f89e80a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f89f0005fd0 tx=0x7f89f0005850 comp rx=0 tx=0).stop 2024-09-12T02:12:47.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.669+0000 7f8a09e00640 1 -- 172.21.15.110:0/3691279002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a04076720 msgr2=0x7f8a041a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.669+0000 7f8a09e00640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a04076720 0x7f8a041a46c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f89f400d950 tx=0x7f89f400de10 comp rx=0 tx=0).stop 2024-09-12T02:12:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.669+0000 7f8a09e00640 1 -- 172.21.15.110:0/3691279002 shutdown_connections 2024-09-12T02:12:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.669+0000 7f8a09e00640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f89e80a2c00 0x7f89e80a50c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.669+0000 7f8a09e00640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a04112a30 0x7f8a0419e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.669+0000 7f8a09e00640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a04077040 0x7f8a041a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.669+0000 7f8a09e00640 1 --2- 172.21.15.110:0/3691279002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a04076720 0x7f8a041a46c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.669+0000 7f8a09e00640 1 -- 172.21.15.110:0/3691279002 >> 172.21.15.110:0/3691279002 conn(0x7f8a040ffa90 msgr2=0x7f8a04101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:47.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.669+0000 7f8a09e00640 1 -- 172.21.15.110:0/3691279002 shutdown_connections 2024-09-12T02:12:47.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:47.669+0000 7f8a09e00640 1 -- 172.21.15.110:0/3691279002 wait complete. 2024-09-12T02:12:47.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:47 smithi115 ceph-mon[35351]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T02:12:47.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:47 smithi136 ceph-mon[35814]: osdmap e95: 12 total, 12 up, 12 in 2024-09-12T02:12:48.431 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:12:48.431 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:12:48.468 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:12:48.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:48 smithi110 ceph-mon[30548]: pgmap v326: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:48.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:48 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3691279002' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:12:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:48 smithi115 ceph-mon[35351]: pgmap v326: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:48.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:48 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3691279002' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:12:48.877 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:48.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:48 smithi136 ceph-mon[35814]: pgmap v326: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:12:48.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:48 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3691279002' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:12:49.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.506+0000 7fead9400640 1 -- 172.21.15.110:0/2740339318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead4109120 msgr2=0x7fead4110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:49.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.506+0000 7fead9400640 1 --2- 172.21.15.110:0/2740339318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead4109120 0x7fead4110ca0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feacc009900 tx=0x7feacc02a400 comp rx=0 tx=0).stop 2024-09-12T02:12:49.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.506+0000 7fead9400640 1 -- 172.21.15.110:0/2740339318 shutdown_connections 2024-09-12T02:12:49.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.506+0000 7fead9400640 1 --2- 172.21.15.110:0/2740339318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead4109120 0x7fead4110ca0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:49.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.506+0000 7fead9400640 1 --2- 172.21.15.110:0/2740339318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fead41049a0 0x7fead41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:49.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.506+0000 7fead9400640 1 --2- 172.21.15.110:0/2740339318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead4103ff0 0x7fead41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:49.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.506+0000 7fead9400640 1 -- 172.21.15.110:0/2740339318 >> 172.21.15.110:0/2740339318 conn(0x7fead40ffa90 msgr2=0x7fead4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:49.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.506+0000 7fead9400640 1 -- 172.21.15.110:0/2740339318 shutdown_connections 2024-09-12T02:12:49.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.506+0000 7fead9400640 1 -- 172.21.15.110:0/2740339318 wait complete. 2024-09-12T02:12:49.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.507+0000 7fead9400640 1 Processor -- start 2024-09-12T02:12:49.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.507+0000 7fead9400640 1 -- start start 2024-09-12T02:12:49.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7fead9400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fead4103ff0 0x7fead419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:49.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7fead9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead41049a0 0x7fead419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:49.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7fead9400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead4109120 0x7fead419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:49.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7fead9400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fead41141a0 con 0x7fead41049a0 2024-09-12T02:12:49.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7fead9400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fead4114020 con 0x7fead4109120 2024-09-12T02:12:49.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7fead9400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fead4114320 con 0x7fead4103ff0 2024-09-12T02:12:49.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7fead2800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fead4103ff0 0x7fead419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:49.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7feacbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead41049a0 0x7fead419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:49.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7fead2800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fead4103ff0 0x7fead419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:44306/0 (socket says 172.21.15.110:44306) 2024-09-12T02:12:49.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7fead2800640 1 -- 172.21.15.110:0/4272309361 learned_addr learned my addr 172.21.15.110:0/4272309361 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:49.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7fead3200640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead4109120 0x7fead419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:49.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7feacbe00640 1 -- 172.21.15.110:0/4272309361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fead4103ff0 msgr2=0x7fead419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:49.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7feacbe00640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fead4103ff0 0x7fead419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:49.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7feacbe00640 1 -- 172.21.15.110:0/4272309361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead4109120 msgr2=0x7fead419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:49.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7feacbe00640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead4109120 0x7fead419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:49.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7feacbe00640 1 -- 172.21.15.110:0/4272309361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead419f5b0 con 0x7fead41049a0 2024-09-12T02:12:49.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.508+0000 7fead2800640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fead4103ff0 0x7fead419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:49.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.509+0000 7feacbe00640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead41049a0 0x7fead419ab40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7feabc00e9f0 tx=0x7feabc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:49.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.509+0000 7feacb400640 1 -- 172.21.15.110:0/4272309361 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc00ccc0 con 0x7fead41049a0 2024-09-12T02:12:49.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.509+0000 7feacb400640 1 -- 172.21.15.110:0/4272309361 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feabc005020 con 0x7fead41049a0 2024-09-12T02:12:49.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.509+0000 7fead9400640 1 -- 172.21.15.110:0/4272309361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead419f8a0 con 0x7fead41049a0 2024-09-12T02:12:49.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.509+0000 7feacb400640 1 -- 172.21.15.110:0/4272309361 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc0049e0 con 0x7fead41049a0 2024-09-12T02:12:49.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.509+0000 7fead9400640 1 -- 172.21.15.110:0/4272309361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead41a7180 con 0x7fead41049a0 2024-09-12T02:12:49.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.510+0000 7fead9400640 1 -- 172.21.15.110:0/4272309361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead41043d0 con 0x7fead41049a0 2024-09-12T02:12:49.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.512+0000 7feacb400640 1 -- 172.21.15.110:0/4272309361 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7feabc005560 con 0x7fead41049a0 2024-09-12T02:12:49.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.514+0000 7feacb400640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7feab80a2c00 0x7feab80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:49.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.514+0000 7feacb400640 1 -- 172.21.15.110:0/4272309361 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7feabc0cf230 con 0x7fead41049a0 2024-09-12T02:12:49.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.514+0000 7fead2800640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7feab80a2c00 0x7feab80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:49.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.515+0000 7fead2800640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7feab80a2c00 0x7feab80a50c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feac400f7d0 tx=0x7feac4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:49.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.518+0000 7feacb400640 1 -- 172.21.15.110:0/4272309361 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feabc0051d0 con 0x7fead41049a0 2024-09-12T02:12:49.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.711+0000 7fead9400640 1 -- 172.21.15.110:0/4272309361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fead41a74b0 con 0x7fead41049a0 2024-09-12T02:12:49.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.711+0000 7feacb400640 1 -- 172.21.15.110:0/4272309361 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v95) ==== 81+0+601 (secure 0 0 0) 0x7feabc09bdf0 con 0x7fead41049a0 2024-09-12T02:12:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3490929121 2024-09-13T02:04:45.356605+0000 2024-09-12T02:12:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/2826731707 2024-09-13T02:04:45.356605+0000 2024-09-12T02:12:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/2413734786 2024-09-13T02:04:45.356605+0000 2024-09-12T02:12:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/3137576010 2024-09-13T02:04:45.356605+0000 2024-09-12T02:12:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/3137576010 2024-09-13T02:04:45.356605+0000 2024-09-12T02:12:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/3368055532 2024-09-13T02:04:17.987172+0000 2024-09-12T02:12:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/667674244 2024-09-13T02:04:17.987172+0000 2024-09-12T02:12:49.712 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/3368055532 2024-09-13T02:04:17.987172+0000 2024-09-12T02:12:49.713 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3644360562 2024-09-13T02:04:17.987172+0000 2024-09-12T02:12:49.713 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3947837481 2024-09-13T02:04:17.987172+0000 2024-09-12T02:12:49.713 INFO:teuthology.orchestra.run.smithi110.stderr:listed 10 entries 2024-09-12T02:12:49.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.713+0000 7fead9400640 1 -- 172.21.15.110:0/4272309361 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7feab80a2c00 msgr2=0x7feab80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:49.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.713+0000 7fead9400640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7feab80a2c00 0x7feab80a50c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feac400f7d0 tx=0x7feac4009500 comp rx=0 tx=0).stop 2024-09-12T02:12:49.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.713+0000 7fead9400640 1 -- 172.21.15.110:0/4272309361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead41049a0 msgr2=0x7fead419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:49.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.713+0000 7fead9400640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead41049a0 0x7fead419ab40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7feabc00e9f0 tx=0x7feabc00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:12:49.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.714+0000 7fead9400640 1 -- 172.21.15.110:0/4272309361 shutdown_connections 2024-09-12T02:12:49.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.714+0000 7fead9400640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7feab80a2c00 0x7feab80a50c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:49.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.714+0000 7fead9400640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fead4109120 0x7fead419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:49.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.714+0000 7fead9400640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead41049a0 0x7fead419ab40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:49.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.714+0000 7fead9400640 1 --2- 172.21.15.110:0/4272309361 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fead4103ff0 0x7fead419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:49.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.714+0000 7fead9400640 1 -- 172.21.15.110:0/4272309361 >> 172.21.15.110:0/4272309361 conn(0x7fead40ffa90 msgr2=0x7fead4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:49.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.714+0000 7fead9400640 1 -- 172.21.15.110:0/4272309361 shutdown_connections 2024-09-12T02:12:49.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:49.714+0000 7fead9400640 1 -- 172.21.15.110:0/4272309361 wait complete. 2024-09-12T02:12:50.457 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi110.front.sepia.ceph.com... 2024-09-12T02:12:50.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:50.457 DEBUG:teuthology.orchestra.run.smithi110:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-12T02:12:50.512 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi110.stderr:ceph-fuse[75428]: fuse finished with error 0 and tester_r 0 2024-09-12T02:12:50.516 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T02:12:50.549 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T02:12:50.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:12:50.549 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-12T02:12:50.633 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:12:50.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:50 smithi110 ceph-mon[30548]: pgmap v327: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:50.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:50 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/4272309361' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:12:50.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:50 smithi115 ceph-mon[35351]: pgmap v327: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:50.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:50 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/4272309361' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:12:50.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:50 smithi136 ceph-mon[35814]: pgmap v327: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:50.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:50 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/4272309361' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:12:51.037 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:51.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.671+0000 7f6db2400640 1 -- 172.21.15.110:0/3179928454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac112a30 msgr2=0x7f6dac114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:51.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.671+0000 7f6db2400640 1 --2- 172.21.15.110:0/3179928454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac112a30 0x7f6dac114e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009ca0 tx=0x7f6da402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:12:51.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.671+0000 7f6db2400640 1 -- 172.21.15.110:0/3179928454 shutdown_connections 2024-09-12T02:12:51.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.671+0000 7f6db2400640 1 --2- 172.21.15.110:0/3179928454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac112a30 0x7f6dac114e20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:51.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.671+0000 7f6db2400640 1 --2- 172.21.15.110:0/3179928454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dac077040 0x7f6dac1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:51.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.671+0000 7f6db2400640 1 --2- 172.21.15.110:0/3179928454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac076720 0x7f6dac076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:51.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.671+0000 7f6db2400640 1 -- 172.21.15.110:0/3179928454 >> 172.21.15.110:0/3179928454 conn(0x7f6dac0ffa90 msgr2=0x7f6dac101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:51.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.671+0000 7f6db2400640 1 -- 172.21.15.110:0/3179928454 shutdown_connections 2024-09-12T02:12:51.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.671+0000 7f6db2400640 1 -- 172.21.15.110:0/3179928454 wait complete. 2024-09-12T02:12:51.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.672+0000 7f6db2400640 1 Processor -- start 2024-09-12T02:12:51.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.672+0000 7f6db2400640 1 -- start start 2024-09-12T02:12:51.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6db2400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dac076720 0x7f6dac1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:51.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6db2400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac077040 0x7f6dac1a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:51.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6db2400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac112a30 0x7f6dac19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:51.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6db2400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac118590 con 0x7f6dac077040 2024-09-12T02:12:51.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6db2400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac118410 con 0x7f6dac112a30 2024-09-12T02:12:51.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6db2400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac118710 con 0x7f6dac076720 2024-09-12T02:12:51.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6da2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac077040 0x7f6dac1a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:51.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6da2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac077040 0x7f6dac1a4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58796/0 (socket says 172.21.15.110:58796) 2024-09-12T02:12:51.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6da2a00640 1 -- 172.21.15.110:0/1616167515 learned_addr learned my addr 172.21.15.110:0/1616167515 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:51.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6dab400640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dac076720 0x7f6dac1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:51.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6dabe00640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac112a30 0x7f6dac19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:51.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6da2a00640 1 -- 172.21.15.110:0/1616167515 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dac076720 msgr2=0x7f6dac1a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:51.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6da2a00640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dac076720 0x7f6dac1a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:51.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6da2a00640 1 -- 172.21.15.110:0/1616167515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac112a30 msgr2=0x7f6dac19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:51.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6da2a00640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac112a30 0x7f6dac19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:51.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.673+0000 7f6da2a00640 1 -- 172.21.15.110:0/1616167515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac19f000 con 0x7f6dac077040 2024-09-12T02:12:51.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.674+0000 7f6da2a00640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac077040 0x7f6dac1a4c50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400e9f0 tx=0x7f6d9400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:51.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.674+0000 7f6da8c00640 1 -- 172.21.15.110:0/1616167515 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9400cd80 con 0x7f6dac077040 2024-09-12T02:12:51.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.674+0000 7f6da8c00640 1 -- 172.21.15.110:0/1616167515 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d94005500 con 0x7f6dac077040 2024-09-12T02:12:51.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.674+0000 7f6db2400640 1 -- 172.21.15.110:0/1616167515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dac19f2f0 con 0x7f6dac077040 2024-09-12T02:12:51.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.674+0000 7f6da8c00640 1 -- 172.21.15.110:0/1616167515 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94010690 con 0x7f6dac077040 2024-09-12T02:12:51.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.674+0000 7f6db2400640 1 -- 172.21.15.110:0/1616167515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dac1ab5e0 con 0x7f6dac077040 2024-09-12T02:12:51.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.675+0000 7f6db2400640 1 -- 172.21.15.110:0/1616167515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dac076b00 con 0x7f6dac077040 2024-09-12T02:12:51.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.678+0000 7f6da8c00640 1 -- 172.21.15.110:0/1616167515 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6d940046c0 con 0x7f6dac077040 2024-09-12T02:12:51.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.679+0000 7f6da8c00640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f6d900a2c00 0x7f6d900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:51.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.679+0000 7f6da8c00640 1 -- 172.21.15.110:0/1616167515 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f6d940cf780 con 0x7f6dac077040 2024-09-12T02:12:51.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.679+0000 7f6dab400640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f6d900a2c00 0x7f6d900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:51.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.680+0000 7f6dab400640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f6d900a2c00 0x7f6d900a50c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6dac19fa10 tx=0x7f6d9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:51.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.683+0000 7f6da8c00640 1 -- 172.21.15.110:0/1616167515 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d9409c3a0 con 0x7f6dac077040 2024-09-12T02:12:51.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.859+0000 7f6db2400640 1 -- 172.21.15.110:0/1616167515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6dac19fe00 con 0x7f6dac077040 2024-09-12T02:12:51.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.861+0000 7f6da8c00640 1 -- 172.21.15.110:0/1616167515 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24795 (secure 0 0 0) 0x7f6dac19fe00 con 0x7f6dac077040 2024-09-12T02:12:51.862 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:12:51.863 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":95,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:12:46.523937+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:12:08.596125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:12:11.312393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:12:21.215161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:12:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.864+0000 7f6db2400640 1 -- 172.21.15.110:0/1616167515 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f6d900a2c00 msgr2=0x7f6d900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.864+0000 7f6db2400640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f6d900a2c00 0x7f6d900a50c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6dac19fa10 tx=0x7f6d9c005f90 comp rx=0 tx=0).stop 2024-09-12T02:12:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.864+0000 7f6db2400640 1 -- 172.21.15.110:0/1616167515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac077040 msgr2=0x7f6dac1a4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.864+0000 7f6db2400640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac077040 0x7f6dac1a4c50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400e9f0 tx=0x7f6d9400edf0 comp rx=0 tx=0).stop 2024-09-12T02:12:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.864+0000 7f6db2400640 1 -- 172.21.15.110:0/1616167515 shutdown_connections 2024-09-12T02:12:51.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.864+0000 7f6db2400640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f6d900a2c00 0x7f6d900a50c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.864+0000 7f6db2400640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dac112a30 0x7f6dac19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.864+0000 7f6db2400640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dac077040 0x7f6dac1a4c50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.864+0000 7f6db2400640 1 --2- 172.21.15.110:0/1616167515 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dac076720 0x7f6dac1a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.864+0000 7f6db2400640 1 -- 172.21.15.110:0/1616167515 >> 172.21.15.110:0/1616167515 conn(0x7f6dac0ffa90 msgr2=0x7f6dac101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.864+0000 7f6db2400640 1 -- 172.21.15.110:0/1616167515 shutdown_connections 2024-09-12T02:12:51.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:51.864+0000 7f6db2400640 1 -- 172.21.15.110:0/1616167515 wait complete. 2024-09-12T02:12:52.632 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:12:52.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:52 smithi115 ceph-mon[35351]: pgmap v328: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:52.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:52 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1616167515' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:52 smithi136 ceph-mon[35814]: pgmap v328: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:52 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1616167515' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:52 smithi110 ceph-mon[30548]: pgmap v328: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:52 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1616167515' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:53.040 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:53.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.643+0000 7ff794c00640 1 -- 172.21.15.110:0/2436668782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff790112870 msgr2=0x7ff790114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:53.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.643+0000 7ff794c00640 1 --2- 172.21.15.110:0/2436668782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff790112870 0x7ff790114c60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff788009ca0 tx=0x7ff78802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:12:53.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.643+0000 7ff794c00640 1 -- 172.21.15.110:0/2436668782 shutdown_connections 2024-09-12T02:12:53.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.643+0000 7ff794c00640 1 --2- 172.21.15.110:0/2436668782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff790112870 0x7ff790114c60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:53.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.643+0000 7ff794c00640 1 --2- 172.21.15.110:0/2436668782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff790077040 0x7ff790112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:53.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.643+0000 7ff794c00640 1 --2- 172.21.15.110:0/2436668782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff790076720 0x7ff790076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:53.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.643+0000 7ff794c00640 1 -- 172.21.15.110:0/2436668782 >> 172.21.15.110:0/2436668782 conn(0x7ff7900ff8d0 msgr2=0x7ff790101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:53.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.643+0000 7ff794c00640 1 -- 172.21.15.110:0/2436668782 shutdown_connections 2024-09-12T02:12:53.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.643+0000 7ff794c00640 1 -- 172.21.15.110:0/2436668782 wait complete. 2024-09-12T02:12:53.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.644+0000 7ff794c00640 1 Processor -- start 2024-09-12T02:12:53.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.644+0000 7ff794c00640 1 -- start start 2024-09-12T02:12:53.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.644+0000 7ff794c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff790076720 0x7ff7901a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:53.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.644+0000 7ff794c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff790077040 0x7ff7901a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:53.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.644+0000 7ff794c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff790112870 0x7ff79019e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:53.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff794c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff790118410 con 0x7ff790077040 2024-09-12T02:12:53.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff794c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff790118290 con 0x7ff790112870 2024-09-12T02:12:53.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff794c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff790118590 con 0x7ff790076720 2024-09-12T02:12:53.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff78ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff790077040 0x7ff7901a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:53.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff78ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff790077040 0x7ff7901a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58822/0 (socket says 172.21.15.110:58822) 2024-09-12T02:12:53.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff78ea00640 1 -- 172.21.15.110:0/82517742 learned_addr learned my addr 172.21.15.110:0/82517742 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:53.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff78f400640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff790076720 0x7ff7901a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:53.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff78fe00640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff790112870 0x7ff79019e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:53.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff78ea00640 1 -- 172.21.15.110:0/82517742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff790076720 msgr2=0x7ff7901a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:53.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff78ea00640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff790076720 0x7ff7901a45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:53.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff78ea00640 1 -- 172.21.15.110:0/82517742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff790112870 msgr2=0x7ff79019e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:53.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff78ea00640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff790112870 0x7ff79019e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:53.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.645+0000 7ff78ea00640 1 -- 172.21.15.110:0/82517742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79019ef30 con 0x7ff790077040 2024-09-12T02:12:53.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.646+0000 7ff78ea00640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff790077040 0x7ff7901a4b30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00e9f0 tx=0x7ff77c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:53.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.646+0000 7ff787e00640 1 -- 172.21.15.110:0/82517742 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c00cd80 con 0x7ff790077040 2024-09-12T02:12:53.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.646+0000 7ff787e00640 1 -- 172.21.15.110:0/82517742 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff77c010910 con 0x7ff790077040 2024-09-12T02:12:53.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.646+0000 7ff787e00640 1 -- 172.21.15.110:0/82517742 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c018990 con 0x7ff790077040 2024-09-12T02:12:53.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.646+0000 7ff794c00640 1 -- 172.21.15.110:0/82517742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79019f220 con 0x7ff790077040 2024-09-12T02:12:53.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.646+0000 7ff794c00640 1 -- 172.21.15.110:0/82517742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7901ab3a0 con 0x7ff790077040 2024-09-12T02:12:53.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.647+0000 7ff794c00640 1 -- 172.21.15.110:0/82517742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff790077e60 con 0x7ff790077040 2024-09-12T02:12:53.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.649+0000 7ff787e00640 1 -- 172.21.15.110:0/82517742 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7ff77c010ac0 con 0x7ff790077040 2024-09-12T02:12:53.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.650+0000 7ff787e00640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff7740a2c00 0x7ff7740a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:53.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.651+0000 7ff787e00640 1 -- 172.21.15.110:0/82517742 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7ff77c0cf660 con 0x7ff790077040 2024-09-12T02:12:53.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.651+0000 7ff78f400640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff7740a2c00 0x7ff7740a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:53.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.651+0000 7ff78f400640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff7740a2c00 0x7ff7740a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff780009bd0 tx=0x7ff780005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:53.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.654+0000 7ff787e00640 1 -- 172.21.15.110:0/82517742 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff77c09c220 con 0x7ff790077040 2024-09-12T02:12:53.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.834+0000 7ff794c00640 1 -- 172.21.15.110:0/82517742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7901ab640 con 0x7ff790077040 2024-09-12T02:12:53.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.835+0000 7ff787e00640 1 -- 172.21.15.110:0/82517742 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24795 (secure 0 0 0) 0x7ff77c09bb20 con 0x7ff790077040 2024-09-12T02:12:53.837 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:12:53.837 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":95,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:12:46.523937+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:12:08.596125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:12:11.312393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:12:21.215161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:12:53.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.838+0000 7ff794c00640 1 -- 172.21.15.110:0/82517742 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff7740a2c00 msgr2=0x7ff7740a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:53.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.838+0000 7ff794c00640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff7740a2c00 0x7ff7740a50c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff780009bd0 tx=0x7ff780005f90 comp rx=0 tx=0).stop 2024-09-12T02:12:53.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.838+0000 7ff794c00640 1 -- 172.21.15.110:0/82517742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff790077040 msgr2=0x7ff7901a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:53.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.838+0000 7ff794c00640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff790077040 0x7ff7901a4b30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00e9f0 tx=0x7ff77c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:12:53.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.838+0000 7ff794c00640 1 -- 172.21.15.110:0/82517742 shutdown_connections 2024-09-12T02:12:53.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.838+0000 7ff794c00640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7ff7740a2c00 0x7ff7740a50c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:53.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.838+0000 7ff794c00640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff790112870 0x7ff79019e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:53.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.838+0000 7ff794c00640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff790077040 0x7ff7901a4b30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:53.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.838+0000 7ff794c00640 1 --2- 172.21.15.110:0/82517742 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff790076720 0x7ff7901a45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:53.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.838+0000 7ff794c00640 1 -- 172.21.15.110:0/82517742 >> 172.21.15.110:0/82517742 conn(0x7ff7900ff8d0 msgr2=0x7ff790101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:53.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.838+0000 7ff794c00640 1 -- 172.21.15.110:0/82517742 shutdown_connections 2024-09-12T02:12:53.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:53.838+0000 7ff794c00640 1 -- 172.21.15.110:0/82517742 wait complete. 2024-09-12T02:12:54.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:54 smithi110 ceph-mon[30548]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:54.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:54 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/82517742' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:54.762 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-12T02:12:54.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:54 smithi136 ceph-mon[35814]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:54.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:54 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/82517742' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:55.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:54 smithi115 ceph-mon[35351]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:55.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:54 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/82517742' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:12:55.130 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:55.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.712+0000 7f2e82000640 1 -- 172.21.15.110:0/4125011473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c1049c0 msgr2=0x7f2e7c108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:55.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.712+0000 7f2e82000640 1 --2- 172.21.15.110:0/4125011473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c1049c0 0x7f2e7c108a10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009900 tx=0x7f2e6402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:12:55.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.712+0000 7f2e82000640 1 -- 172.21.15.110:0/4125011473 shutdown_connections 2024-09-12T02:12:55.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.712+0000 7f2e82000640 1 --2- 172.21.15.110:0/4125011473 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e7c109140 0x7f2e7c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:55.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.712+0000 7f2e82000640 1 --2- 172.21.15.110:0/4125011473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c1049c0 0x7f2e7c108a10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:55.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.712+0000 7f2e82000640 1 --2- 172.21.15.110:0/4125011473 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e7c104010 0x7f2e7c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.712+0000 7f2e82000640 1 -- 172.21.15.110:0/4125011473 >> 172.21.15.110:0/4125011473 conn(0x7f2e7c0ffa50 msgr2=0x7f2e7c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.712+0000 7f2e82000640 1 -- 172.21.15.110:0/4125011473 shutdown_connections 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.712+0000 7f2e82000640 1 -- 172.21.15.110:0/4125011473 wait complete. 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.713+0000 7f2e82000640 1 Processor -- start 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.713+0000 7f2e82000640 1 -- start start 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.713+0000 7f2e82000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e7c104010 0x7f2e7c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.713+0000 7f2e82000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e7c1049c0 0x7f2e7c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.713+0000 7f2e82000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c109140 0x7f2e7c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.713+0000 7f2e82000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c114190 con 0x7f2e7c109140 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.713+0000 7f2e82000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c114010 con 0x7f2e7c1049c0 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.713+0000 7f2e82000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2e7c114310 con 0x7f2e7c104010 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.713+0000 7f2e7be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c109140 0x7f2e7c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:55.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.714+0000 7f2e7be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c109140 0x7f2e7c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58834/0 (socket says 172.21.15.110:58834) 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.714+0000 7f2e73e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e7c1049c0 0x7f2e7c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.714+0000 7f2e7be00640 1 -- 172.21.15.110:0/1820116171 learned_addr learned my addr 172.21.15.110:0/1820116171 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.714+0000 7f2e7b400640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e7c104010 0x7f2e7c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.714+0000 7f2e7b400640 1 -- 172.21.15.110:0/1820116171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e7c1049c0 msgr2=0x7f2e7c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.714+0000 7f2e7b400640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e7c1049c0 0x7f2e7c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.714+0000 7f2e7b400640 1 -- 172.21.15.110:0/1820116171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c109140 msgr2=0x7f2e7c19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.714+0000 7f2e7b400640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c109140 0x7f2e7c19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.714+0000 7f2e7b400640 1 -- 172.21.15.110:0/1820116171 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e7c19f620 con 0x7f2e7c104010 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.714+0000 7f2e7be00640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c109140 0x7f2e7c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.714+0000 7f2e7b400640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e7c104010 0x7f2e7c19a670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00e9f0 tx=0x7f2e6c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.714+0000 7f2e78c00640 1 -- 172.21.15.110:0/1820116171 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00ccc0 con 0x7f2e7c104010 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.715+0000 7f2e78c00640 1 -- 172.21.15.110:0/1820116171 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e6c010910 con 0x7f2e7c104010 2024-09-12T02:12:55.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.715+0000 7f2e82000640 1 -- 172.21.15.110:0/1820116171 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e7c19f910 con 0x7f2e7c104010 2024-09-12T02:12:55.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.715+0000 7f2e78c00640 1 -- 172.21.15.110:0/1820116171 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c018960 con 0x7f2e7c104010 2024-09-12T02:12:55.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.715+0000 7f2e82000640 1 -- 172.21.15.110:0/1820116171 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7c1a71f0 con 0x7f2e7c104010 2024-09-12T02:12:55.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.716+0000 7f2e82000640 1 -- 172.21.15.110:0/1820116171 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e7c1043f0 con 0x7f2e7c104010 2024-09-12T02:12:55.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.718+0000 7f2e78c00640 1 -- 172.21.15.110:0/1820116171 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2e6c010ac0 con 0x7f2e7c104010 2024-09-12T02:12:55.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.719+0000 7f2e78c00640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e600a2b80 0x7f2e600a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:55.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.719+0000 7f2e78c00640 1 -- 172.21.15.110:0/1820116171 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f2e6c0cfaf0 con 0x7f2e7c104010 2024-09-12T02:12:55.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.719+0000 7f2e73e00640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e600a2b80 0x7f2e600a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:55.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.720+0000 7f2e73e00640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e600a2b80 0x7f2e600a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2e64000c00 tx=0x7f2e64005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:55.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.721+0000 7f2e78c00640 1 -- 172.21.15.110:0/1820116171 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e6c09c060 con 0x7f2e7c104010 2024-09-12T02:12:55.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:55.931+0000 7f2e82000640 1 -- 172.21.15.110:0/1820116171 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2e7c19b9d0 con 0x7f2e7c104010 2024-09-12T02:12:56.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.555+0000 7f2e78c00640 1 -- 172.21.15.110:0/1820116171 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f2e7c19b9d0 con 0x7f2e7c104010 2024-09-12T02:12:56.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.558+0000 7f2e82000640 1 -- 172.21.15.110:0/1820116171 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e600a2b80 msgr2=0x7f2e600a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:56.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.558+0000 7f2e82000640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e600a2b80 0x7f2e600a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2e64000c00 tx=0x7f2e64005b50 comp rx=0 tx=0).stop 2024-09-12T02:12:56.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.558+0000 7f2e82000640 1 -- 172.21.15.110:0/1820116171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e7c104010 msgr2=0x7f2e7c19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.558+0000 7f2e82000640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e7c104010 0x7f2e7c19a670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00e9f0 tx=0x7f2e6c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:12:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.558+0000 7f2e82000640 1 -- 172.21.15.110:0/1820116171 shutdown_connections 2024-09-12T02:12:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.558+0000 7f2e82000640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e600a2b80 0x7f2e600a5040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.558+0000 7f2e82000640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c109140 0x7f2e7c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.558+0000 7f2e82000640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e7c1049c0 0x7f2e7c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.558+0000 7f2e82000640 1 --2- 172.21.15.110:0/1820116171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e7c104010 0x7f2e7c19a670 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.558+0000 7f2e82000640 1 -- 172.21.15.110:0/1820116171 >> 172.21.15.110:0/1820116171 conn(0x7f2e7c0ffa50 msgr2=0x7f2e7c100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.558+0000 7f2e82000640 1 -- 172.21.15.110:0/1820116171 shutdown_connections 2024-09-12T02:12:56.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:56.558+0000 7f2e82000640 1 -- 172.21.15.110:0/1820116171 wait complete. 2024-09-12T02:12:56.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:56 smithi136 ceph-mon[35814]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 515 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:56.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:56 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1820116171' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:12:56.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:56 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:12:56.922 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:56 smithi110 ceph-mon[30548]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 515 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:56.922 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:56 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1820116171' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:12:56.922 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:56 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:12:57.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:56 smithi115 ceph-mon[35351]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 515 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:57.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:56 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1820116171' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:12:57.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:56 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-12T02:12:57.357 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-12T02:12:57.358 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-12T02:12:57.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:57 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:12:57.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:57 smithi110 ceph-mon[30548]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:12:57.733 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:12:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:57 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:12:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:57 smithi136 ceph-mon[35814]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:12:58.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:57 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-12T02:12:58.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:57 smithi115 ceph-mon[35351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:12:58.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.344+0000 7f2613200640 1 -- 172.21.15.110:0/154475860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f260c101de0 msgr2=0x7f260c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:58.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.344+0000 7f2613200640 1 --2- 172.21.15.110:0/154475860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f260c101de0 0x7f260c1021c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009900 tx=0x7f25fc02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:12:58.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.345+0000 7f2613200640 1 -- 172.21.15.110:0/154475860 shutdown_connections 2024-09-12T02:12:58.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.345+0000 7f2613200640 1 --2- 172.21.15.110:0/154475860 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f260c106f10 0x7f260c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:58.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.345+0000 7f2613200640 1 --2- 172.21.15.110:0/154475860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c102790 0x7f260c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:58.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.345+0000 7f2613200640 1 --2- 172.21.15.110:0/154475860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f260c101de0 0x7f260c1021c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:58.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.345+0000 7f2613200640 1 -- 172.21.15.110:0/154475860 >> 172.21.15.110:0/154475860 conn(0x7f260c0fd8c0 msgr2=0x7f260c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:58.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.345+0000 7f2613200640 1 -- 172.21.15.110:0/154475860 shutdown_connections 2024-09-12T02:12:58.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.345+0000 7f2613200640 1 -- 172.21.15.110:0/154475860 wait complete. 2024-09-12T02:12:58.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.346+0000 7f2613200640 1 Processor -- start 2024-09-12T02:12:58.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.346+0000 7f2613200640 1 -- start start 2024-09-12T02:12:58.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.346+0000 7f2613200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f260c101de0 0x7f260c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:58.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.346+0000 7f2613200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c102790 0x7f260c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:58.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.346+0000 7f2613200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f260c106f10 0x7f260c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:58.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.346+0000 7f2613200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f260c111f80 con 0x7f260c101de0 2024-09-12T02:12:58.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.346+0000 7f2613200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f260c111e00 con 0x7f260c102790 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.346+0000 7f2613200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f260c112100 con 0x7f260c106f10 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.346+0000 7f2611200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f260c106f10 0x7f260c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.346+0000 7f2603400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c102790 0x7f260c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.346+0000 7f260be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f260c101de0 0x7f260c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.347+0000 7f2611200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f260c106f10 0x7f260c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:44382/0 (socket says 172.21.15.110:44382) 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.347+0000 7f2603400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c102790 0x7f260c19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:36104/0 (socket says 172.21.15.110:36104) 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.347+0000 7f2611200640 1 -- 172.21.15.110:0/929909629 learned_addr learned my addr 172.21.15.110:0/929909629 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.347+0000 7f2611200640 1 -- 172.21.15.110:0/929909629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c102790 msgr2=0x7f260c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.347+0000 7f2611200640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c102790 0x7f260c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.347+0000 7f2611200640 1 -- 172.21.15.110:0/929909629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f260c101de0 msgr2=0x7f260c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.347+0000 7f2611200640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f260c101de0 0x7f260c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.347+0000 7f2611200640 1 -- 172.21.15.110:0/929909629 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260c19f620 con 0x7f260c106f10 2024-09-12T02:12:58.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.347+0000 7f260be00640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f260c101de0 0x7f260c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:58.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.347+0000 7f2603400640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c102790 0x7f260c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:12:58.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.347+0000 7f2611200640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f260c106f10 0x7f260c19ef40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2604009fd0 tx=0x7f260400b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:58.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.348+0000 7f2609600640 1 -- 172.21.15.110:0/929909629 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2604017070 con 0x7f260c106f10 2024-09-12T02:12:58.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.348+0000 7f2613200640 1 -- 172.21.15.110:0/929909629 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260c19f910 con 0x7f260c106f10 2024-09-12T02:12:58.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.348+0000 7f2609600640 1 -- 172.21.15.110:0/929909629 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2604003e50 con 0x7f260c106f10 2024-09-12T02:12:58.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.348+0000 7f2609600640 1 -- 172.21.15.110:0/929909629 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26040106c0 con 0x7f260c106f10 2024-09-12T02:12:58.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.348+0000 7f2613200640 1 -- 172.21.15.110:0/929909629 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f260c1a71f0 con 0x7f260c106f10 2024-09-12T02:12:58.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.349+0000 7f2613200640 1 -- 172.21.15.110:0/929909629 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f260c1021c0 con 0x7f260c106f10 2024-09-12T02:12:58.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.351+0000 7f2609600640 1 -- 172.21.15.110:0/929909629 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2604003970 con 0x7f260c106f10 2024-09-12T02:12:58.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.352+0000 7f2609600640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f25f00a2c00 0x7f25f00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:12:58.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.352+0000 7f2609600640 1 -- 172.21.15.110:0/929909629 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f26040cef90 con 0x7f260c106f10 2024-09-12T02:12:58.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.352+0000 7f260be00640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f25f00a2c00 0x7f25f00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:12:58.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.353+0000 7f260be00640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f25f00a2c00 0x7f25f00a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25fc000c00 tx=0x7f25fc031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:12:58.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.354+0000 7f2609600640 1 -- 172.21.15.110:0/929909629 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f260409b580 con 0x7f260c106f10 2024-09-12T02:12:58.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:58.565+0000 7f2613200640 1 -- 172.21.15.110:0/929909629 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f260c1a74d0 con 0x7f260c106f10 2024-09-12T02:12:58.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:58 smithi136 ceph-mon[35814]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 468 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:58 smithi110 ceph-mon[30548]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 468 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:58.945 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:58 smithi115 ceph-mon[35351]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 468 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:12:59.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.569+0000 7f2609600640 1 -- 172.21.15.110:0/929909629 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f260409f880 con 0x7f260c106f10 2024-09-12T02:12:59.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.573+0000 7f2613200640 1 -- 172.21.15.110:0/929909629 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f25f00a2c00 msgr2=0x7f25f00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:59.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.573+0000 7f2613200640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f25f00a2c00 0x7f25f00a50c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f25fc000c00 tx=0x7f25fc031510 comp rx=0 tx=0).stop 2024-09-12T02:12:59.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.573+0000 7f2613200640 1 -- 172.21.15.110:0/929909629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f260c106f10 msgr2=0x7f260c19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:12:59.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.573+0000 7f2613200640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f260c106f10 0x7f260c19ef40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2604009fd0 tx=0x7f260400b260 comp rx=0 tx=0).stop 2024-09-12T02:12:59.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.573+0000 7f2613200640 1 -- 172.21.15.110:0/929909629 shutdown_connections 2024-09-12T02:12:59.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.573+0000 7f2613200640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f25f00a2c00 0x7f25f00a50c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:59.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.573+0000 7f2613200640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f260c106f10 0x7f260c19ef40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:59.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.573+0000 7f2613200640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f260c102790 0x7f260c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:59.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.573+0000 7f2613200640 1 --2- 172.21.15.110:0/929909629 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f260c101de0 0x7f260c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:12:59.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.573+0000 7f2613200640 1 -- 172.21.15.110:0/929909629 >> 172.21.15.110:0/929909629 conn(0x7f260c0fd8c0 msgr2=0x7f260c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:12:59.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.573+0000 7f2613200640 1 -- 172.21.15.110:0/929909629 shutdown_connections 2024-09-12T02:12:59.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:12:59.573+0000 7f2613200640 1 -- 172.21.15.110:0/929909629 wait complete. 2024-09-12T02:12:59.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:59 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/929909629' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T02:12:59.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:12:59 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T02:12:59.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:59 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/929909629' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T02:12:59.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:12:59 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T02:13:00.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:59 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/929909629' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T02:13:00.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:12:59 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-12T02:13:00.397 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-12T02:13:00.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:00 smithi110 ceph-mon[30548]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:13:00.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:00 smithi110 ceph-mon[30548]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:13:00.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:00 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T02:13:00.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:00 smithi110 ceph-mon[30548]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:13:00.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:00 smithi110 ceph-mon[30548]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:13:00.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:00 smithi110 ceph-mon[30548]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-12T02:13:00.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:00 smithi110 ceph-mon[30548]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-12T02:13:00.776 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:00 smithi136 ceph-mon[35814]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:13:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:00 smithi136 ceph-mon[35814]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:13:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:00 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T02:13:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:00 smithi136 ceph-mon[35814]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:13:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:00 smithi136 ceph-mon[35814]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:13:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:00 smithi136 ceph-mon[35814]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-12T02:13:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:00 smithi136 ceph-mon[35814]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-12T02:13:01.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:00 smithi115 ceph-mon[35351]: pgmap v332: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-12T02:13:01.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:00 smithi115 ceph-mon[35351]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T02:13:01.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:00 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-12T02:13:01.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:00 smithi115 ceph-mon[35351]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-12T02:13:01.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:00 smithi115 ceph-mon[35351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-12T02:13:01.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:00 smithi115 ceph-mon[35351]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-12T02:13:01.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:00 smithi115 ceph-mon[35351]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-12T02:13:01.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.407+0000 7f1297e00640 1 -- 172.21.15.110:0/999641604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f129010e3c0 msgr2=0x7f1290110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:01.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.407+0000 7f1297e00640 1 --2- 172.21.15.110:0/999641604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f129010e3c0 0x7f1290110810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1288009be0 tx=0x7f128802a750 comp rx=0 tx=0).stop 2024-09-12T02:13:01.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.407+0000 7f1297e00640 1 -- 172.21.15.110:0/999641604 shutdown_connections 2024-09-12T02:13:01.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.407+0000 7f1297e00640 1 --2- 172.21.15.110:0/999641604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f129010e3c0 0x7f1290110810 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:01.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.407+0000 7f1297e00640 1 --2- 172.21.15.110:0/999641604 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1290074f40 0x7f129010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:01.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.407+0000 7f1297e00640 1 --2- 172.21.15.110:0/999641604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1290074620 0x7f1290074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:01.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.407+0000 7f1297e00640 1 -- 172.21.15.110:0/999641604 >> 172.21.15.110:0/999641604 conn(0x7f12900fd8c0 msgr2=0x7f12900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:01.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.407+0000 7f1297e00640 1 -- 172.21.15.110:0/999641604 shutdown_connections 2024-09-12T02:13:01.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.407+0000 7f1297e00640 1 -- 172.21.15.110:0/999641604 wait complete. 2024-09-12T02:13:01.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.408+0000 7f1297e00640 1 Processor -- start 2024-09-12T02:13:01.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.408+0000 7f1297e00640 1 -- start start 2024-09-12T02:13:01.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.408+0000 7f1297e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1290074620 0x7f129019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:01.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.408+0000 7f1297e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1290074f40 0x7f129019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:01.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.408+0000 7f1297e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f129010e3c0 0x7f129019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:01.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.408+0000 7f1297e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1290114160 con 0x7f129010e3c0 2024-09-12T02:13:01.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.408+0000 7f1297e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1290113fe0 con 0x7f1290074620 2024-09-12T02:13:01.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.408+0000 7f1297e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f12901142e0 con 0x7f1290074f40 2024-09-12T02:13:01.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.408+0000 7f1295400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1290074620 0x7f129019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:01.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.408+0000 7f1295400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1290074620 0x7f129019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:48022/0 (socket says 172.21.15.110:48022) 2024-09-12T02:13:01.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.409+0000 7f1295400640 1 -- 172.21.15.110:0/1629444395 learned_addr learned my addr 172.21.15.110:0/1629444395 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:01.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.409+0000 7f1294a00640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1290074f40 0x7f129019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:01.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.409+0000 7f1295e00640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f129010e3c0 0x7f129019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:01.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.409+0000 7f1295400640 1 -- 172.21.15.110:0/1629444395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1290074f40 msgr2=0x7f129019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:01.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.409+0000 7f1295400640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1290074f40 0x7f129019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:01.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.409+0000 7f1295400640 1 -- 172.21.15.110:0/1629444395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f129010e3c0 msgr2=0x7f129019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:01.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.409+0000 7f1295400640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f129010e3c0 0x7f129019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:01.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.409+0000 7f1295400640 1 -- 172.21.15.110:0/1629444395 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129019f5e0 con 0x7f1290074620 2024-09-12T02:13:01.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.409+0000 7f1295400640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1290074620 0x7f129019a630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f128400e9f0 tx=0x7f128400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:01.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.409+0000 7f128e000640 1 -- 172.21.15.110:0/1629444395 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128400ccc0 con 0x7f1290074620 2024-09-12T02:13:01.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.410+0000 7f1297e00640 1 -- 172.21.15.110:0/1629444395 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f129019f8d0 con 0x7f1290074620 2024-09-12T02:13:01.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.410+0000 7f128e000640 1 -- 172.21.15.110:0/1629444395 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1284005500 con 0x7f1290074620 2024-09-12T02:13:01.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.410+0000 7f128e000640 1 -- 172.21.15.110:0/1629444395 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284010690 con 0x7f1290074620 2024-09-12T02:13:01.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.410+0000 7f1297e00640 1 -- 172.21.15.110:0/1629444395 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12901a71b0 con 0x7f1290074620 2024-09-12T02:13:01.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.411+0000 7f1297e00640 1 -- 172.21.15.110:0/1629444395 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1290074a00 con 0x7f1290074620 2024-09-12T02:13:01.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.413+0000 7f128e000640 1 -- 172.21.15.110:0/1629444395 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f12840046c0 con 0x7f1290074620 2024-09-12T02:13:01.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.414+0000 7f128e000640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f12780a2c00 0x7f12780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:01.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.414+0000 7f128e000640 1 -- 172.21.15.110:0/1629444395 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f12840cf810 con 0x7f1290074620 2024-09-12T02:13:01.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.414+0000 7f1294a00640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f12780a2c00 0x7f12780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:01.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.415+0000 7f1294a00640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f12780a2c00 0x7f12780a50c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f127c0095f0 tx=0x7f127c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:01.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.416+0000 7f128e000640 1 -- 172.21.15.110:0/1629444395 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f12840541b0 con 0x7f1290074620 2024-09-12T02:13:01.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:01.637+0000 7f1297e00640 1 -- 172.21.15.110:0/1629444395 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f129019b990 con 0x7f1290074620 2024-09-12T02:13:01.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:01 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] up:active 2024-09-12T02:13:01.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:01 smithi136 ceph-mon[35814]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:13:01.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:01 smithi136 ceph-mon[35814]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:13:01.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:01 smithi136 ceph-mon[35814]: Cluster is now healthy 2024-09-12T02:13:01.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:01 smithi136 ceph-mon[35814]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-12T02:13:01.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:01 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-09-12T02:13:01.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:01 smithi136 ceph-mon[35814]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-12T02:13:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:01 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] up:active 2024-09-12T02:13:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:01 smithi110 ceph-mon[30548]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:13:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:01 smithi110 ceph-mon[30548]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:13:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:01 smithi110 ceph-mon[30548]: Cluster is now healthy 2024-09-12T02:13:01.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:01 smithi110 ceph-mon[30548]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-12T02:13:01.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:01 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-09-12T02:13:01.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:01 smithi110 ceph-mon[30548]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-12T02:13:02.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:01 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] up:active 2024-09-12T02:13:02.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:01 smithi115 ceph-mon[35351]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-12T02:13:02.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:01 smithi115 ceph-mon[35351]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T02:13:02.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:01 smithi115 ceph-mon[35351]: Cluster is now healthy 2024-09-12T02:13:02.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:01 smithi115 ceph-mon[35351]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-12T02:13:02.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:01 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:creating} 9 up:standby 2024-09-12T02:13:02.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:01 smithi115 ceph-mon[35351]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-12T02:13:02.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.593+0000 7f128e000640 1 -- 172.21.15.110:0/1629444395 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f129019b990 con 0x7f1290074620 2024-09-12T02:13:02.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.596+0000 7f1297e00640 1 -- 172.21.15.110:0/1629444395 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f12780a2c00 msgr2=0x7f12780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:02.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.596+0000 7f1297e00640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f12780a2c00 0x7f12780a50c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f127c0095f0 tx=0x7f127c005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:02.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.596+0000 7f1297e00640 1 -- 172.21.15.110:0/1629444395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1290074620 msgr2=0x7f129019a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:02.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.596+0000 7f1297e00640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1290074620 0x7f129019a630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f128400e9f0 tx=0x7f128400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:13:02.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.596+0000 7f1297e00640 1 -- 172.21.15.110:0/1629444395 shutdown_connections 2024-09-12T02:13:02.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.596+0000 7f1297e00640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f12780a2c00 0x7f12780a50c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:02.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.596+0000 7f1297e00640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f129010e3c0 0x7f129019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:02.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.596+0000 7f1297e00640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1290074f40 0x7f129019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:02.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.596+0000 7f1297e00640 1 --2- 172.21.15.110:0/1629444395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1290074620 0x7f129019a630 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:02.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.596+0000 7f1297e00640 1 -- 172.21.15.110:0/1629444395 >> 172.21.15.110:0/1629444395 conn(0x7f12900fd8c0 msgr2=0x7f12900fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:02.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.596+0000 7f1297e00640 1 -- 172.21.15.110:0/1629444395 shutdown_connections 2024-09-12T02:13:02.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:02.596+0000 7f1297e00640 1 -- 172.21.15.110:0/1629444395 wait complete. 2024-09-12T02:13:02.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:02 smithi136 ceph-mon[35814]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-12T02:13:02.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:02 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] up:active 2024-09-12T02:13:02.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:02 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-09-12T02:13:02.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:02 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1629444395' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:13:02.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:02 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:13:02.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:02 smithi110 ceph-mon[30548]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-12T02:13:02.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:02 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] up:active 2024-09-12T02:13:02.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:02 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-09-12T02:13:02.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:02 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1629444395' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:13:02.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:02 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:13:03.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:02 smithi115 ceph-mon[35351]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-12T02:13:03.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:02 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] up:active 2024-09-12T02:13:03.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:02 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-09-12T02:13:03.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:02 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1629444395' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:13:03.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:02 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-12T02:13:03.462 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-12T02:13:03.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:03 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:13:03.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:03 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-09-12T02:13:03.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:03 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:13:03.832 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:03.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:03 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:13:03.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:03 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-09-12T02:13:03.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:03 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:13:04.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:03 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-12T02:13:04.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:03 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 9 up:standby 2024-09-12T02:13:04.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:03 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:13:04.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.413+0000 7f892a000640 1 -- 172.21.15.110:0/145296865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924076720 msgr2=0x7f8924076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:04.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.413+0000 7f892a000640 1 --2- 172.21.15.110:0/145296865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924076720 0x7f8924076b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8914009900 tx=0x7f891402a410 comp rx=0 tx=0).stop 2024-09-12T02:13:04.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.413+0000 7f892a000640 1 -- 172.21.15.110:0/145296865 shutdown_connections 2024-09-12T02:13:04.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.413+0000 7f892a000640 1 --2- 172.21.15.110:0/145296865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8924112a30 0x7f8924114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:04.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.413+0000 7f892a000640 1 --2- 172.21.15.110:0/145296865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8924077040 0x7f89241124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:04.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.413+0000 7f892a000640 1 --2- 172.21.15.110:0/145296865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924076720 0x7f8924076b00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:04.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.413+0000 7f892a000640 1 -- 172.21.15.110:0/145296865 >> 172.21.15.110:0/145296865 conn(0x7f89240ffa90 msgr2=0x7f8924101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:04.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.413+0000 7f892a000640 1 -- 172.21.15.110:0/145296865 shutdown_connections 2024-09-12T02:13:04.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.413+0000 7f892a000640 1 -- 172.21.15.110:0/145296865 wait complete. 2024-09-12T02:13:04.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.415+0000 7f892a000640 1 Processor -- start 2024-09-12T02:13:04.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.415+0000 7f892a000640 1 -- start start 2024-09-12T02:13:04.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.415+0000 7f892a000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8924076720 0x7f89241a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:04.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.415+0000 7f892a000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924077040 0x7f89241a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:04.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.415+0000 7f892a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8924112a30 0x7f892419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:04.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.415+0000 7f892a000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f89241185c0 con 0x7f8924077040 2024-09-12T02:13:04.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.415+0000 7f892a000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8924118440 con 0x7f8924076720 2024-09-12T02:13:04.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.415+0000 7f892a000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8924118740 con 0x7f8924112a30 2024-09-12T02:13:04.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.416+0000 7f8923400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8924076720 0x7f89241a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:04.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.416+0000 7f8923400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8924076720 0x7f89241a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:48044/0 (socket says 172.21.15.110:48044) 2024-09-12T02:13:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.416+0000 7f8923400640 1 -- 172.21.15.110:0/1485640683 learned_addr learned my addr 172.21.15.110:0/1485640683 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.416+0000 7f8922a00640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924077040 0x7f89241a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.416+0000 7f8923e00640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8924112a30 0x7f892419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.416+0000 7f8923400640 1 -- 172.21.15.110:0/1485640683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8924112a30 msgr2=0x7f892419e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.416+0000 7f8923400640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8924112a30 0x7f892419e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.416+0000 7f8923400640 1 -- 172.21.15.110:0/1485640683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924077040 msgr2=0x7f89241a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.416+0000 7f8923400640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924077040 0x7f89241a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.416+0000 7f8923400640 1 -- 172.21.15.110:0/1485640683 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892419efe0 con 0x7f8924076720 2024-09-12T02:13:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.416+0000 7f8923400640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8924076720 0x7f89241a46f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8914006010 tx=0x7f8914004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.417+0000 7f891be00640 1 -- 172.21.15.110:0/1485640683 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891403f030 con 0x7f8924076720 2024-09-12T02:13:04.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.417+0000 7f892a000640 1 -- 172.21.15.110:0/1485640683 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892419f270 con 0x7f8924076720 2024-09-12T02:13:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.417+0000 7f891be00640 1 -- 172.21.15.110:0/1485640683 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8914004440 con 0x7f8924076720 2024-09-12T02:13:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.417+0000 7f891be00640 1 -- 172.21.15.110:0/1485640683 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914035070 con 0x7f8924076720 2024-09-12T02:13:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.417+0000 7f892a000640 1 -- 172.21.15.110:0/1485640683 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89241ab5c0 con 0x7f8924076720 2024-09-12T02:13:04.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.418+0000 7f892a000640 1 -- 172.21.15.110:0/1485640683 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8924076b00 con 0x7f8924076720 2024-09-12T02:13:04.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.420+0000 7f891be00640 1 -- 172.21.15.110:0/1485640683 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f8914042030 con 0x7f8924076720 2024-09-12T02:13:04.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.421+0000 7f891be00640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f89080a2c00 0x7f89080a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:04.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.421+0000 7f891be00640 1 -- 172.21.15.110:0/1485640683 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f89140ef9d0 con 0x7f8924076720 2024-09-12T02:13:04.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.421+0000 7f8922a00640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f89080a2c00 0x7f89080a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:04.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.422+0000 7f8922a00640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f89080a2c00 0x7f89080a50c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8924079390 tx=0x7f8910005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:04.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.423+0000 7f891be00640 1 -- 172.21.15.110:0/1485640683 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89140bc000 con 0x7f8924076720 2024-09-12T02:13:04.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:04.633+0000 7f892a000640 1 -- 172.21.15.110:0/1485640683 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f892419fde0 con 0x7f8924076720 2024-09-12T02:13:04.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:04 smithi115 ceph-mon[35351]: pgmap v334: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-12T02:13:04.795 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:13:04 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b[65150]: 2024-09-12T02:13:04.537+0000 7f3c599a6640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-12T02:13:04.795 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:13:04 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b[65150]: 2024-09-12T02:13:04.537+0000 7f3c599a6640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-12T02:13:04.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:04 smithi136 ceph-mon[35814]: pgmap v334: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-12T02:13:04.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:04 smithi110 ceph-mon[30548]: pgmap v334: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-12T02:13:05.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.608+0000 7f891be00640 1 -- 172.21.15.110:0/1485640683 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f892419fde0 con 0x7f8924076720 2024-09-12T02:13:05.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.611+0000 7f892a000640 1 -- 172.21.15.110:0/1485640683 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f89080a2c00 msgr2=0x7f89080a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:05.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.611+0000 7f892a000640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f89080a2c00 0x7f89080a50c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8924079390 tx=0x7f8910005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:05.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.611+0000 7f892a000640 1 -- 172.21.15.110:0/1485640683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8924076720 msgr2=0x7f89241a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:05.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.611+0000 7f892a000640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8924076720 0x7f89241a46f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8914006010 tx=0x7f8914004040 comp rx=0 tx=0).stop 2024-09-12T02:13:05.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.611+0000 7f892a000640 1 -- 172.21.15.110:0/1485640683 shutdown_connections 2024-09-12T02:13:05.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.611+0000 7f892a000640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f89080a2c00 0x7f89080a50c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:05.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.611+0000 7f892a000640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8924112a30 0x7f892419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:05.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.611+0000 7f892a000640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924077040 0x7f89241a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:05.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.611+0000 7f892a000640 1 --2- 172.21.15.110:0/1485640683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8924076720 0x7f89241a46f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:05.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.611+0000 7f892a000640 1 -- 172.21.15.110:0/1485640683 >> 172.21.15.110:0/1485640683 conn(0x7f89240ffa90 msgr2=0x7f8924101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:05.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.611+0000 7f892a000640 1 -- 172.21.15.110:0/1485640683 shutdown_connections 2024-09-12T02:13:05.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:05.611+0000 7f892a000640 1 -- 172.21.15.110:0/1485640683 wait complete. 2024-09-12T02:13:05.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:05 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1485640683' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:13:05.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:05 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:13:05.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:05 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1485640683' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:13:05.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:05 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:13:06.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:05 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1485640683' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:13:06.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:05 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-12T02:13:06.556 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-12T02:13:06.557 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-12T02:13:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:06 smithi136 ceph-mon[35814]: pgmap v335: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-12T02:13:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:06 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:13:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:06 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:13:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:06 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:13:06.930 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:06 smithi115 ceph-mon[35351]: pgmap v335: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-12T02:13:06.930 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:06 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:13:06.930 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:06 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:13:06.930 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:06 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:13:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:06 smithi110 ceph-mon[30548]: pgmap v335: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 1.5 KiB/s wr, 6 op/s 2024-09-12T02:13:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:06 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-12T02:13:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:06 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:13:06.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:06 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:13:07.588 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:08.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.253+0000 7f7e89200640 1 -- 172.21.15.110:0/2571970477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e84074620 msgr2=0x7f7e84074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:08.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.253+0000 7f7e89200640 1 --2- 172.21.15.110:0/2571970477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e84074620 0x7f7e84074a00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009860 tx=0x7f7e7402a3d0 comp rx=0 tx=0).stop 2024-09-12T02:13:08.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.253+0000 7f7e89200640 1 -- 172.21.15.110:0/2571970477 shutdown_connections 2024-09-12T02:13:08.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.253+0000 7f7e89200640 1 --2- 172.21.15.110:0/2571970477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e8410e3b0 0x7f7e84110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:08.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.253+0000 7f7e89200640 1 --2- 172.21.15.110:0/2571970477 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e84074f40 0x7f7e8410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:08.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.253+0000 7f7e89200640 1 --2- 172.21.15.110:0/2571970477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e84074620 0x7f7e84074a00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:08.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.253+0000 7f7e89200640 1 -- 172.21.15.110:0/2571970477 >> 172.21.15.110:0/2571970477 conn(0x7f7e840fd8b0 msgr2=0x7f7e840ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:08.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.253+0000 7f7e89200640 1 -- 172.21.15.110:0/2571970477 shutdown_connections 2024-09-12T02:13:08.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.253+0000 7f7e89200640 1 -- 172.21.15.110:0/2571970477 wait complete. 2024-09-12T02:13:08.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.254+0000 7f7e89200640 1 Processor -- start 2024-09-12T02:13:08.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.254+0000 7f7e89200640 1 -- start start 2024-09-12T02:13:08.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e89200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e84074620 0x7f7e8419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:08.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e89200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e84074f40 0x7f7e8419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:08.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e89200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e8410e3b0 0x7f7e8419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:08.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e89200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7e841141b0 con 0x7f7e8410e3b0 2024-09-12T02:13:08.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e89200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7e84114030 con 0x7f7e84074f40 2024-09-12T02:13:08.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e89200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7e84114330 con 0x7f7e84074620 2024-09-12T02:13:08.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e7be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e84074f40 0x7f7e8419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:08.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e7be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e84074f40 0x7f7e8419ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:48056/0 (socket says 172.21.15.110:48056) 2024-09-12T02:13:08.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e7be00640 1 -- 172.21.15.110:0/3040979370 learned_addr learned my addr 172.21.15.110:0/3040979370 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:08.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e81e00640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e84074620 0x7f7e8419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:08.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e82800640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e8410e3b0 0x7f7e8419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:08.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e7be00640 1 -- 172.21.15.110:0/3040979370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e84074620 msgr2=0x7f7e8419a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:08.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e7be00640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e84074620 0x7f7e8419a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:08.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e7be00640 1 -- 172.21.15.110:0/3040979370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e8410e3b0 msgr2=0x7f7e8419efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:08.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e7be00640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e8410e3b0 0x7f7e8419efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:08.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.255+0000 7f7e7be00640 1 -- 172.21.15.110:0/3040979370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8419f6c0 con 0x7f7e84074f40 2024-09-12T02:13:08.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.256+0000 7f7e7be00640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e84074f40 0x7f7e8419ac50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00e9f0 tx=0x7f7e6c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:08.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.256+0000 7f7e7aa00640 1 -- 172.21.15.110:0/3040979370 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00cd80 con 0x7f7e84074f40 2024-09-12T02:13:08.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.256+0000 7f7e89200640 1 -- 172.21.15.110:0/3040979370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8419f9b0 con 0x7f7e84074f40 2024-09-12T02:13:08.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.256+0000 7f7e7aa00640 1 -- 172.21.15.110:0/3040979370 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e6c005500 con 0x7f7e84074f40 2024-09-12T02:13:08.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.256+0000 7f7e7aa00640 1 -- 172.21.15.110:0/3040979370 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c010690 con 0x7f7e84074f40 2024-09-12T02:13:08.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.256+0000 7f7e89200640 1 -- 172.21.15.110:0/3040979370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e841a7290 con 0x7f7e84074f40 2024-09-12T02:13:08.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.257+0000 7f7e89200640 1 -- 172.21.15.110:0/3040979370 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e84074a00 con 0x7f7e84074f40 2024-09-12T02:13:08.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.259+0000 7f7e7aa00640 1 -- 172.21.15.110:0/3040979370 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f7e6c0046c0 con 0x7f7e84074f40 2024-09-12T02:13:08.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.261+0000 7f7e7aa00640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f7e680a2c00 0x7f7e680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:08.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.261+0000 7f7e7aa00640 1 -- 172.21.15.110:0/3040979370 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f7e6c0cf760 con 0x7f7e84074f40 2024-09-12T02:13:08.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.262+0000 7f7e81e00640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f7e680a2c00 0x7f7e680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:08.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.262+0000 7f7e81e00640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f7e680a2c00 0x7f7e680a50c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e7402a9c0 tx=0x7f7e74005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:08.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.264+0000 7f7e7aa00640 1 -- 172.21.15.110:0/3040979370 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7e6c09c320 con 0x7f7e84074f40 2024-09-12T02:13:08.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.487+0000 7f7e89200640 1 -- 172.21.15.110:0/3040979370 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7e84062630 con 0x7f7e680a2c00 2024-09-12T02:13:08.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.516+0000 7f7e7aa00640 1 -- 172.21.15.110:0/3040979370 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7e84062630 con 0x7f7e680a2c00 2024-09-12T02:13:08.517 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:13:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:13:08.496+0000 7fc637400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:13:08.517 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:13:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:13:08.496+0000 7fc637400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:13:08.517 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:13:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:13:08.496+0000 7fc637400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:13:08.518 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:13:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:13:08.496+0000 7fc637400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:13:08.518 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:13:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:13:08.496+0000 7fc637400640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:13:08.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.519+0000 7f7e89200640 1 -- 172.21.15.110:0/3040979370 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f7e680a2c00 msgr2=0x7f7e680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:08.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.519+0000 7f7e89200640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f7e680a2c00 0x7f7e680a50c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e7402a9c0 tx=0x7f7e74005c90 comp rx=0 tx=0).stop 2024-09-12T02:13:08.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.519+0000 7f7e89200640 1 -- 172.21.15.110:0/3040979370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e84074f40 msgr2=0x7f7e8419ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:08.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.519+0000 7f7e89200640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e84074f40 0x7f7e8419ac50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00e9f0 tx=0x7f7e6c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:13:08.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.519+0000 7f7e89200640 1 -- 172.21.15.110:0/3040979370 shutdown_connections 2024-09-12T02:13:08.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.519+0000 7f7e89200640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f7e680a2c00 0x7f7e680a50c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:08.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.519+0000 7f7e89200640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e8410e3b0 0x7f7e8419efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:08.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.519+0000 7f7e89200640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7e84074f40 0x7f7e8419ac50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:08.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.519+0000 7f7e89200640 1 --2- 172.21.15.110:0/3040979370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e84074620 0x7f7e8419a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:08.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.519+0000 7f7e89200640 1 -- 172.21.15.110:0/3040979370 >> 172.21.15.110:0/3040979370 conn(0x7f7e840fd8b0 msgr2=0x7f7e840ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:08.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.520+0000 7f7e89200640 1 -- 172.21.15.110:0/3040979370 shutdown_connections 2024-09-12T02:13:08.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:08.520+0000 7f7e89200640 1 -- 172.21.15.110:0/3040979370 wait complete. 2024-09-12T02:13:08.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:08 smithi136 ceph-mon[35814]: pgmap v336: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-12T02:13:08.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:08 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:08.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:08 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:08.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:08 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:08.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:08 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:08 smithi110 ceph-mon[30548]: pgmap v336: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-12T02:13:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:08.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:08 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:09.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:08 smithi115 ceph-mon[35351]: pgmap v336: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-09-12T02:13:09.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:08 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:09.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:08 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:09.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:08 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:09.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:08 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:09.411 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-12T02:13:09.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:09 smithi110 ceph-mon[30548]: from='client.24710 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:09.834 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:09.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:09 smithi136 ceph-mon[35814]: from='client.24710 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:10.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:09 smithi115 ceph-mon[35351]: from='client.24710 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:10.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.439+0000 7f19a6000640 1 -- 172.21.15.110:0/1841245343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a01079c0 msgr2=0x7f19a0107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:10.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.439+0000 7f19a6000640 1 --2- 172.21.15.110:0/1841245343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a01079c0 0x7f19a0107da0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1994009930 tx=0x7f199402a420 comp rx=0 tx=0).stop 2024-09-12T02:13:10.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.439+0000 7f19a6000640 1 -- 172.21.15.110:0/1841245343 shutdown_connections 2024-09-12T02:13:10.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.439+0000 7f19a6000640 1 --2- 172.21.15.110:0/1841245343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19a0102360 0x7f19a010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:10.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.439+0000 7f19a6000640 1 --2- 172.21.15.110:0/1841245343 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19a01019c0 0x7f19a0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:10.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.439+0000 7f19a6000640 1 --2- 172.21.15.110:0/1841245343 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a01079c0 0x7f19a0107da0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:10.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.439+0000 7f19a6000640 1 -- 172.21.15.110:0/1841245343 >> 172.21.15.110:0/1841245343 conn(0x7f19a00fd740 msgr2=0x7f19a00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:10.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.439+0000 7f19a6000640 1 -- 172.21.15.110:0/1841245343 shutdown_connections 2024-09-12T02:13:10.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.439+0000 7f19a6000640 1 -- 172.21.15.110:0/1841245343 wait complete. 2024-09-12T02:13:10.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.440+0000 7f19a6000640 1 Processor -- start 2024-09-12T02:13:10.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.440+0000 7f19a6000640 1 -- start start 2024-09-12T02:13:10.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.440+0000 7f19a6000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19a01019c0 0x7f19a019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:10.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.440+0000 7f19a6000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19a0102360 0x7f19a019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:10.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.440+0000 7f19a6000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a01079c0 0x7f19a019ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:10.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.440+0000 7f19a6000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f19a0111de0 con 0x7f19a01079c0 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.440+0000 7f19a6000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f19a0111c60 con 0x7f19a0102360 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.440+0000 7f19a6000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f19a0111f60 con 0x7f19a01019c0 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.441+0000 7f19a5600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a01079c0 0x7f19a019ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.441+0000 7f19a4c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19a01019c0 0x7f19a019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.441+0000 7f19a5600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a01079c0 0x7f19a019ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58492/0 (socket says 172.21.15.110:58492) 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.441+0000 7f19a5600640 1 -- 172.21.15.110:0/127012828 learned_addr learned my addr 172.21.15.110:0/127012828 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.441+0000 7f199fe00640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19a0102360 0x7f19a019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.441+0000 7f19a4c00640 1 -- 172.21.15.110:0/127012828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19a0102360 msgr2=0x7f19a019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.441+0000 7f19a4c00640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19a0102360 0x7f19a019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.441+0000 7f19a4c00640 1 -- 172.21.15.110:0/127012828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a01079c0 msgr2=0x7f19a019ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.441+0000 7f19a4c00640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a01079c0 0x7f19a019ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.441+0000 7f19a4c00640 1 -- 172.21.15.110:0/127012828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a019f4c0 con 0x7f19a01019c0 2024-09-12T02:13:10.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.441+0000 7f19a4c00640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19a01019c0 0x7f19a019a510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1994005940 tx=0x7f1994031b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:10.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.442+0000 7f199d600640 1 -- 172.21.15.110:0/127012828 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199403f070 con 0x7f19a01019c0 2024-09-12T02:13:10.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.442+0000 7f199d600640 1 -- 172.21.15.110:0/127012828 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1994003ad0 con 0x7f19a01019c0 2024-09-12T02:13:10.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.442+0000 7f19a6000640 1 -- 172.21.15.110:0/127012828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a019f750 con 0x7f19a01019c0 2024-09-12T02:13:10.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.442+0000 7f199d600640 1 -- 172.21.15.110:0/127012828 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994035070 con 0x7f19a01019c0 2024-09-12T02:13:10.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.442+0000 7f19a6000640 1 -- 172.21.15.110:0/127012828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a01a7090 con 0x7f19a01019c0 2024-09-12T02:13:10.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.443+0000 7f19a6000640 1 -- 172.21.15.110:0/127012828 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a0103100 con 0x7f19a01019c0 2024-09-12T02:13:10.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.446+0000 7f199d600640 1 -- 172.21.15.110:0/127012828 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f19940035f0 con 0x7f19a01019c0 2024-09-12T02:13:10.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.447+0000 7f199d600640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f19880a2c10 0x7f19880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:10.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.447+0000 7f199d600640 1 -- 172.21.15.110:0/127012828 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f19940efc30 con 0x7f19a01019c0 2024-09-12T02:13:10.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.447+0000 7f199fe00640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f19880a2c10 0x7f19880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:10.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.448+0000 7f199fe00640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f19880a2c10 0x7f19880a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f19a010ec90 tx=0x7f198c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:10.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.448+0000 7f199d600640 1 -- 172.21.15.110:0/127012828 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19940bc0a0 con 0x7f19a01019c0 2024-09-12T02:13:10.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.662+0000 7f19a6000640 1 -- 172.21.15.110:0/127012828 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f19a00fe580 con 0x7f19880a2c10 2024-09-12T02:13:10.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.686+0000 7f199d600640 1 -- 172.21.15.110:0/127012828 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f19a00fe580 con 0x7f19880a2c10 2024-09-12T02:13:10.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.689+0000 7f19a6000640 1 -- 172.21.15.110:0/127012828 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f19880a2c10 msgr2=0x7f19880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:10.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.689+0000 7f19a6000640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f19880a2c10 0x7f19880a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f19a010ec90 tx=0x7f198c005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:10.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.689+0000 7f19a6000640 1 -- 172.21.15.110:0/127012828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19a01019c0 msgr2=0x7f19a019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:10.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.689+0000 7f19a6000640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19a01019c0 0x7f19a019a510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1994005940 tx=0x7f1994031b50 comp rx=0 tx=0).stop 2024-09-12T02:13:10.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.689+0000 7f19a6000640 1 -- 172.21.15.110:0/127012828 shutdown_connections 2024-09-12T02:13:10.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.689+0000 7f19a6000640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f19880a2c10 0x7f19880a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:10.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.689+0000 7f19a6000640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19a01079c0 0x7f19a019ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:10.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.689+0000 7f19a6000640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19a0102360 0x7f19a019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:10.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.689+0000 7f19a6000640 1 --2- 172.21.15.110:0/127012828 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19a01019c0 0x7f19a019a510 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:10.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.689+0000 7f19a6000640 1 -- 172.21.15.110:0/127012828 >> 172.21.15.110:0/127012828 conn(0x7f19a00fd740 msgr2=0x7f19a00fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:10.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.689+0000 7f19a6000640 1 -- 172.21.15.110:0/127012828 shutdown_connections 2024-09-12T02:13:10.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:10.689+0000 7f19a6000640 1 -- 172.21.15.110:0/127012828 wait complete. 2024-09-12T02:13:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:10 smithi136 ceph-mon[35814]: pgmap v337: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-12T02:13:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:10 smithi136 ceph-mon[35814]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T02:13:10.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:10.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:10.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:13:10.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:13:10.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:10 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:10 smithi110 ceph-mon[30548]: pgmap v337: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-12T02:13:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:10 smithi110 ceph-mon[30548]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T02:13:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:13:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:13:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:10 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:11.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:10 smithi115 ceph-mon[35351]: pgmap v337: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-12T02:13:11.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:10 smithi115 ceph-mon[35351]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-12T02:13:11.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:11.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:11.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:13:11.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:13:11.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:10 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:13:11.495 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-12T02:13:11.865 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:11.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:11 smithi136 ceph-mon[35814]: from='client.24730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:11.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:11 smithi110 ceph-mon[30548]: from='client.24730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:12.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:11 smithi115 ceph-mon[35351]: from='client.24730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:12.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.500+0000 7f05c0200640 1 -- 172.21.15.110:0/3714297794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b81049a0 msgr2=0x7f05b81089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:12.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.500+0000 7f05c0200640 1 --2- 172.21.15.110:0/3714297794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b81049a0 0x7f05b81089f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009900 tx=0x7f05a402a410 comp rx=0 tx=0).stop 2024-09-12T02:13:12.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.500+0000 7f05c0200640 1 -- 172.21.15.110:0/3714297794 shutdown_connections 2024-09-12T02:13:12.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.500+0000 7f05c0200640 1 --2- 172.21.15.110:0/3714297794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8109120 0x7f05b8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:12.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.500+0000 7f05c0200640 1 --2- 172.21.15.110:0/3714297794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b81049a0 0x7f05b81089f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:12.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.500+0000 7f05c0200640 1 --2- 172.21.15.110:0/3714297794 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05b8103ff0 0x7f05b81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:12.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.500+0000 7f05c0200640 1 -- 172.21.15.110:0/3714297794 >> 172.21.15.110:0/3714297794 conn(0x7f05b80ffa90 msgr2=0x7f05b8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:12.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.500+0000 7f05c0200640 1 -- 172.21.15.110:0/3714297794 shutdown_connections 2024-09-12T02:13:12.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.500+0000 7f05c0200640 1 -- 172.21.15.110:0/3714297794 wait complete. 2024-09-12T02:13:12.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.501+0000 7f05c0200640 1 Processor -- start 2024-09-12T02:13:12.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.502+0000 7f05c0200640 1 -- start start 2024-09-12T02:13:12.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.502+0000 7f05c0200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05b8103ff0 0x7f05b819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:12.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.502+0000 7f05c0200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b81049a0 0x7f05b819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.502+0000 7f05c0200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8109120 0x7f05b819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.502+0000 7f05c0200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f05b8114120 con 0x7f05b81049a0 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.502+0000 7f05c0200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f05b8113fa0 con 0x7f05b8109120 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.502+0000 7f05c0200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f05b81142a0 con 0x7f05b8103ff0 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.502+0000 7f05bce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b81049a0 0x7f05b819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.502+0000 7f05bce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b81049a0 0x7f05b819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58502/0 (socket says 172.21.15.110:58502) 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.502+0000 7f05bce00640 1 -- 172.21.15.110:0/2832162803 learned_addr learned my addr 172.21.15.110:0/2832162803 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.502+0000 7f05bd800640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05b8103ff0 0x7f05b819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.502+0000 7f05be200640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8109120 0x7f05b819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.503+0000 7f05bce00640 1 -- 172.21.15.110:0/2832162803 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05b8103ff0 msgr2=0x7f05b819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.503+0000 7f05bce00640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05b8103ff0 0x7f05b819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.503+0000 7f05bce00640 1 -- 172.21.15.110:0/2832162803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8109120 msgr2=0x7f05b819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:12.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.503+0000 7f05bce00640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8109120 0x7f05b819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:12.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.503+0000 7f05bce00640 1 -- 172.21.15.110:0/2832162803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b819f650 con 0x7f05b81049a0 2024-09-12T02:13:12.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.503+0000 7f05be200640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8109120 0x7f05b819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:13:12.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.503+0000 7f05bce00640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b81049a0 0x7f05b819abe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f05a4006010 tx=0x7f05a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:12.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.503+0000 7f05b6000640 1 -- 172.21.15.110:0/2832162803 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a403f030 con 0x7f05b81049a0 2024-09-12T02:13:12.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.503+0000 7f05b6000640 1 -- 172.21.15.110:0/2832162803 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05a4003ce0 con 0x7f05b81049a0 2024-09-12T02:13:12.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.503+0000 7f05b6000640 1 -- 172.21.15.110:0/2832162803 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a4035070 con 0x7f05b81049a0 2024-09-12T02:13:12.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.503+0000 7f05c0200640 1 -- 172.21.15.110:0/2832162803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b819f8e0 con 0x7f05b81049a0 2024-09-12T02:13:12.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.504+0000 7f05c0200640 1 -- 172.21.15.110:0/2832162803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b81a7220 con 0x7f05b81049a0 2024-09-12T02:13:12.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.505+0000 7f05c0200640 1 -- 172.21.15.110:0/2832162803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b81054d0 con 0x7f05b81049a0 2024-09-12T02:13:12.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.506+0000 7f05b6000640 1 -- 172.21.15.110:0/2832162803 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f05a4042030 con 0x7f05b81049a0 2024-09-12T02:13:12.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.509+0000 7f05b6000640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f05a00a2c10 0x7f05a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:12.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.510+0000 7f05b6000640 1 -- 172.21.15.110:0/2832162803 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f05a40ef5e0 con 0x7f05b81049a0 2024-09-12T02:13:12.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.510+0000 7f05bd800640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f05a00a2c10 0x7f05a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:12.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.510+0000 7f05bd800640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f05a00a2c10 0x7f05a00a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00bbe0 tx=0x7f05ac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:12.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.513+0000 7f05b6000640 1 -- 172.21.15.110:0/2832162803 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f05a40bbab0 con 0x7f05b81049a0 2024-09-12T02:13:12.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:12 smithi110 ceph-mon[30548]: pgmap v338: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-12T02:13:12.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.721+0000 7f05c0200640 1 -- 172.21.15.110:0/2832162803 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f05b8062630 con 0x7f05a00a2c10 2024-09-12T02:13:12.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.727+0000 7f05b6000640 1 -- 172.21.15.110:0/2832162803 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f05b8062630 con 0x7f05a00a2c10 2024-09-12T02:13:12.727 INFO:teuthology.orchestra.run.smithi110.stdout:/volumes/qa/sv_0/36dcd3a9-d1c1-4450-b2fb-147deacff581 2024-09-12T02:13:12.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.729+0000 7f05c0200640 1 -- 172.21.15.110:0/2832162803 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f05a00a2c10 msgr2=0x7f05a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:12.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.729+0000 7f05c0200640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f05a00a2c10 0x7f05a00a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00bbe0 tx=0x7f05ac00b390 comp rx=0 tx=0).stop 2024-09-12T02:13:12.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.729+0000 7f05c0200640 1 -- 172.21.15.110:0/2832162803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b81049a0 msgr2=0x7f05b819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:12.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.729+0000 7f05c0200640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b81049a0 0x7f05b819abe0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f05a4006010 tx=0x7f05a40042f0 comp rx=0 tx=0).stop 2024-09-12T02:13:12.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.729+0000 7f05c0200640 1 -- 172.21.15.110:0/2832162803 shutdown_connections 2024-09-12T02:13:12.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.729+0000 7f05c0200640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f05a00a2c10 0x7f05a00a50d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:12.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.729+0000 7f05c0200640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f05b8109120 0x7f05b819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:12.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.729+0000 7f05c0200640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b81049a0 0x7f05b819abe0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:12.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.729+0000 7f05c0200640 1 --2- 172.21.15.110:0/2832162803 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05b8103ff0 0x7f05b819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:12.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.729+0000 7f05c0200640 1 -- 172.21.15.110:0/2832162803 >> 172.21.15.110:0/2832162803 conn(0x7f05b80ffa90 msgr2=0x7f05b8100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:12.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.729+0000 7f05c0200640 1 -- 172.21.15.110:0/2832162803 shutdown_connections 2024-09-12T02:13:12.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:12.729+0000 7f05c0200640 1 -- 172.21.15.110:0/2832162803 wait complete. 2024-09-12T02:13:12.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:12 smithi136 ceph-mon[35814]: pgmap v338: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-12T02:13:13.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:12 smithi115 ceph-mon[35351]: pgmap v338: 129 pgs: 129 active+clean; 584 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-12T02:13:13.626 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-12T02:13:13.999 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.629+0000 7f33c3200640 1 -- 172.21.15.110:0/3279115728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c41079c0 msgr2=0x7f33c4107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.629+0000 7f33c3200640 1 --2- 172.21.15.110:0/3279115728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c41079c0 0x7f33c4107da0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009930 tx=0x7f33b402a420 comp rx=0 tx=0).stop 2024-09-12T02:13:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.629+0000 7f33c3200640 1 -- 172.21.15.110:0/3279115728 shutdown_connections 2024-09-12T02:13:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.629+0000 7f33c3200640 1 --2- 172.21.15.110:0/3279115728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33c4102360 0x7f33c410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.629+0000 7f33c3200640 1 --2- 172.21.15.110:0/3279115728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33c41019c0 0x7f33c4101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.629+0000 7f33c3200640 1 --2- 172.21.15.110:0/3279115728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c41079c0 0x7f33c4107da0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.629+0000 7f33c3200640 1 -- 172.21.15.110:0/3279115728 >> 172.21.15.110:0/3279115728 conn(0x7f33c40fd740 msgr2=0x7f33c40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.629+0000 7f33c3200640 1 -- 172.21.15.110:0/3279115728 shutdown_connections 2024-09-12T02:13:14.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.629+0000 7f33c3200640 1 -- 172.21.15.110:0/3279115728 wait complete. 2024-09-12T02:13:14.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.630+0000 7f33c3200640 1 Processor -- start 2024-09-12T02:13:14.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.631+0000 7f33c3200640 1 -- start start 2024-09-12T02:13:14.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.631+0000 7f33c3200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33c41019c0 0x7f33c41982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:14.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.631+0000 7f33c3200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33c4102360 0x7f33c41987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:14.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.631+0000 7f33c3200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c41079c0 0x7f33c419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:14.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.631+0000 7f33c3200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f33c4111dd0 con 0x7f33c4102360 2024-09-12T02:13:14.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.631+0000 7f33c3200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f33c4111c50 con 0x7f33c41019c0 2024-09-12T02:13:14.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.631+0000 7f33c3200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f33c4111f50 con 0x7f33c41079c0 2024-09-12T02:13:14.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.631+0000 7f33bbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33c4102360 0x7f33c41987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:14.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.631+0000 7f33bbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33c4102360 0x7f33c41987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58526/0 (socket says 172.21.15.110:58526) 2024-09-12T02:13:14.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.631+0000 7f33bbe00640 1 -- 172.21.15.110:0/1940090359 learned_addr learned my addr 172.21.15.110:0/1940090359 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:14.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.631+0000 7f33c1e00640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33c41019c0 0x7f33c41982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:14.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.631+0000 7f33c2800640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c41079c0 0x7f33c419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:14.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.632+0000 7f33bbe00640 1 -- 172.21.15.110:0/1940090359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c41079c0 msgr2=0x7f33c419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:14.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.632+0000 7f33bbe00640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c41079c0 0x7f33c419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:14.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.632+0000 7f33bbe00640 1 -- 172.21.15.110:0/1940090359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33c41019c0 msgr2=0x7f33c41982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.632+0000 7f33bbe00640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33c41019c0 0x7f33c41982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.632+0000 7f33bbe00640 1 -- 172.21.15.110:0/1940090359 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c419d260 con 0x7f33c4102360 2024-09-12T02:13:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.632+0000 7f33bbe00640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33c4102360 0x7f33c41987f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00e9f0 tx=0x7f33ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.632+0000 7f33baa00640 1 -- 172.21.15.110:0/1940090359 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00cd80 con 0x7f33c4102360 2024-09-12T02:13:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.632+0000 7f33baa00640 1 -- 172.21.15.110:0/1940090359 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33ac010910 con 0x7f33c4102360 2024-09-12T02:13:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.632+0000 7f33baa00640 1 -- 172.21.15.110:0/1940090359 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac018990 con 0x7f33c4102360 2024-09-12T02:13:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.632+0000 7f33c3200640 1 -- 172.21.15.110:0/1940090359 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c419d550 con 0x7f33c4102360 2024-09-12T02:13:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.632+0000 7f33c3200640 1 -- 172.21.15.110:0/1940090359 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c41a4e30 con 0x7f33c4102360 2024-09-12T02:13:14.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.634+0000 7f33c3200640 1 -- 172.21.15.110:0/1940090359 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c4101e20 con 0x7f33c4102360 2024-09-12T02:13:14.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.635+0000 7f33baa00640 1 -- 172.21.15.110:0/1940090359 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f33ac010ac0 con 0x7f33c4102360 2024-09-12T02:13:14.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.636+0000 7f33baa00640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f33a80a2c90 0x7f33a80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:14.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.637+0000 7f33baa00640 1 -- 172.21.15.110:0/1940090359 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f33ac0cf7e0 con 0x7f33c4102360 2024-09-12T02:13:14.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.637+0000 7f33c1e00640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f33a80a2c90 0x7f33a80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:14.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.638+0000 7f33c1e00640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f33a80a2c90 0x7f33a80a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f33b4006010 tx=0x7f33b4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:14.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.641+0000 7f33baa00640 1 -- 172.21.15.110:0/1940090359 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f33ac09bbf0 con 0x7f33c4102360 2024-09-12T02:13:14.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:14 smithi110 ceph-mon[30548]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:14.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:14 smithi110 ceph-mon[30548]: pgmap v339: 129 pgs: 129 active+clean; 604 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.1 KiB/s wr, 14 op/s 2024-09-12T02:13:14.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.842+0000 7f33c3200640 1 -- 172.21.15.110:0/1940090359 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f33c4109f90 con 0x7f33a80a2c90 2024-09-12T02:13:14.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.867+0000 7f33baa00640 1 -- 172.21.15.110:0/1940090359 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f33c4109f90 con 0x7f33a80a2c90 2024-09-12T02:13:14.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.869+0000 7f33c3200640 1 -- 172.21.15.110:0/1940090359 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f33a80a2c90 msgr2=0x7f33a80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:14.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.869+0000 7f33c3200640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f33a80a2c90 0x7f33a80a5150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f33b4006010 tx=0x7f33b4000bc0 comp rx=0 tx=0).stop 2024-09-12T02:13:14.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.869+0000 7f33c3200640 1 -- 172.21.15.110:0/1940090359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33c4102360 msgr2=0x7f33c41987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:14.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.869+0000 7f33c3200640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33c4102360 0x7f33c41987f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00e9f0 tx=0x7f33ac00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:13:14.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.869+0000 7f33c3200640 1 -- 172.21.15.110:0/1940090359 shutdown_connections 2024-09-12T02:13:14.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.869+0000 7f33c3200640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f33a80a2c90 0x7f33a80a5150 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:14.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.869+0000 7f33c3200640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f33c41079c0 0x7f33c419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:14.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.869+0000 7f33c3200640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33c4102360 0x7f33c41987f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:14.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.869+0000 7f33c3200640 1 --2- 172.21.15.110:0/1940090359 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f33c41019c0 0x7f33c41982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.869+0000 7f33c3200640 1 -- 172.21.15.110:0/1940090359 >> 172.21.15.110:0/1940090359 conn(0x7f33c40fd740 msgr2=0x7f33c40fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.869+0000 7f33c3200640 1 -- 172.21.15.110:0/1940090359 shutdown_connections 2024-09-12T02:13:14.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:14.869+0000 7f33c3200640 1 -- 172.21.15.110:0/1940090359 wait complete. 2024-09-12T02:13:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:14 smithi136 ceph-mon[35814]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:14 smithi136 ceph-mon[35814]: pgmap v339: 129 pgs: 129 active+clean; 604 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.1 KiB/s wr, 14 op/s 2024-09-12T02:13:15.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:14 smithi115 ceph-mon[35351]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:15.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:14 smithi115 ceph-mon[35351]: pgmap v339: 129 pgs: 129 active+clean; 604 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.1 KiB/s wr, 14 op/s 2024-09-12T02:13:15.665 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-12T02:13:16.034 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:16.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.672+0000 7fd047e00640 1 -- 172.21.15.110:0/2658645932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0480745c0 msgr2=0x7fd0480749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:16.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.672+0000 7fd047e00640 1 --2- 172.21.15.110:0/2658645932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0480745c0 0x7fd0480749a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd038009900 tx=0x7fd03802a480 comp rx=0 tx=0).stop 2024-09-12T02:13:16.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.672+0000 7fd047e00640 1 -- 172.21.15.110:0/2658645932 shutdown_connections 2024-09-12T02:13:16.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.672+0000 7fd047e00640 1 --2- 172.21.15.110:0/2658645932 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04810e260 0x7fd048110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:16.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.672+0000 7fd047e00640 1 --2- 172.21.15.110:0/2658645932 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd048074ee0 0x7fd04810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:16.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.672+0000 7fd047e00640 1 --2- 172.21.15.110:0/2658645932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0480745c0 0x7fd0480749a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:16.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.672+0000 7fd047e00640 1 -- 172.21.15.110:0/2658645932 >> 172.21.15.110:0/2658645932 conn(0x7fd0480fd740 msgr2=0x7fd0480ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:16.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.672+0000 7fd047e00640 1 -- 172.21.15.110:0/2658645932 shutdown_connections 2024-09-12T02:13:16.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.672+0000 7fd047e00640 1 -- 172.21.15.110:0/2658645932 wait complete. 2024-09-12T02:13:16.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.673+0000 7fd047e00640 1 Processor -- start 2024-09-12T02:13:16.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.673+0000 7fd047e00640 1 -- start start 2024-09-12T02:13:16.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.673+0000 7fd047e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0480745c0 0x7fd04819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:16.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.673+0000 7fd047e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd048074ee0 0x7fd04819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:16.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.673+0000 7fd047e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04810e260 0x7fd04819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.673+0000 7fd047e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd048113fb0 con 0x7fd048074ee0 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.673+0000 7fd047e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd048113e30 con 0x7fd04810e260 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.673+0000 7fd047e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd048114130 con 0x7fd0480745c0 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.674+0000 7fd046000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd048074ee0 0x7fd04819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.674+0000 7fd047400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04810e260 0x7fd04819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.674+0000 7fd047400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04810e260 0x7fd04819ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:60998/0 (socket says 172.21.15.110:60998) 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.674+0000 7fd047400640 1 -- 172.21.15.110:0/3307476486 learned_addr learned my addr 172.21.15.110:0/3307476486 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.674+0000 7fd046a00640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0480745c0 0x7fd04819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.674+0000 7fd047400640 1 -- 172.21.15.110:0/3307476486 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0480745c0 msgr2=0x7fd04819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.674+0000 7fd047400640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0480745c0 0x7fd04819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.674+0000 7fd047400640 1 -- 172.21.15.110:0/3307476486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd048074ee0 msgr2=0x7fd04819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.674+0000 7fd047400640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd048074ee0 0x7fd04819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:16.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.674+0000 7fd047400640 1 -- 172.21.15.110:0/3307476486 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04819f450 con 0x7fd04810e260 2024-09-12T02:13:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.674+0000 7fd047400640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04810e260 0x7fd04819ed70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd04000eb40 tx=0x7fd04000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.675+0000 7fd03f400640 1 -- 172.21.15.110:0/3307476486 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040004b20 con 0x7fd04810e260 2024-09-12T02:13:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.675+0000 7fd047e00640 1 -- 172.21.15.110:0/3307476486 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04819f740 con 0x7fd04810e260 2024-09-12T02:13:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.675+0000 7fd03f400640 1 -- 172.21.15.110:0/3307476486 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd040004cc0 con 0x7fd04810e260 2024-09-12T02:13:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.675+0000 7fd047e00640 1 -- 172.21.15.110:0/3307476486 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0481a7020 con 0x7fd04810e260 2024-09-12T02:13:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.675+0000 7fd03f400640 1 -- 172.21.15.110:0/3307476486 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0400107b0 con 0x7fd04810e260 2024-09-12T02:13:16.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.676+0000 7fd047e00640 1 -- 172.21.15.110:0/3307476486 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd028005290 con 0x7fd04810e260 2024-09-12T02:13:16.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.678+0000 7fd03f400640 1 -- 172.21.15.110:0/3307476486 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd040005000 con 0x7fd04810e260 2024-09-12T02:13:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.679+0000 7fd03f400640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd02c0a2c90 0x7fd02c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:16.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.679+0000 7fd03f400640 1 -- 172.21.15.110:0/3307476486 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7fd0400cfad0 con 0x7fd04810e260 2024-09-12T02:13:16.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.679+0000 7fd046a00640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd02c0a2c90 0x7fd02c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:16.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.680+0000 7fd046a00640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd02c0a2c90 0x7fd02c0a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd038009230 tx=0x7fd0380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:16.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.684+0000 7fd03f400640 1 -- 172.21.15.110:0/3307476486 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd04009c530 con 0x7fd04810e260 2024-09-12T02:13:16.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.886+0000 7fd047e00640 1 -- 172.21.15.110:0/3307476486 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fd028000bc0 con 0x7fd02c0a2c90 2024-09-12T02:13:16.887 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:16 smithi110 ceph-mon[30548]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:16.887 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:16 smithi110 ceph-mon[30548]: pgmap v340: 129 pgs: 129 active+clean; 605 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-12T02:13:16.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.891+0000 7fd03f400640 1 -- 172.21.15.110:0/3307476486 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd028000bc0 con 0x7fd02c0a2c90 2024-09-12T02:13:16.891 INFO:teuthology.orchestra.run.smithi110.stdout:/volumes/qa/sv_1/0726ba32-b748-40d8-bb38-f69cc5a7bd4b 2024-09-12T02:13:16.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.893+0000 7fd047e00640 1 -- 172.21.15.110:0/3307476486 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd02c0a2c90 msgr2=0x7fd02c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:16.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.893+0000 7fd047e00640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd02c0a2c90 0x7fd02c0a5150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd038009230 tx=0x7fd0380058d0 comp rx=0 tx=0).stop 2024-09-12T02:13:16.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.893+0000 7fd047e00640 1 -- 172.21.15.110:0/3307476486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04810e260 msgr2=0x7fd04819ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:16.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.893+0000 7fd047e00640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04810e260 0x7fd04819ed70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd04000eb40 tx=0x7fd04000c2d0 comp rx=0 tx=0).stop 2024-09-12T02:13:16.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.893+0000 7fd047e00640 1 -- 172.21.15.110:0/3307476486 shutdown_connections 2024-09-12T02:13:16.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.893+0000 7fd047e00640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd02c0a2c90 0x7fd02c0a5150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:16.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.893+0000 7fd047e00640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd04810e260 0x7fd04819ed70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:16.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.893+0000 7fd047e00640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd048074ee0 0x7fd04819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:16.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.893+0000 7fd047e00640 1 --2- 172.21.15.110:0/3307476486 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0480745c0 0x7fd04819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:16.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.893+0000 7fd047e00640 1 -- 172.21.15.110:0/3307476486 >> 172.21.15.110:0/3307476486 conn(0x7fd0480fd740 msgr2=0x7fd0480feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:16.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.894+0000 7fd047e00640 1 -- 172.21.15.110:0/3307476486 shutdown_connections 2024-09-12T02:13:16.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:16.894+0000 7fd047e00640 1 -- 172.21.15.110:0/3307476486 wait complete. 2024-09-12T02:13:16.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:16 smithi136 ceph-mon[35814]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:16.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:16 smithi136 ceph-mon[35814]: pgmap v340: 129 pgs: 129 active+clean; 605 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-12T02:13:17.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:16 smithi115 ceph-mon[35351]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:17.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:16 smithi115 ceph-mon[35351]: pgmap v340: 129 pgs: 129 active+clean; 605 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-12T02:13:17.726 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:13:18.093 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:18.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.716+0000 7f7943400640 1 -- 172.21.15.110:0/824698389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f793c101df0 msgr2=0x7f793c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:18.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.716+0000 7f7943400640 1 --2- 172.21.15.110:0/824698389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f793c101df0 0x7f793c1021d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f792c009900 tx=0x7f792c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:13:18.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.716+0000 7f7943400640 1 -- 172.21.15.110:0/824698389 shutdown_connections 2024-09-12T02:13:18.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.716+0000 7f7943400640 1 --2- 172.21.15.110:0/824698389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f793c106f20 0x7f793c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:18.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.716+0000 7f7943400640 1 --2- 172.21.15.110:0/824698389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f793c1027a0 0x7f793c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.716+0000 7f7943400640 1 --2- 172.21.15.110:0/824698389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f793c101df0 0x7f793c1021d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.716+0000 7f7943400640 1 -- 172.21.15.110:0/824698389 >> 172.21.15.110:0/824698389 conn(0x7f793c0fd8b0 msgr2=0x7f793c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.716+0000 7f7943400640 1 -- 172.21.15.110:0/824698389 shutdown_connections 2024-09-12T02:13:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.716+0000 7f7943400640 1 -- 172.21.15.110:0/824698389 wait complete. 2024-09-12T02:13:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.717+0000 7f7943400640 1 Processor -- start 2024-09-12T02:13:18.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.717+0000 7f7943400640 1 -- start start 2024-09-12T02:13:18.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.717+0000 7f7943400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f793c101df0 0x7f793c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:18.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.717+0000 7f7943400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f793c1027a0 0x7f793c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:18.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.717+0000 7f7943400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f793c106f20 0x7f793c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:18.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.717+0000 7f7943400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f793c111f80 con 0x7f793c106f20 2024-09-12T02:13:18.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.717+0000 7f7943400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f793c111e00 con 0x7f793c101df0 2024-09-12T02:13:18.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.717+0000 7f7943400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f793c112100 con 0x7f793c1027a0 2024-09-12T02:13:18.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.718+0000 7f7941400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f793c106f20 0x7f793c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:18.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.718+0000 7f7941400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f793c106f20 0x7f793c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58578/0 (socket says 172.21.15.110:58578) 2024-09-12T02:13:18.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.718+0000 7f7941400640 1 -- 172.21.15.110:0/1171144974 learned_addr learned my addr 172.21.15.110:0/1171144974 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:18.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.718+0000 7f7940a00640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f793c101df0 0x7f793c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.718+0000 7f7933e00640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f793c1027a0 0x7f793c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.718+0000 7f7941400640 1 -- 172.21.15.110:0/1171144974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f793c1027a0 msgr2=0x7f793c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.718+0000 7f7941400640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f793c1027a0 0x7f793c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.718+0000 7f7941400640 1 -- 172.21.15.110:0/1171144974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f793c101df0 msgr2=0x7f793c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.718+0000 7f7941400640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f793c101df0 0x7f793c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.718+0000 7f7941400640 1 -- 172.21.15.110:0/1171144974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c19d410 con 0x7f793c106f20 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.719+0000 7f7941400640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f793c106f20 0x7f793c19cd30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f793400eb10 tx=0x7f793400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.719+0000 7f793a000640 1 -- 172.21.15.110:0/1171144974 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934004b20 con 0x7f793c106f20 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.719+0000 7f7943400640 1 -- 172.21.15.110:0/1171144974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793c19d700 con 0x7f793c106f20 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.719+0000 7f793a000640 1 -- 172.21.15.110:0/1171144974 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7934004cc0 con 0x7f793c106f20 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.719+0000 7f793a000640 1 -- 172.21.15.110:0/1171144974 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934010700 con 0x7f793c106f20 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.719+0000 7f7943400640 1 -- 172.21.15.110:0/1171144974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793c1a4fe0 con 0x7f793c106f20 2024-09-12T02:13:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.720+0000 7f7943400640 1 -- 172.21.15.110:0/1171144974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793c1021d0 con 0x7f793c106f20 2024-09-12T02:13:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.722+0000 7f793a000640 1 -- 172.21.15.110:0/1171144974 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7934005020 con 0x7f793c106f20 2024-09-12T02:13:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.723+0000 7f793a000640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f79200a2c10 0x7f79200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.723+0000 7f793a000640 1 -- 172.21.15.110:0/1171144974 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f79340cfb60 con 0x7f793c106f20 2024-09-12T02:13:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.723+0000 7f7940a00640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f79200a2c10 0x7f79200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.724+0000 7f7940a00640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f79200a2c10 0x7f79200a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f792c009230 tx=0x7f792c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.727+0000 7f793a000640 1 -- 172.21.15.110:0/1171144974 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f793409c5c0 con 0x7f793c106f20 2024-09-12T02:13:18.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:18 smithi136 ceph-mon[35814]: from='client.24740 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:18.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:18 smithi136 ceph-mon[35814]: pgmap v341: 129 pgs: 129 active+clean; 605 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-09-12T02:13:18.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:18 smithi110 ceph-mon[30548]: from='client.24740 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:18.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:18 smithi110 ceph-mon[30548]: pgmap v341: 129 pgs: 129 active+clean; 605 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-09-12T02:13:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.942+0000 7f7943400640 1 -- 172.21.15.110:0/1171144974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f793c1997c0 con 0x7f793c106f20 2024-09-12T02:13:18.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.943+0000 7f793a000640 1 -- 172.21.15.110:0/1171144974 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11932 (secure 0 0 0) 0x7f793409bec0 con 0x7f793c106f20 2024-09-12T02:13:18.944 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:13:18.944 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"btime":"2024-09-12T02:13:05:600095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:12:13.698489+0000","modified":"2024-09-12T02:13:04.635785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.110:6841/4021694968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":4021694968},{"type":"v1","addr":"172.21.15.110:6841","nonce":4021694968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6839/1796624254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1796624254},{"type":"v1","addr":"172.21.15.115:6839","nonce":1796624254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24538,24517]},"id":1}]} 2024-09-12T02:13:18.944 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-09-12T02:13:18.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.945+0000 7f7943400640 1 -- 172.21.15.110:0/1171144974 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f79200a2c10 msgr2=0x7f79200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:18.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.945+0000 7f7943400640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f79200a2c10 0x7f79200a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f792c009230 tx=0x7f792c0058d0 comp rx=0 tx=0).stop 2024-09-12T02:13:18.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.945+0000 7f7943400640 1 -- 172.21.15.110:0/1171144974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f793c106f20 msgr2=0x7f793c19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:18.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.945+0000 7f7943400640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f793c106f20 0x7f793c19cd30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f793400eb10 tx=0x7f793400c2d0 comp rx=0 tx=0).stop 2024-09-12T02:13:18.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.945+0000 7f7943400640 1 -- 172.21.15.110:0/1171144974 shutdown_connections 2024-09-12T02:13:18.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.946+0000 7f7943400640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f79200a2c10 0x7f79200a50d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:18.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.946+0000 7f7943400640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f793c106f20 0x7f793c19cd30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:18.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.946+0000 7f7943400640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f793c1027a0 0x7f793c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:18.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.946+0000 7f7943400640 1 --2- 172.21.15.110:0/1171144974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f793c101df0 0x7f793c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:18.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.946+0000 7f7943400640 1 -- 172.21.15.110:0/1171144974 >> 172.21.15.110:0/1171144974 conn(0x7f793c0fd8b0 msgr2=0x7f793c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:18.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.946+0000 7f7943400640 1 -- 172.21.15.110:0/1171144974 shutdown_connections 2024-09-12T02:13:18.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:18.946+0000 7f7943400640 1 -- 172.21.15.110:0/1171144974 wait complete. 2024-09-12T02:13:19.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:18 smithi115 ceph-mon[35351]: from='client.24740 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:13:19.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:18 smithi115 ceph-mon[35351]: pgmap v341: 129 pgs: 129 active+clean; 605 KiB data, 380 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-09-12T02:13:19.861 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:19 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1171144974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:13:19.900 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:13:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:19 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1171144974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:13:20.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:19 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1171144974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:13:20.264 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:20.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:20 smithi110 ceph-mon[30548]: pgmap v342: 129 pgs: 129 active+clean; 624 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-09-12T02:13:20.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.848+0000 7f422fe00640 1 -- 172.21.15.110:0/2367638245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230109090 msgr2=0x7f4230110c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:20.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.848+0000 7f422fe00640 1 --2- 172.21.15.110:0/2367638245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230109090 0x7f4230110c10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4228009ca0 tx=0x7f422802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:13:20.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.848+0000 7f422fe00640 1 -- 172.21.15.110:0/2367638245 shutdown_connections 2024-09-12T02:13:20.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.848+0000 7f422fe00640 1 --2- 172.21.15.110:0/2367638245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230109090 0x7f4230110c10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:20.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.848+0000 7f422fe00640 1 --2- 172.21.15.110:0/2367638245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4230104800 0x7f4230108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:20.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.848+0000 7f422fe00640 1 --2- 172.21.15.110:0/2367638245 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4230103e50 0x7f4230104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:20.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.848+0000 7f422fe00640 1 -- 172.21.15.110:0/2367638245 >> 172.21.15.110:0/2367638245 conn(0x7f42300ff8b0 msgr2=0x7f4230101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:20.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.848+0000 7f422fe00640 1 -- 172.21.15.110:0/2367638245 shutdown_connections 2024-09-12T02:13:20.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.849+0000 7f422fe00640 1 -- 172.21.15.110:0/2367638245 wait complete. 2024-09-12T02:13:20.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.849+0000 7f422fe00640 1 Processor -- start 2024-09-12T02:13:20.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422fe00640 1 -- start start 2024-09-12T02:13:20.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230103e50 0x7f423019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:20.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4230104800 0x7f423019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:20.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4230109090 0x7f423019ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:20.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f4230114090 con 0x7f4230103e50 2024-09-12T02:13:20.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422fe00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4230113f10 con 0x7f4230104800 2024-09-12T02:13:20.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422fe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4230114210 con 0x7f4230109090 2024-09-12T02:13:20.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230103e50 0x7f423019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:20.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230103e50 0x7f423019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52528/0 (socket says 172.21.15.110:52528) 2024-09-12T02:13:20.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422ea00640 1 -- 172.21.15.110:0/3527992383 learned_addr learned my addr 172.21.15.110:0/3527992383 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:20.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422e000640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4230104800 0x7f423019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:20.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422f400640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4230109090 0x7f423019ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:20.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.850+0000 7f422ea00640 1 -- 172.21.15.110:0/3527992383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4230109090 msgr2=0x7f423019ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:20.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.851+0000 7f422ea00640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4230109090 0x7f423019ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:20.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.851+0000 7f422ea00640 1 -- 172.21.15.110:0/3527992383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4230104800 msgr2=0x7f423019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:20.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.851+0000 7f422ea00640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4230104800 0x7f423019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:20.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.851+0000 7f422ea00640 1 -- 172.21.15.110:0/3527992383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423019f4c0 con 0x7f4230103e50 2024-09-12T02:13:20.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.851+0000 7f422f400640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4230109090 0x7f423019ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:13:20.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.851+0000 7f422ea00640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230103e50 0x7f423019a510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f422000e9f0 tx=0x7f422000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:20.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.851+0000 7f4227400640 1 -- 172.21.15.110:0/3527992383 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422000cd80 con 0x7f4230103e50 2024-09-12T02:13:20.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.851+0000 7f4227400640 1 -- 172.21.15.110:0/3527992383 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4220010910 con 0x7f4230103e50 2024-09-12T02:13:20.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.851+0000 7f422fe00640 1 -- 172.21.15.110:0/3527992383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f423019f7b0 con 0x7f4230103e50 2024-09-12T02:13:20.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.851+0000 7f4227400640 1 -- 172.21.15.110:0/3527992383 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220018990 con 0x7f4230103e50 2024-09-12T02:13:20.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.851+0000 7f422fe00640 1 -- 172.21.15.110:0/3527992383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42301a7090 con 0x7f4230103e50 2024-09-12T02:13:20.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.852+0000 7f422fe00640 1 -- 172.21.15.110:0/3527992383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4230105330 con 0x7f4230103e50 2024-09-12T02:13:20.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.854+0000 7f4227400640 1 -- 172.21.15.110:0/3527992383 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f4220010ac0 con 0x7f4230103e50 2024-09-12T02:13:20.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.855+0000 7f4227400640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f42140a2c90 0x7f42140a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:20.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.856+0000 7f4227400640 1 -- 172.21.15.110:0/3527992383 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f42200cf890 con 0x7f4230103e50 2024-09-12T02:13:20.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.856+0000 7f422e000640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f42140a2c90 0x7f42140a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:20.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.856+0000 7f422e000640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f42140a2c90 0x7f42140a5150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f42300ffd60 tx=0x7f421c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:20.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:20.859+0000 7f4227400640 1 -- 172.21.15.110:0/3527992383 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f422009c2f0 con 0x7f4230103e50 2024-09-12T02:13:20.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:20 smithi136 ceph-mon[35814]: pgmap v342: 129 pgs: 129 active+clean; 624 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-09-12T02:13:21.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.035+0000 7f422fe00640 1 -- 172.21.15.110:0/3527992383 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4230104230 con 0x7f4230103e50 2024-09-12T02:13:21.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.037+0000 7f4227400640 1 -- 172.21.15.110:0/3527992383 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24795 (secure 0 0 0) 0x7f422009bbf0 con 0x7f4230103e50 2024-09-12T02:13:21.038 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:13:21.038 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":95,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:12:46.523937+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:12:08.596125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:12:11.312393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:12:21.215161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:13:21.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.040+0000 7f422fe00640 1 -- 172.21.15.110:0/3527992383 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f42140a2c90 msgr2=0x7f42140a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:21.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.040+0000 7f422fe00640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f42140a2c90 0x7f42140a5150 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f42300ffd60 tx=0x7f421c005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:21.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.040+0000 7f422fe00640 1 -- 172.21.15.110:0/3527992383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230103e50 msgr2=0x7f423019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:21.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.040+0000 7f422fe00640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230103e50 0x7f423019a510 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f422000e9f0 tx=0x7f422000eeb0 comp rx=0 tx=0).stop 2024-09-12T02:13:21.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.040+0000 7f422fe00640 1 -- 172.21.15.110:0/3527992383 shutdown_connections 2024-09-12T02:13:21.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.040+0000 7f422fe00640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f42140a2c90 0x7f42140a5150 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:21.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.040+0000 7f422fe00640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4230109090 0x7f423019ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:21.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.040+0000 7f422fe00640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4230104800 0x7f423019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:21.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.040+0000 7f422fe00640 1 --2- 172.21.15.110:0/3527992383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4230103e50 0x7f423019a510 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:21.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.040+0000 7f422fe00640 1 -- 172.21.15.110:0/3527992383 >> 172.21.15.110:0/3527992383 conn(0x7f42300ff8b0 msgr2=0x7f4230100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:21.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.040+0000 7f422fe00640 1 -- 172.21.15.110:0/3527992383 shutdown_connections 2024-09-12T02:13:21.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:21.040+0000 7f422fe00640 1 -- 172.21.15.110:0/3527992383 wait complete. 2024-09-12T02:13:21.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:20 smithi115 ceph-mon[35351]: pgmap v342: 129 pgs: 129 active+clean; 624 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2024-09-12T02:13:21.820 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:21 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3527992383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:13:21.859 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:13:21.859 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:13:21.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:21 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3527992383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:13:22.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:21 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3527992383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:13:22.224 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.848+0000 7f83e3400640 1 -- 172.21.15.110:0/1531567682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83dc101de0 msgr2=0x7f83dc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.849+0000 7f83e3400640 1 --2- 172.21.15.110:0/1531567682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83dc101de0 0x7f83dc1021c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009900 tx=0x7f83cc02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:13:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.849+0000 7f83e3400640 1 -- 172.21.15.110:0/1531567682 shutdown_connections 2024-09-12T02:13:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.849+0000 7f83e3400640 1 --2- 172.21.15.110:0/1531567682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83dc106f10 0x7f83dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:22.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.849+0000 7f83e3400640 1 --2- 172.21.15.110:0/1531567682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83dc102790 0x7f83dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.849+0000 7f83e3400640 1 --2- 172.21.15.110:0/1531567682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83dc101de0 0x7f83dc1021c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.849+0000 7f83e3400640 1 -- 172.21.15.110:0/1531567682 >> 172.21.15.110:0/1531567682 conn(0x7f83dc0fd8c0 msgr2=0x7f83dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.849+0000 7f83e3400640 1 -- 172.21.15.110:0/1531567682 shutdown_connections 2024-09-12T02:13:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.849+0000 7f83e3400640 1 -- 172.21.15.110:0/1531567682 wait complete. 2024-09-12T02:13:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.850+0000 7f83e3400640 1 Processor -- start 2024-09-12T02:13:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.850+0000 7f83e3400640 1 -- start start 2024-09-12T02:13:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.850+0000 7f83e3400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83dc101de0 0x7f83dc19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.850+0000 7f83e3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83dc102790 0x7f83dc19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.850+0000 7f83e3400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83dc106f10 0x7f83dc19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.850+0000 7f83e3400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc111f70 con 0x7f83dc102790 2024-09-12T02:13:22.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.850+0000 7f83e3400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc111df0 con 0x7f83dc106f10 2024-09-12T02:13:22.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.850+0000 7f83e3400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc1120f0 con 0x7f83dc101de0 2024-09-12T02:13:22.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.850+0000 7f83d3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83dc102790 0x7f83dc19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:22.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.850+0000 7f83d3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83dc102790 0x7f83dc19ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52554/0 (socket says 172.21.15.110:52554) 2024-09-12T02:13:22.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.850+0000 7f83d3e00640 1 -- 172.21.15.110:0/3337821446 learned_addr learned my addr 172.21.15.110:0/3337821446 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:22.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.850+0000 7f83e0a00640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83dc101de0 0x7f83dc19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:22.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.851+0000 7f83e1400640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83dc106f10 0x7f83dc19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:22.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.851+0000 7f83d3e00640 1 -- 172.21.15.110:0/3337821446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83dc101de0 msgr2=0x7f83dc19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:22.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.851+0000 7f83d3e00640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83dc101de0 0x7f83dc19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:22.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.851+0000 7f83d3e00640 1 -- 172.21.15.110:0/3337821446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83dc106f10 msgr2=0x7f83dc19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:22.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.851+0000 7f83d3e00640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83dc106f10 0x7f83dc19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:22.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.851+0000 7f83d3e00640 1 -- 172.21.15.110:0/3337821446 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc19f5e0 con 0x7f83dc102790 2024-09-12T02:13:22.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.851+0000 7f83e1400640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83dc106f10 0x7f83dc19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:13:22.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.851+0000 7f83d3e00640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83dc102790 0x7f83dc19ab70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f83c400e9f0 tx=0x7f83c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:22.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.851+0000 7f83da000640 1 -- 172.21.15.110:0/3337821446 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c400cd80 con 0x7f83dc102790 2024-09-12T02:13:22.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.851+0000 7f83da000640 1 -- 172.21.15.110:0/3337821446 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83c4005500 con 0x7f83dc102790 2024-09-12T02:13:22.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.851+0000 7f83e3400640 1 -- 172.21.15.110:0/3337821446 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83dc19f8d0 con 0x7f83dc102790 2024-09-12T02:13:22.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.851+0000 7f83da000640 1 -- 172.21.15.110:0/3337821446 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c4010690 con 0x7f83dc102790 2024-09-12T02:13:22.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.852+0000 7f83e3400640 1 -- 172.21.15.110:0/3337821446 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83dc1a71b0 con 0x7f83dc102790 2024-09-12T02:13:22.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.853+0000 7f83e3400640 1 -- 172.21.15.110:0/3337821446 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83dc1021c0 con 0x7f83dc102790 2024-09-12T02:13:22.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.854+0000 7f83da000640 1 -- 172.21.15.110:0/3337821446 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f83c40046c0 con 0x7f83dc102790 2024-09-12T02:13:22.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.855+0000 7f83da000640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f83c00a2c10 0x7f83c00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:22.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.856+0000 7f83da000640 1 -- 172.21.15.110:0/3337821446 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f83c40cfa00 con 0x7f83dc102790 2024-09-12T02:13:22.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.856+0000 7f83e0a00640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f83c00a2c10 0x7f83c00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:22.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.856+0000 7f83e0a00640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f83c00a2c10 0x7f83c00a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009230 tx=0x7f83cc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:22.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:22.860+0000 7f83da000640 1 -- 172.21.15.110:0/3337821446 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f83c409c460 con 0x7f83dc102790 2024-09-12T02:13:22.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:22 smithi136 ceph-mon[35814]: pgmap v343: 129 pgs: 129 active+clean; 624 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-12T02:13:22.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:22 smithi110 ceph-mon[30548]: pgmap v343: 129 pgs: 129 active+clean; 624 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-12T02:13:23.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.032+0000 7f83e3400640 1 -- 172.21.15.110:0/3337821446 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83dc10de00 con 0x7f83c00a2c10 2024-09-12T02:13:23.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.042+0000 7f83da000640 1 -- 172.21.15.110:0/3337821446 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340363 (secure 0 0 0) 0x7f83dc10de00 con 0x7f83c00a2c10 2024-09-12T02:13:23.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:22 smithi115 ceph-mon[35351]: pgmap v343: 129 pgs: 129 active+clean; 624 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-12T02:13:23.048 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:13:23.049 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-09-12T02:13:23.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.047+0000 7f83e3400640 1 -- 172.21.15.110:0/3337821446 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f83c00a2c10 msgr2=0x7f83c00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:23.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.047+0000 7f83e3400640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f83c00a2c10 0x7f83c00a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009230 tx=0x7f83cc0058d0 comp rx=0 tx=0).stop 2024-09-12T02:13:23.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.047+0000 7f83e3400640 1 -- 172.21.15.110:0/3337821446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83dc102790 msgr2=0x7f83dc19ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:23.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.047+0000 7f83e3400640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83dc102790 0x7f83dc19ab70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f83c400e9f0 tx=0x7f83c400edf0 comp rx=0 tx=0).stop 2024-09-12T02:13:23.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.047+0000 7f83e3400640 1 -- 172.21.15.110:0/3337821446 shutdown_connections 2024-09-12T02:13:23.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.047+0000 7f83e3400640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f83c00a2c10 0x7f83c00a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:23.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.047+0000 7f83e3400640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83dc106f10 0x7f83dc19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:23.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.047+0000 7f83e3400640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83dc102790 0x7f83dc19ab70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:23.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.047+0000 7f83e3400640 1 --2- 172.21.15.110:0/3337821446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83dc101de0 0x7f83dc19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:23.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.047+0000 7f83e3400640 1 -- 172.21.15.110:0/3337821446 >> 172.21.15.110:0/3337821446 conn(0x7f83dc0fd8c0 msgr2=0x7f83dc0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:23.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.048+0000 7f83e3400640 1 -- 172.21.15.110:0/3337821446 shutdown_connections 2024-09-12T02:13:23.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:23.048+0000 7f83e3400640 1 -- 172.21.15.110:0/3337821446 wait complete. 2024-09-12T02:13:23.850 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-12T02:13:21.463148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":639088,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":251,"num_read_kb":229,"num_write":340,"num_write_kb":3035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":393076,"kb_used_data":14708,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124548748,"statfs":{"total":1151940427776,"available":1151537917952,"internally_reserved":0,"allocated":15060992,"data_stored":8353202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41266,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":72,"num_write":30,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003320"},"pg_stats":[{"pgid":"2.1f","version":"95'9","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.589421+0000","last_change":"2024-09-12T02:12:09.666492+0000","last_active":"2024-09-12T02:13:00.589421+0000","last_peered":"2024-09-12T02:13:00.589421+0000","last_clean":"2024-09-12T02:13:00.589421+0000","last_became_active":"2024-09-12T02:12:09.666198+0000","last_became_peered":"2024-09-12T02:12:09.666198+0000","last_unstale":"2024-09-12T02:13:00.589421+0000","last_undegraded":"2024-09-12T02:13:00.589421+0000","last_fullsized":"2024-09-12T02:13:00.589421+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:01.779452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531924+0000","last_change":"2024-09-12T02:12:12.695888+0000","last_active":"2024-09-12T02:12:46.531924+0000","last_peered":"2024-09-12T02:12:46.531924+0000","last_clean":"2024-09-12T02:12:46.531924+0000","last_became_active":"2024-09-12T02:12:12.695065+0000","last_became_peered":"2024-09-12T02:12:12.695065+0000","last_unstale":"2024-09-12T02:12:46.531924+0000","last_undegraded":"2024-09-12T02:12:46.531924+0000","last_fullsized":"2024-09-12T02:12:46.531924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:09.799039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539140+0000","last_change":"2024-09-12T02:12:22.738585+0000","last_active":"2024-09-12T02:12:46.539140+0000","last_peered":"2024-09-12T02:12:46.539140+0000","last_clean":"2024-09-12T02:12:46.539140+0000","last_became_active":"2024-09-12T02:12:22.738174+0000","last_became_peered":"2024-09-12T02:12:22.738174+0000","last_unstale":"2024-09-12T02:12:46.539140+0000","last_undegraded":"2024-09-12T02:12:46.539140+0000","last_fullsized":"2024-09-12T02:12:46.539140+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:00.875256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"95'2","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532164+0000","last_change":"2024-09-12T02:12:09.735005+0000","last_active":"2024-09-12T02:12:46.532164+0000","last_peered":"2024-09-12T02:12:46.532164+0000","last_clean":"2024-09-12T02:12:46.532164+0000","last_became_active":"2024-09-12T02:12:09.734590+0000","last_became_peered":"2024-09-12T02:12:09.734590+0000","last_unstale":"2024-09-12T02:12:46.532164+0000","last_undegraded":"2024-09-12T02:12:46.532164+0000","last_fullsized":"2024-09-12T02:12:46.532164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:17.079183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.538251+0000","last_change":"2024-09-12T02:12:12.692688+0000","last_active":"2024-09-12T02:12:46.538251+0000","last_peered":"2024-09-12T02:12:46.538251+0000","last_clean":"2024-09-12T02:12:46.538251+0000","last_became_active":"2024-09-12T02:12:12.692252+0000","last_became_peered":"2024-09-12T02:12:12.692252+0000","last_unstale":"2024-09-12T02:12:46.538251+0000","last_undegraded":"2024-09-12T02:12:46.538251+0000","last_fullsized":"2024-09-12T02:12:46.538251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:40.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531995+0000","last_change":"2024-09-12T02:12:22.738074+0000","last_active":"2024-09-12T02:12:46.531995+0000","last_peered":"2024-09-12T02:12:46.531995+0000","last_clean":"2024-09-12T02:12:46.531995+0000","last_became_active":"2024-09-12T02:12:22.737692+0000","last_became_peered":"2024-09-12T02:12:22.737692+0000","last_unstale":"2024-09-12T02:12:46.531995+0000","last_undegraded":"2024-09-12T02:12:46.531995+0000","last_fullsized":"2024-09-12T02:12:46.531995+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:04.003426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"95'4","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.589299+0000","last_change":"2024-09-12T02:12:09.670228+0000","last_active":"2024-09-12T02:13:00.589299+0000","last_peered":"2024-09-12T02:13:00.589299+0000","last_clean":"2024-09-12T02:13:00.589299+0000","last_became_active":"2024-09-12T02:12:09.669517+0000","last_became_peered":"2024-09-12T02:12:09.669517+0000","last_unstale":"2024-09-12T02:13:00.589299+0000","last_undegraded":"2024-09-12T02:13:00.589299+0000","last_fullsized":"2024-09-12T02:13:00.589299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:49.547787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.541549+0000","last_change":"2024-09-12T02:12:12.693797+0000","last_active":"2024-09-12T02:12:46.541549+0000","last_peered":"2024-09-12T02:12:46.541549+0000","last_clean":"2024-09-12T02:12:46.541549+0000","last_became_active":"2024-09-12T02:12:12.692757+0000","last_became_peered":"2024-09-12T02:12:12.692757+0000","last_unstale":"2024-09-12T02:12:46.541549+0000","last_undegraded":"2024-09-12T02:12:46.541549+0000","last_fullsized":"2024-09-12T02:12:46.541549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:04.738832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532326+0000","last_change":"2024-09-12T02:12:22.742804+0000","last_active":"2024-09-12T02:12:46.532326+0000","last_peered":"2024-09-12T02:12:46.532326+0000","last_clean":"2024-09-12T02:12:46.532326+0000","last_became_active":"2024-09-12T02:12:22.742478+0000","last_became_peered":"2024-09-12T02:12:22.742478+0000","last_unstale":"2024-09-12T02:12:46.532326+0000","last_undegraded":"2024-09-12T02:12:46.532326+0000","last_fullsized":"2024-09-12T02:12:46.532326+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:25.406069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532754+0000","last_change":"2024-09-12T02:12:09.669360+0000","last_active":"2024-09-12T02:12:46.532754+0000","last_peered":"2024-09-12T02:12:46.532754+0000","last_clean":"2024-09-12T02:12:46.532754+0000","last_became_active":"2024-09-12T02:12:09.668908+0000","last_became_peered":"2024-09-12T02:12:09.668908+0000","last_unstale":"2024-09-12T02:12:46.532754+0000","last_undegraded":"2024-09-12T02:12:46.532754+0000","last_fullsized":"2024-09-12T02:12:46.532754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:48.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.542028+0000","last_change":"2024-09-12T02:12:46.542028+0000","last_active":"2024-09-12T02:12:46.542028+0000","last_peered":"2024-09-12T02:12:46.542028+0000","last_clean":"2024-09-12T02:12:46.542028+0000","last_became_active":"2024-09-12T02:12:46.541630+0000","last_became_peered":"2024-09-12T02:12:46.541630+0000","last_unstale":"2024-09-12T02:12:46.542028+0000","last_undegraded":"2024-09-12T02:12:46.542028+0000","last_fullsized":"2024-09-12T02:12:46.542028+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:08.641424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532137+0000","last_change":"2024-09-12T02:12:22.738663+0000","last_active":"2024-09-12T02:12:46.532137+0000","last_peered":"2024-09-12T02:12:46.532137+0000","last_clean":"2024-09-12T02:12:46.532137+0000","last_became_active":"2024-09-12T02:12:22.738280+0000","last_became_peered":"2024-09-12T02:12:22.738280+0000","last_unstale":"2024-09-12T02:12:46.532137+0000","last_undegraded":"2024-09-12T02:12:46.532137+0000","last_fullsized":"2024-09-12T02:12:46.532137+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:44.271539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537014+0000","last_change":"2024-09-12T02:12:12.687131+0000","last_active":"2024-09-12T02:12:46.537014+0000","last_peered":"2024-09-12T02:12:46.537014+0000","last_clean":"2024-09-12T02:12:46.537014+0000","last_became_active":"2024-09-12T02:12:12.686793+0000","last_became_peered":"2024-09-12T02:12:12.686793+0000","last_unstale":"2024-09-12T02:12:46.537014+0000","last_undegraded":"2024-09-12T02:12:46.537014+0000","last_fullsized":"2024-09-12T02:12:46.537014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:58.370130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"95'4","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.586790+0000","last_change":"2024-09-12T02:12:46.550259+0000","last_active":"2024-09-12T02:12:59.586790+0000","last_peered":"2024-09-12T02:12:59.586790+0000","last_clean":"2024-09-12T02:12:59.586790+0000","last_became_active":"2024-09-12T02:12:46.543047+0000","last_became_peered":"2024-09-12T02:12:46.543047+0000","last_unstale":"2024-09-12T02:12:59.586790+0000","last_undegraded":"2024-09-12T02:12:59.586790+0000","last_fullsized":"2024-09-12T02:12:59.586790+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.359689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532503+0000","last_change":"2024-09-12T02:12:23.023792+0000","last_active":"2024-09-12T02:12:46.532503+0000","last_peered":"2024-09-12T02:12:46.532503+0000","last_clean":"2024-09-12T02:12:46.532503+0000","last_became_active":"2024-09-12T02:12:23.023337+0000","last_became_peered":"2024-09-12T02:12:23.023337+0000","last_unstale":"2024-09-12T02:12:46.532503+0000","last_undegraded":"2024-09-12T02:12:46.532503+0000","last_fullsized":"2024-09-12T02:12:46.532503+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:01.859092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531648+0000","last_change":"2024-09-12T02:12:12.683615+0000","last_active":"2024-09-12T02:12:46.531648+0000","last_peered":"2024-09-12T02:12:46.531648+0000","last_clean":"2024-09-12T02:12:46.531648+0000","last_became_active":"2024-09-12T02:12:12.683279+0000","last_became_peered":"2024-09-12T02:12:12.683279+0000","last_unstale":"2024-09-12T02:12:46.531648+0000","last_undegraded":"2024-09-12T02:12:46.531648+0000","last_fullsized":"2024-09-12T02:12:46.531648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:10.819995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"95'1","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539290+0000","last_change":"2024-09-12T02:12:09.667600+0000","last_active":"2024-09-12T02:12:46.539290+0000","last_peered":"2024-09-12T02:12:46.539290+0000","last_clean":"2024-09-12T02:12:46.539290+0000","last_became_active":"2024-09-12T02:12:09.666053+0000","last_became_peered":"2024-09-12T02:12:09.666053+0000","last_unstale":"2024-09-12T02:12:46.539290+0000","last_undegraded":"2024-09-12T02:12:46.539290+0000","last_fullsized":"2024-09-12T02:12:46.539290+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:01.597906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"95'1","reported_seq":25,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532545+0000","last_change":"2024-09-12T02:12:22.748946+0000","last_active":"2024-09-12T02:12:46.532545+0000","last_peered":"2024-09-12T02:12:46.532545+0000","last_clean":"2024-09-12T02:12:46.532545+0000","last_became_active":"2024-09-12T02:12:22.748163+0000","last_became_peered":"2024-09-12T02:12:22.748163+0000","last_unstale":"2024-09-12T02:12:46.532545+0000","last_undegraded":"2024-09-12T02:12:46.532545+0000","last_fullsized":"2024-09-12T02:12:46.532545+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:49.560905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536543+0000","last_change":"2024-09-12T02:12:12.692275+0000","last_active":"2024-09-12T02:12:46.536543+0000","last_peered":"2024-09-12T02:12:46.536543+0000","last_clean":"2024-09-12T02:12:46.536543+0000","last_became_active":"2024-09-12T02:12:12.691932+0000","last_became_peered":"2024-09-12T02:12:12.691932+0000","last_unstale":"2024-09-12T02:12:46.536543+0000","last_undegraded":"2024-09-12T02:12:46.536543+0000","last_fullsized":"2024-09-12T02:12:46.536543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:01.922677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"95'3","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.586917+0000","last_change":"2024-09-12T02:12:09.665190+0000","last_active":"2024-09-12T02:12:59.586917+0000","last_peered":"2024-09-12T02:12:59.586917+0000","last_clean":"2024-09-12T02:12:59.586917+0000","last_became_active":"2024-09-12T02:12:09.664805+0000","last_became_peered":"2024-09-12T02:12:09.664805+0000","last_unstale":"2024-09-12T02:12:59.586917+0000","last_undegraded":"2024-09-12T02:12:59.586917+0000","last_fullsized":"2024-09-12T02:12:59.586917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:41.770072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.946089+0000","last_change":"2024-09-12T02:12:22.744555+0000","last_active":"2024-09-12T02:12:46.946089+0000","last_peered":"2024-09-12T02:12:46.946089+0000","last_clean":"2024-09-12T02:12:46.946089+0000","last_became_active":"2024-09-12T02:12:22.742530+0000","last_became_peered":"2024-09-12T02:12:22.742530+0000","last_unstale":"2024-09-12T02:12:46.946089+0000","last_undegraded":"2024-09-12T02:12:46.946089+0000","last_fullsized":"2024-09-12T02:12:46.946089+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:45.737376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531852+0000","last_change":"2024-09-12T02:12:12.681891+0000","last_active":"2024-09-12T02:12:46.531852+0000","last_peered":"2024-09-12T02:12:46.531852+0000","last_clean":"2024-09-12T02:12:46.531852+0000","last_became_active":"2024-09-12T02:12:12.681522+0000","last_became_peered":"2024-09-12T02:12:12.681522+0000","last_unstale":"2024-09-12T02:12:46.531852+0000","last_undegraded":"2024-09-12T02:12:46.531852+0000","last_fullsized":"2024-09-12T02:12:46.531852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.363251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"95'2","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.586100+0000","last_change":"2024-09-12T02:12:09.735407+0000","last_active":"2024-09-12T02:12:59.586100+0000","last_peered":"2024-09-12T02:12:59.586100+0000","last_clean":"2024-09-12T02:12:59.586100+0000","last_became_active":"2024-09-12T02:12:09.735010+0000","last_became_peered":"2024-09-12T02:12:09.735010+0000","last_unstale":"2024-09-12T02:12:59.586100+0000","last_undegraded":"2024-09-12T02:12:59.586100+0000","last_fullsized":"2024-09-12T02:12:59.586100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:19.457664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.948014+0000","last_change":"2024-09-12T02:12:46.948014+0000","last_active":"2024-09-12T02:12:46.948014+0000","last_peered":"2024-09-12T02:12:46.948014+0000","last_clean":"2024-09-12T02:12:46.948014+0000","last_became_active":"2024-09-12T02:12:46.947557+0000","last_became_peered":"2024-09-12T02:12:46.947557+0000","last_unstale":"2024-09-12T02:12:46.948014+0000","last_undegraded":"2024-09-12T02:12:46.948014+0000","last_fullsized":"2024-09-12T02:12:46.948014+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:25.012171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537959+0000","last_change":"2024-09-12T02:12:12.691186+0000","last_active":"2024-09-12T02:12:46.537959+0000","last_peered":"2024-09-12T02:12:46.537959+0000","last_clean":"2024-09-12T02:12:46.537959+0000","last_became_active":"2024-09-12T02:12:12.690861+0000","last_became_peered":"2024-09-12T02:12:12.690861+0000","last_unstale":"2024-09-12T02:12:46.537959+0000","last_undegraded":"2024-09-12T02:12:46.537959+0000","last_fullsized":"2024-09-12T02:12:46.537959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:07.126197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"95'4","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.584672+0000","last_change":"2024-09-12T02:12:09.665891+0000","last_active":"2024-09-12T02:12:59.584672+0000","last_peered":"2024-09-12T02:12:59.584672+0000","last_clean":"2024-09-12T02:12:59.584672+0000","last_became_active":"2024-09-12T02:12:09.665474+0000","last_became_peered":"2024-09-12T02:12:09.665474+0000","last_unstale":"2024-09-12T02:12:59.584672+0000","last_undegraded":"2024-09-12T02:12:59.584672+0000","last_fullsized":"2024-09-12T02:12:59.584672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:48.118918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539272+0000","last_change":"2024-09-12T02:12:22.732360+0000","last_active":"2024-09-12T02:12:46.539272+0000","last_peered":"2024-09-12T02:12:46.539272+0000","last_clean":"2024-09-12T02:12:46.539272+0000","last_became_active":"2024-09-12T02:12:22.731908+0000","last_became_peered":"2024-09-12T02:12:22.731908+0000","last_unstale":"2024-09-12T02:12:46.539272+0000","last_undegraded":"2024-09-12T02:12:46.539272+0000","last_fullsized":"2024-09-12T02:12:46.539272+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:25.918921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532089+0000","last_change":"2024-09-12T02:12:12.683478+0000","last_active":"2024-09-12T02:12:46.532089+0000","last_peered":"2024-09-12T02:12:46.532089+0000","last_clean":"2024-09-12T02:12:46.532089+0000","last_became_active":"2024-09-12T02:12:12.683112+0000","last_became_peered":"2024-09-12T02:12:12.683112+0000","last_unstale":"2024-09-12T02:12:46.532089+0000","last_undegraded":"2024-09-12T02:12:46.532089+0000","last_fullsized":"2024-09-12T02:12:46.532089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:54.092216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'9","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:16.698015+0000","last_change":"2024-09-12T02:12:09.665209+0000","last_active":"2024-09-12T02:13:16.698015+0000","last_peered":"2024-09-12T02:13:16.698015+0000","last_clean":"2024-09-12T02:13:16.698015+0000","last_became_active":"2024-09-12T02:12:09.664849+0000","last_became_peered":"2024-09-12T02:12:09.664849+0000","last_unstale":"2024-09-12T02:13:16.698015+0000","last_undegraded":"2024-09-12T02:13:16.698015+0000","last_fullsized":"2024-09-12T02:13:16.698015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:31.415245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531361+0000","last_change":"2024-09-12T02:12:23.024293+0000","last_active":"2024-09-12T02:12:46.531361+0000","last_peered":"2024-09-12T02:12:46.531361+0000","last_clean":"2024-09-12T02:12:46.531361+0000","last_became_active":"2024-09-12T02:12:23.022939+0000","last_became_peered":"2024-09-12T02:12:23.022939+0000","last_unstale":"2024-09-12T02:12:46.531361+0000","last_undegraded":"2024-09-12T02:12:46.531361+0000","last_fullsized":"2024-09-12T02:12:46.531361+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:17.425084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993402+0000","last_change":"2024-09-12T02:12:12.696102+0000","last_active":"2024-09-12T02:12:46.993402+0000","last_peered":"2024-09-12T02:12:46.993402+0000","last_clean":"2024-09-12T02:12:46.993402+0000","last_became_active":"2024-09-12T02:12:12.695789+0000","last_became_peered":"2024-09-12T02:12:12.695789+0000","last_unstale":"2024-09-12T02:12:46.993402+0000","last_undegraded":"2024-09-12T02:12:46.993402+0000","last_fullsized":"2024-09-12T02:12:46.993402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.674070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"95'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.588975+0000","last_change":"2024-09-12T02:12:09.736807+0000","last_active":"2024-09-12T02:12:59.588975+0000","last_peered":"2024-09-12T02:12:59.588975+0000","last_clean":"2024-09-12T02:12:59.588975+0000","last_became_active":"2024-09-12T02:12:09.736351+0000","last_became_peered":"2024-09-12T02:12:09.736351+0000","last_unstale":"2024-09-12T02:12:59.588975+0000","last_undegraded":"2024-09-12T02:12:59.588975+0000","last_fullsized":"2024-09-12T02:12:59.588975+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:14.228251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536399+0000","last_change":"2024-09-12T02:12:22.738679+0000","last_active":"2024-09-12T02:12:46.536399+0000","last_peered":"2024-09-12T02:12:46.536399+0000","last_clean":"2024-09-12T02:12:46.536399+0000","last_became_active":"2024-09-12T02:12:22.738221+0000","last_became_peered":"2024-09-12T02:12:22.738221+0000","last_unstale":"2024-09-12T02:12:46.536399+0000","last_undegraded":"2024-09-12T02:12:46.536399+0000","last_fullsized":"2024-09-12T02:12:46.536399+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:41.143026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535192+0000","last_change":"2024-09-12T02:12:12.685853+0000","last_active":"2024-09-12T02:12:46.535192+0000","last_peered":"2024-09-12T02:12:46.535192+0000","last_clean":"2024-09-12T02:12:46.535192+0000","last_became_active":"2024-09-12T02:12:12.685537+0000","last_became_peered":"2024-09-12T02:12:12.685537+0000","last_unstale":"2024-09-12T02:12:46.535192+0000","last_undegraded":"2024-09-12T02:12:46.535192+0000","last_fullsized":"2024-09-12T02:12:46.535192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:01.159056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.947151+0000","last_change":"2024-09-12T02:12:09.736953+0000","last_active":"2024-09-12T02:12:46.947151+0000","last_peered":"2024-09-12T02:12:46.947151+0000","last_clean":"2024-09-12T02:12:46.947151+0000","last_became_active":"2024-09-12T02:12:09.736584+0000","last_became_peered":"2024-09-12T02:12:09.736584+0000","last_unstale":"2024-09-12T02:12:46.947151+0000","last_undegraded":"2024-09-12T02:12:46.947151+0000","last_fullsized":"2024-09-12T02:12:46.947151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:26.923372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531896+0000","last_change":"2024-09-12T02:12:23.023892+0000","last_active":"2024-09-12T02:12:46.531896+0000","last_peered":"2024-09-12T02:12:46.531896+0000","last_clean":"2024-09-12T02:12:46.531896+0000","last_became_active":"2024-09-12T02:12:23.023377+0000","last_became_peered":"2024-09-12T02:12:23.023377+0000","last_unstale":"2024-09-12T02:12:46.531896+0000","last_undegraded":"2024-09-12T02:12:46.531896+0000","last_fullsized":"2024-09-12T02:12:46.531896+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:06.944269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535106+0000","last_change":"2024-09-12T02:12:12.680026+0000","last_active":"2024-09-12T02:12:46.535106+0000","last_peered":"2024-09-12T02:12:46.535106+0000","last_clean":"2024-09-12T02:12:46.535106+0000","last_became_active":"2024-09-12T02:12:12.679683+0000","last_became_peered":"2024-09-12T02:12:12.679683+0000","last_unstale":"2024-09-12T02:12:46.535106+0000","last_undegraded":"2024-09-12T02:12:46.535106+0000","last_fullsized":"2024-09-12T02:12:46.535106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:10.911026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"95'1","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537252+0000","last_change":"2024-09-12T02:12:09.666246+0000","last_active":"2024-09-12T02:12:46.537252+0000","last_peered":"2024-09-12T02:12:46.537252+0000","last_clean":"2024-09-12T02:12:46.537252+0000","last_became_active":"2024-09-12T02:12:09.665095+0000","last_became_peered":"2024-09-12T02:12:09.665095+0000","last_unstale":"2024-09-12T02:12:46.537252+0000","last_undegraded":"2024-09-12T02:12:46.537252+0000","last_fullsized":"2024-09-12T02:12:46.537252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:40.468381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.992715+0000","last_change":"2024-09-12T02:12:22.739778+0000","last_active":"2024-09-12T02:12:46.992715+0000","last_peered":"2024-09-12T02:12:46.992715+0000","last_clean":"2024-09-12T02:12:46.992715+0000","last_became_active":"2024-09-12T02:12:22.739402+0000","last_became_peered":"2024-09-12T02:12:22.739402+0000","last_unstale":"2024-09-12T02:12:46.992715+0000","last_undegraded":"2024-09-12T02:12:46.992715+0000","last_fullsized":"2024-09-12T02:12:46.992715+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:10.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536468+0000","last_change":"2024-09-12T02:12:12.686121+0000","last_active":"2024-09-12T02:12:46.536468+0000","last_peered":"2024-09-12T02:12:46.536468+0000","last_clean":"2024-09-12T02:12:46.536468+0000","last_became_active":"2024-09-12T02:12:12.682209+0000","last_became_peered":"2024-09-12T02:12:12.682209+0000","last_unstale":"2024-09-12T02:12:46.536468+0000","last_undegraded":"2024-09-12T02:12:46.536468+0000","last_fullsized":"2024-09-12T02:12:46.536468+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:28.068552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"95'4","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:15.622562+0000","last_change":"2024-09-12T02:12:09.736820+0000","last_active":"2024-09-12T02:13:15.622562+0000","last_peered":"2024-09-12T02:13:15.622562+0000","last_clean":"2024-09-12T02:13:15.622562+0000","last_became_active":"2024-09-12T02:12:09.736472+0000","last_became_peered":"2024-09-12T02:12:09.736472+0000","last_unstale":"2024-09-12T02:13:15.622562+0000","last_undegraded":"2024-09-12T02:13:15.622562+0000","last_fullsized":"2024-09-12T02:13:15.622562+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:37.753089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993545+0000","last_change":"2024-09-12T02:12:23.024329+0000","last_active":"2024-09-12T02:12:46.993545+0000","last_peered":"2024-09-12T02:12:46.993545+0000","last_clean":"2024-09-12T02:12:46.993545+0000","last_became_active":"2024-09-12T02:12:23.023494+0000","last_became_peered":"2024-09-12T02:12:23.023494+0000","last_unstale":"2024-09-12T02:12:46.993545+0000","last_undegraded":"2024-09-12T02:12:46.993545+0000","last_fullsized":"2024-09-12T02:12:46.993545+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:56.650693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.992900+0000","last_change":"2024-09-12T02:12:12.687520+0000","last_active":"2024-09-12T02:12:46.992900+0000","last_peered":"2024-09-12T02:12:46.992900+0000","last_clean":"2024-09-12T02:12:46.992900+0000","last_became_active":"2024-09-12T02:12:12.687147+0000","last_became_peered":"2024-09-12T02:12:12.687147+0000","last_unstale":"2024-09-12T02:12:46.992900+0000","last_undegraded":"2024-09-12T02:12:46.992900+0000","last_fullsized":"2024-09-12T02:12:46.992900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:40.391396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"95'3","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.586704+0000","last_change":"2024-09-12T02:12:09.668841+0000","last_active":"2024-09-12T02:13:00.586704+0000","last_peered":"2024-09-12T02:13:00.586704+0000","last_clean":"2024-09-12T02:13:00.586704+0000","last_became_active":"2024-09-12T02:12:09.668488+0000","last_became_peered":"2024-09-12T02:12:09.668488+0000","last_unstale":"2024-09-12T02:13:00.586704+0000","last_undegraded":"2024-09-12T02:13:00.586704+0000","last_fullsized":"2024-09-12T02:13:00.586704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:28.259068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535798+0000","last_change":"2024-09-12T02:12:23.023804+0000","last_active":"2024-09-12T02:12:46.535798+0000","last_peered":"2024-09-12T02:12:46.535798+0000","last_clean":"2024-09-12T02:12:46.535798+0000","last_became_active":"2024-09-12T02:12:23.023331+0000","last_became_peered":"2024-09-12T02:12:23.023331+0000","last_unstale":"2024-09-12T02:12:46.535798+0000","last_undegraded":"2024-09-12T02:12:46.535798+0000","last_fullsized":"2024-09-12T02:12:46.535798+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:50.133965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531645+0000","last_change":"2024-09-12T02:12:12.695881+0000","last_active":"2024-09-12T02:12:46.531645+0000","last_peered":"2024-09-12T02:12:46.531645+0000","last_clean":"2024-09-12T02:12:46.531645+0000","last_became_active":"2024-09-12T02:12:12.695321+0000","last_became_peered":"2024-09-12T02:12:12.695321+0000","last_unstale":"2024-09-12T02:12:46.531645+0000","last_undegraded":"2024-09-12T02:12:46.531645+0000","last_fullsized":"2024-09-12T02:12:46.531645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:24.938014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"95'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:02.599585+0000","last_change":"2024-09-12T02:12:09.667252+0000","last_active":"2024-09-12T02:13:02.599585+0000","last_peered":"2024-09-12T02:13:02.599585+0000","last_clean":"2024-09-12T02:13:02.599585+0000","last_became_active":"2024-09-12T02:12:09.666892+0000","last_became_peered":"2024-09-12T02:12:09.666892+0000","last_unstale":"2024-09-12T02:13:02.599585+0000","last_undegraded":"2024-09-12T02:13:02.599585+0000","last_fullsized":"2024-09-12T02:13:02.599585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:52.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":364,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536208+0000","last_change":"2024-09-12T02:10:50.611240+0000","last_active":"2024-09-12T02:12:46.536208+0000","last_peered":"2024-09-12T02:12:46.536208+0000","last_clean":"2024-09-12T02:12:46.536208+0000","last_became_active":"2024-09-12T02:10:50.610769+0000","last_became_peered":"2024-09-12T02:10:50.610769+0000","last_unstale":"2024-09-12T02:12:46.536208+0000","last_undegraded":"2024-09-12T02:12:46.536208+0000","last_fullsized":"2024-09-12T02:12:46.536208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:07.996202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:07.996202+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.996202+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.113749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"95'1","reported_seq":25,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536759+0000","last_change":"2024-09-12T02:12:22.734156+0000","last_active":"2024-09-12T02:12:46.536759+0000","last_peered":"2024-09-12T02:12:46.536759+0000","last_clean":"2024-09-12T02:12:46.536759+0000","last_became_active":"2024-09-12T02:12:22.733679+0000","last_became_peered":"2024-09-12T02:12:22.733679+0000","last_unstale":"2024-09-12T02:12:46.536759+0000","last_undegraded":"2024-09-12T02:12:46.536759+0000","last_fullsized":"2024-09-12T02:12:46.536759+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:38.764902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536590+0000","last_change":"2024-09-12T02:12:12.686957+0000","last_active":"2024-09-12T02:12:46.536590+0000","last_peered":"2024-09-12T02:12:46.536590+0000","last_clean":"2024-09-12T02:12:46.536590+0000","last_became_active":"2024-09-12T02:12:12.686160+0000","last_became_peered":"2024-09-12T02:12:12.686160+0000","last_unstale":"2024-09-12T02:12:46.536590+0000","last_undegraded":"2024-09-12T02:12:46.536590+0000","last_fullsized":"2024-09-12T02:12:46.536590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:29.390487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"95'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.590925+0000","last_change":"2024-09-12T02:12:09.737061+0000","last_active":"2024-09-12T02:13:00.590925+0000","last_peered":"2024-09-12T02:13:00.590925+0000","last_clean":"2024-09-12T02:13:00.590925+0000","last_became_active":"2024-09-12T02:12:09.736550+0000","last_became_peered":"2024-09-12T02:12:09.736550+0000","last_unstale":"2024-09-12T02:13:00.590925+0000","last_undegraded":"2024-09-12T02:13:00.590925+0000","last_fullsized":"2024-09-12T02:13:00.590925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:27.859724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.541038+0000","last_change":"2024-09-12T02:12:22.734200+0000","last_active":"2024-09-12T02:12:46.541038+0000","last_peered":"2024-09-12T02:12:46.541038+0000","last_clean":"2024-09-12T02:12:46.541038+0000","last_became_active":"2024-09-12T02:12:22.733679+0000","last_became_peered":"2024-09-12T02:12:22.733679+0000","last_unstale":"2024-09-12T02:12:46.541038+0000","last_undegraded":"2024-09-12T02:12:46.541038+0000","last_fullsized":"2024-09-12T02:12:46.541038+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:33.308512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536307+0000","last_change":"2024-09-12T02:12:12.691852+0000","last_active":"2024-09-12T02:12:46.536307+0000","last_peered":"2024-09-12T02:12:46.536307+0000","last_clean":"2024-09-12T02:12:46.536307+0000","last_became_active":"2024-09-12T02:12:12.691461+0000","last_became_peered":"2024-09-12T02:12:12.691461+0000","last_unstale":"2024-09-12T02:12:46.536307+0000","last_undegraded":"2024-09-12T02:12:46.536307+0000","last_fullsized":"2024-09-12T02:12:46.536307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:28.587845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'1","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535566+0000","last_change":"2024-09-12T02:12:09.668230+0000","last_active":"2024-09-12T02:12:46.535566+0000","last_peered":"2024-09-12T02:12:46.535566+0000","last_clean":"2024-09-12T02:12:46.535566+0000","last_became_active":"2024-09-12T02:12:09.667802+0000","last_became_peered":"2024-09-12T02:12:09.667802+0000","last_unstale":"2024-09-12T02:12:46.535566+0000","last_undegraded":"2024-09-12T02:12:46.535566+0000","last_fullsized":"2024-09-12T02:12:46.535566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:58.505854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537775+0000","last_change":"2024-09-12T02:12:22.743207+0000","last_active":"2024-09-12T02:12:46.537775+0000","last_peered":"2024-09-12T02:12:46.537775+0000","last_clean":"2024-09-12T02:12:46.537775+0000","last_became_active":"2024-09-12T02:12:22.742820+0000","last_became_peered":"2024-09-12T02:12:22.742820+0000","last_unstale":"2024-09-12T02:12:46.537775+0000","last_undegraded":"2024-09-12T02:12:46.537775+0000","last_fullsized":"2024-09-12T02:12:46.537775+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:09.469987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536452+0000","last_change":"2024-09-12T02:12:12.681966+0000","last_active":"2024-09-12T02:12:46.536452+0000","last_peered":"2024-09-12T02:12:46.536452+0000","last_clean":"2024-09-12T02:12:46.536452+0000","last_became_active":"2024-09-12T02:12:12.681603+0000","last_became_peered":"2024-09-12T02:12:12.681603+0000","last_unstale":"2024-09-12T02:12:46.536452+0000","last_undegraded":"2024-09-12T02:12:46.536452+0000","last_fullsized":"2024-09-12T02:12:46.536452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:00.236008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993528+0000","last_change":"2024-09-12T02:12:09.665620+0000","last_active":"2024-09-12T02:12:46.993528+0000","last_peered":"2024-09-12T02:12:46.993528+0000","last_clean":"2024-09-12T02:12:46.993528+0000","last_became_active":"2024-09-12T02:12:09.665306+0000","last_became_peered":"2024-09-12T02:12:09.665306+0000","last_unstale":"2024-09-12T02:12:46.993528+0000","last_undegraded":"2024-09-12T02:12:46.993528+0000","last_fullsized":"2024-09-12T02:12:46.993528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.910141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536232+0000","last_change":"2024-09-12T02:12:22.732559+0000","last_active":"2024-09-12T02:12:46.536232+0000","last_peered":"2024-09-12T02:12:46.536232+0000","last_clean":"2024-09-12T02:12:46.536232+0000","last_became_active":"2024-09-12T02:12:22.732005+0000","last_became_peered":"2024-09-12T02:12:22.732005+0000","last_unstale":"2024-09-12T02:12:46.536232+0000","last_undegraded":"2024-09-12T02:12:46.536232+0000","last_fullsized":"2024-09-12T02:12:46.536232+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:14.101574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537272+0000","last_change":"2024-09-12T02:12:12.689448+0000","last_active":"2024-09-12T02:12:46.537272+0000","last_peered":"2024-09-12T02:12:46.537272+0000","last_clean":"2024-09-12T02:12:46.537272+0000","last_became_active":"2024-09-12T02:12:12.689112+0000","last_became_peered":"2024-09-12T02:12:12.689112+0000","last_unstale":"2024-09-12T02:12:46.537272+0000","last_undegraded":"2024-09-12T02:12:46.537272+0000","last_fullsized":"2024-09-12T02:12:46.537272+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.802911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"95'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:02.585417+0000","last_change":"2024-09-12T02:12:09.666062+0000","last_active":"2024-09-12T02:13:02.585417+0000","last_peered":"2024-09-12T02:13:02.585417+0000","last_clean":"2024-09-12T02:13:02.585417+0000","last_became_active":"2024-09-12T02:12:09.665632+0000","last_became_peered":"2024-09-12T02:12:09.665632+0000","last_unstale":"2024-09-12T02:13:02.585417+0000","last_undegraded":"2024-09-12T02:13:02.585417+0000","last_fullsized":"2024-09-12T02:13:02.585417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:23.794505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.534894+0000","last_change":"2024-09-12T02:12:22.733650+0000","last_active":"2024-09-12T02:12:46.534894+0000","last_peered":"2024-09-12T02:12:46.534894+0000","last_clean":"2024-09-12T02:12:46.534894+0000","last_became_active":"2024-09-12T02:12:22.733258+0000","last_became_peered":"2024-09-12T02:12:22.733258+0000","last_unstale":"2024-09-12T02:12:46.534894+0000","last_undegraded":"2024-09-12T02:12:46.534894+0000","last_fullsized":"2024-09-12T02:12:46.534894+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:56.885431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535840+0000","last_change":"2024-09-12T02:12:12.687166+0000","last_active":"2024-09-12T02:12:46.535840+0000","last_peered":"2024-09-12T02:12:46.535840+0000","last_clean":"2024-09-12T02:12:46.535840+0000","last_became_active":"2024-09-12T02:12:12.686646+0000","last_became_peered":"2024-09-12T02:12:12.686646+0000","last_unstale":"2024-09-12T02:12:46.535840+0000","last_undegraded":"2024-09-12T02:12:46.535840+0000","last_fullsized":"2024-09-12T02:12:46.535840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.038063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"95'15","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.591073+0000","last_change":"2024-09-12T02:12:46.547259+0000","last_active":"2024-09-12T02:13:00.591073+0000","last_peered":"2024-09-12T02:13:00.591073+0000","last_clean":"2024-09-12T02:13:00.591073+0000","last_became_active":"2024-09-12T02:12:46.540288+0000","last_became_peered":"2024-09-12T02:12:46.540288+0000","last_unstale":"2024-09-12T02:13:00.591073+0000","last_undegraded":"2024-09-12T02:13:00.591073+0000","last_fullsized":"2024-09-12T02:13:00.591073+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:10.251191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.992871+0000","last_change":"2024-09-12T02:12:22.745382+0000","last_active":"2024-09-12T02:12:46.992871+0000","last_peered":"2024-09-12T02:12:46.992871+0000","last_clean":"2024-09-12T02:12:46.992871+0000","last_became_active":"2024-09-12T02:12:22.740850+0000","last_became_peered":"2024-09-12T02:12:22.740850+0000","last_unstale":"2024-09-12T02:12:46.992871+0000","last_undegraded":"2024-09-12T02:12:46.992871+0000","last_fullsized":"2024-09-12T02:12:46.992871+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:40.207459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535998+0000","last_change":"2024-09-12T02:12:12.692745+0000","last_active":"2024-09-12T02:12:46.535998+0000","last_peered":"2024-09-12T02:12:46.535998+0000","last_clean":"2024-09-12T02:12:46.535998+0000","last_became_active":"2024-09-12T02:12:12.692213+0000","last_became_peered":"2024-09-12T02:12:12.692213+0000","last_unstale":"2024-09-12T02:12:46.535998+0000","last_undegraded":"2024-09-12T02:12:46.535998+0000","last_fullsized":"2024-09-12T02:12:46.535998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:11.869094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"95'3","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:14.621877+0000","last_change":"2024-09-12T02:12:09.668239+0000","last_active":"2024-09-12T02:13:14.621877+0000","last_peered":"2024-09-12T02:13:14.621877+0000","last_clean":"2024-09-12T02:13:14.621877+0000","last_became_active":"2024-09-12T02:12:09.667870+0000","last_became_peered":"2024-09-12T02:12:09.667870+0000","last_unstale":"2024-09-12T02:13:14.621877+0000","last_undegraded":"2024-09-12T02:13:14.621877+0000","last_fullsized":"2024-09-12T02:13:14.621877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:55.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.945857+0000","last_change":"2024-09-12T02:12:22.743248+0000","last_active":"2024-09-12T02:12:46.945857+0000","last_peered":"2024-09-12T02:12:46.945857+0000","last_clean":"2024-09-12T02:12:46.945857+0000","last_became_active":"2024-09-12T02:12:22.742861+0000","last_became_peered":"2024-09-12T02:12:22.742861+0000","last_unstale":"2024-09-12T02:12:46.945857+0000","last_undegraded":"2024-09-12T02:12:46.945857+0000","last_fullsized":"2024-09-12T02:12:46.945857+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:07.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536287+0000","last_change":"2024-09-12T02:12:12.687994+0000","last_active":"2024-09-12T02:12:46.536287+0000","last_peered":"2024-09-12T02:12:46.536287+0000","last_clean":"2024-09-12T02:12:46.536287+0000","last_became_active":"2024-09-12T02:12:12.687652+0000","last_became_peered":"2024-09-12T02:12:12.687652+0000","last_unstale":"2024-09-12T02:12:46.536287+0000","last_undegraded":"2024-09-12T02:12:46.536287+0000","last_fullsized":"2024-09-12T02:12:46.536287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:16.168879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"95'3","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.587176+0000","last_change":"2024-09-12T02:12:09.670281+0000","last_active":"2024-09-12T02:12:59.587176+0000","last_peered":"2024-09-12T02:12:59.587176+0000","last_clean":"2024-09-12T02:12:59.587176+0000","last_became_active":"2024-09-12T02:12:09.669953+0000","last_became_peered":"2024-09-12T02:12:09.669953+0000","last_unstale":"2024-09-12T02:12:59.587176+0000","last_undegraded":"2024-09-12T02:12:59.587176+0000","last_fullsized":"2024-09-12T02:12:59.587176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.189591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535519+0000","last_change":"2024-09-12T02:12:22.747973+0000","last_active":"2024-09-12T02:12:46.535519+0000","last_peered":"2024-09-12T02:12:46.535519+0000","last_clean":"2024-09-12T02:12:46.535519+0000","last_became_active":"2024-09-12T02:12:22.747635+0000","last_became_peered":"2024-09-12T02:12:22.747635+0000","last_unstale":"2024-09-12T02:12:46.535519+0000","last_undegraded":"2024-09-12T02:12:46.535519+0000","last_fullsized":"2024-09-12T02:12:46.535519+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:11.310108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993091+0000","last_change":"2024-09-12T02:12:12.697466+0000","last_active":"2024-09-12T02:12:46.993091+0000","last_peered":"2024-09-12T02:12:46.993091+0000","last_clean":"2024-09-12T02:12:46.993091+0000","last_became_active":"2024-09-12T02:12:12.697119+0000","last_became_peered":"2024-09-12T02:12:12.697119+0000","last_unstale":"2024-09-12T02:12:46.993091+0000","last_undegraded":"2024-09-12T02:12:46.993091+0000","last_fullsized":"2024-09-12T02:12:46.993091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:37.396793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"95'6","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.590195+0000","last_change":"2024-09-12T02:12:09.670895+0000","last_active":"2024-09-12T02:13:00.590195+0000","last_peered":"2024-09-12T02:13:00.590195+0000","last_clean":"2024-09-12T02:13:00.590195+0000","last_became_active":"2024-09-12T02:12:09.670301+0000","last_became_peered":"2024-09-12T02:12:09.670301+0000","last_unstale":"2024-09-12T02:13:00.590195+0000","last_undegraded":"2024-09-12T02:13:00.590195+0000","last_fullsized":"2024-09-12T02:13:00.590195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:06.693381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535287+0000","last_change":"2024-09-12T02:12:22.740419+0000","last_active":"2024-09-12T02:12:46.535287+0000","last_peered":"2024-09-12T02:12:46.535287+0000","last_clean":"2024-09-12T02:12:46.535287+0000","last_became_active":"2024-09-12T02:12:22.739966+0000","last_became_peered":"2024-09-12T02:12:22.739966+0000","last_unstale":"2024-09-12T02:12:46.535287+0000","last_undegraded":"2024-09-12T02:12:46.535287+0000","last_fullsized":"2024-09-12T02:12:46.535287+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.556038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532237+0000","last_change":"2024-09-12T02:12:12.681814+0000","last_active":"2024-09-12T02:12:46.532237+0000","last_peered":"2024-09-12T02:12:46.532237+0000","last_clean":"2024-09-12T02:12:46.532237+0000","last_became_active":"2024-09-12T02:12:12.681468+0000","last_became_peered":"2024-09-12T02:12:12.681468+0000","last_unstale":"2024-09-12T02:12:46.532237+0000","last_undegraded":"2024-09-12T02:12:46.532237+0000","last_fullsized":"2024-09-12T02:12:46.532237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:31.964646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'26","reported_seq":101,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:16.625289+0000","last_change":"2024-09-12T02:12:09.664324+0000","last_active":"2024-09-12T02:13:16.625289+0000","last_peered":"2024-09-12T02:13:16.625289+0000","last_clean":"2024-09-12T02:13:16.625289+0000","last_became_active":"2024-09-12T02:12:09.663970+0000","last_became_peered":"2024-09-12T02:12:09.663970+0000","last_unstale":"2024-09-12T02:13:16.625289+0000","last_undegraded":"2024-09-12T02:13:16.625289+0000","last_fullsized":"2024-09-12T02:13:16.625289+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:03.408761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44483,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":61,"num_write":27,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.538629+0000","last_change":"2024-09-12T02:12:46.538194+0000","last_active":"2024-09-12T02:12:46.538629+0000","last_peered":"2024-09-12T02:12:46.538629+0000","last_clean":"2024-09-12T02:12:46.538629+0000","last_became_active":"2024-09-12T02:12:46.537669+0000","last_became_peered":"2024-09-12T02:12:46.537669+0000","last_unstale":"2024-09-12T02:12:46.538629+0000","last_undegraded":"2024-09-12T02:12:46.538629+0000","last_fullsized":"2024-09-12T02:12:46.538629+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:05.394149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.541661+0000","last_change":"2024-09-12T02:12:12.690126+0000","last_active":"2024-09-12T02:12:46.541661+0000","last_peered":"2024-09-12T02:12:46.541661+0000","last_clean":"2024-09-12T02:12:46.541661+0000","last_became_active":"2024-09-12T02:12:12.689821+0000","last_became_peered":"2024-09-12T02:12:12.689821+0000","last_unstale":"2024-09-12T02:12:46.541661+0000","last_undegraded":"2024-09-12T02:12:46.541661+0000","last_fullsized":"2024-09-12T02:12:46.541661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:39.503772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"95'4","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.587144+0000","last_change":"2024-09-12T02:12:09.735571+0000","last_active":"2024-09-12T02:12:59.587144+0000","last_peered":"2024-09-12T02:12:59.587144+0000","last_clean":"2024-09-12T02:12:59.587144+0000","last_became_active":"2024-09-12T02:12:09.735150+0000","last_became_peered":"2024-09-12T02:12:09.735150+0000","last_unstale":"2024-09-12T02:12:59.587144+0000","last_undegraded":"2024-09-12T02:12:59.587144+0000","last_fullsized":"2024-09-12T02:12:59.587144+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:44.840395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.543628+0000","last_change":"2024-09-12T02:12:46.543628+0000","last_active":"2024-09-12T02:12:46.543628+0000","last_peered":"2024-09-12T02:12:46.543628+0000","last_clean":"2024-09-12T02:12:46.543628+0000","last_became_active":"2024-09-12T02:12:46.543158+0000","last_became_peered":"2024-09-12T02:12:46.543158+0000","last_unstale":"2024-09-12T02:12:46.543628+0000","last_undegraded":"2024-09-12T02:12:46.543628+0000","last_fullsized":"2024-09-12T02:12:46.543628+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:05.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.538252+0000","last_change":"2024-09-12T02:12:12.683253+0000","last_active":"2024-09-12T02:12:46.538252+0000","last_peered":"2024-09-12T02:12:46.538252+0000","last_clean":"2024-09-12T02:12:46.538252+0000","last_became_active":"2024-09-12T02:12:12.682761+0000","last_became_peered":"2024-09-12T02:12:12.682761+0000","last_unstale":"2024-09-12T02:12:46.538252+0000","last_undegraded":"2024-09-12T02:12:46.538252+0000","last_fullsized":"2024-09-12T02:12:46.538252+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:56.321662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"95'2","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.586154+0000","last_change":"2024-09-12T02:12:46.542190+0000","last_active":"2024-09-12T02:12:59.586154+0000","last_peered":"2024-09-12T02:12:59.586154+0000","last_clean":"2024-09-12T02:12:59.586154+0000","last_became_active":"2024-09-12T02:12:46.541755+0000","last_became_peered":"2024-09-12T02:12:46.541755+0000","last_unstale":"2024-09-12T02:12:59.586154+0000","last_undegraded":"2024-09-12T02:12:59.586154+0000","last_fullsized":"2024-09-12T02:12:59.586154+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:53.224512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.541107+0000","last_change":"2024-09-12T02:12:46.540620+0000","last_active":"2024-09-12T02:12:46.541107+0000","last_peered":"2024-09-12T02:12:46.541107+0000","last_clean":"2024-09-12T02:12:46.541107+0000","last_became_active":"2024-09-12T02:12:46.540177+0000","last_became_peered":"2024-09-12T02:12:46.540177+0000","last_unstale":"2024-09-12T02:12:46.541107+0000","last_undegraded":"2024-09-12T02:12:46.541107+0000","last_fullsized":"2024-09-12T02:12:46.541107+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:30.701052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.541878+0000","last_change":"2024-09-12T02:12:12.686728+0000","last_active":"2024-09-12T02:12:46.541878+0000","last_peered":"2024-09-12T02:12:46.541878+0000","last_clean":"2024-09-12T02:12:46.541878+0000","last_became_active":"2024-09-12T02:12:12.686159+0000","last_became_peered":"2024-09-12T02:12:12.686159+0000","last_unstale":"2024-09-12T02:12:46.541878+0000","last_undegraded":"2024-09-12T02:12:46.541878+0000","last_fullsized":"2024-09-12T02:12:46.541878+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:51.567343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'3","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:15.620123+0000","last_change":"2024-09-12T02:12:09.665179+0000","last_active":"2024-09-12T02:13:15.620123+0000","last_peered":"2024-09-12T02:13:15.620123+0000","last_clean":"2024-09-12T02:13:15.620123+0000","last_became_active":"2024-09-12T02:12:09.664794+0000","last_became_peered":"2024-09-12T02:12:09.664794+0000","last_unstale":"2024-09-12T02:13:15.620123+0000","last_undegraded":"2024-09-12T02:13:15.620123+0000","last_fullsized":"2024-09-12T02:13:15.620123+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:36.646536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531492+0000","last_change":"2024-09-12T02:12:22.735715+0000","last_active":"2024-09-12T02:12:46.531492+0000","last_peered":"2024-09-12T02:12:46.531492+0000","last_clean":"2024-09-12T02:12:46.531492+0000","last_became_active":"2024-09-12T02:12:22.735341+0000","last_became_peered":"2024-09-12T02:12:22.735341+0000","last_unstale":"2024-09-12T02:12:46.531492+0000","last_undegraded":"2024-09-12T02:12:46.531492+0000","last_fullsized":"2024-09-12T02:12:46.531492+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:36.141512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537857+0000","last_change":"2024-09-12T02:12:22.743286+0000","last_active":"2024-09-12T02:12:46.537857+0000","last_peered":"2024-09-12T02:12:46.537857+0000","last_clean":"2024-09-12T02:12:46.537857+0000","last_became_active":"2024-09-12T02:12:22.742804+0000","last_became_peered":"2024-09-12T02:12:22.742804+0000","last_unstale":"2024-09-12T02:12:46.537857+0000","last_undegraded":"2024-09-12T02:12:46.537857+0000","last_fullsized":"2024-09-12T02:12:46.537857+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:26.133009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.946622+0000","last_change":"2024-09-12T02:12:12.682970+0000","last_active":"2024-09-12T02:12:46.946622+0000","last_peered":"2024-09-12T02:12:46.946622+0000","last_clean":"2024-09-12T02:12:46.946622+0000","last_became_active":"2024-09-12T02:12:12.682625+0000","last_became_peered":"2024-09-12T02:12:12.682625+0000","last_unstale":"2024-09-12T02:12:46.946622+0000","last_undegraded":"2024-09-12T02:12:46.946622+0000","last_fullsized":"2024-09-12T02:12:46.946622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:44.585654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"95'1","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536678+0000","last_change":"2024-09-12T02:12:09.669380+0000","last_active":"2024-09-12T02:12:46.536678+0000","last_peered":"2024-09-12T02:12:46.536678+0000","last_clean":"2024-09-12T02:12:46.536678+0000","last_became_active":"2024-09-12T02:12:09.669052+0000","last_became_peered":"2024-09-12T02:12:09.669052+0000","last_unstale":"2024-09-12T02:12:46.536678+0000","last_undegraded":"2024-09-12T02:12:46.536678+0000","last_fullsized":"2024-09-12T02:12:46.536678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:35.828558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537304+0000","last_change":"2024-09-12T02:12:22.745871+0000","last_active":"2024-09-12T02:12:46.537304+0000","last_peered":"2024-09-12T02:12:46.537304+0000","last_clean":"2024-09-12T02:12:46.537304+0000","last_became_active":"2024-09-12T02:12:22.745370+0000","last_became_peered":"2024-09-12T02:12:22.745370+0000","last_unstale":"2024-09-12T02:12:46.537304+0000","last_undegraded":"2024-09-12T02:12:46.537304+0000","last_fullsized":"2024-09-12T02:12:46.537304+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:20.579806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531491+0000","last_change":"2024-09-12T02:12:12.684996+0000","last_active":"2024-09-12T02:12:46.531491+0000","last_peered":"2024-09-12T02:12:46.531491+0000","last_clean":"2024-09-12T02:12:46.531491+0000","last_became_active":"2024-09-12T02:12:12.684663+0000","last_became_peered":"2024-09-12T02:12:12.684663+0000","last_unstale":"2024-09-12T02:12:46.531491+0000","last_undegraded":"2024-09-12T02:12:46.531491+0000","last_fullsized":"2024-09-12T02:12:46.531491+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:35.054435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"95'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.590695+0000","last_change":"2024-09-12T02:12:09.668939+0000","last_active":"2024-09-12T02:13:00.590695+0000","last_peered":"2024-09-12T02:13:00.590695+0000","last_clean":"2024-09-12T02:13:00.590695+0000","last_became_active":"2024-09-12T02:12:09.665857+0000","last_became_peered":"2024-09-12T02:12:09.665857+0000","last_unstale":"2024-09-12T02:13:00.590695+0000","last_undegraded":"2024-09-12T02:13:00.590695+0000","last_fullsized":"2024-09-12T02:13:00.590695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:42.311387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"95'3","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.590676+0000","last_change":"2024-09-12T02:12:09.666892+0000","last_active":"2024-09-12T02:13:00.590676+0000","last_peered":"2024-09-12T02:13:00.590676+0000","last_clean":"2024-09-12T02:13:00.590676+0000","last_became_active":"2024-09-12T02:12:09.666503+0000","last_became_peered":"2024-09-12T02:12:09.666503+0000","last_unstale":"2024-09-12T02:13:00.590676+0000","last_undegraded":"2024-09-12T02:13:00.590676+0000","last_fullsized":"2024-09-12T02:13:00.590676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:16.010778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.534849+0000","last_change":"2024-09-12T02:12:12.683323+0000","last_active":"2024-09-12T02:12:46.534849+0000","last_peered":"2024-09-12T02:12:46.534849+0000","last_clean":"2024-09-12T02:12:46.534849+0000","last_became_active":"2024-09-12T02:12:12.683017+0000","last_became_peered":"2024-09-12T02:12:12.683017+0000","last_unstale":"2024-09-12T02:12:46.534849+0000","last_undegraded":"2024-09-12T02:12:46.534849+0000","last_fullsized":"2024-09-12T02:12:46.534849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:00.287600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539463+0000","last_change":"2024-09-12T02:12:22.743509+0000","last_active":"2024-09-12T02:12:46.539463+0000","last_peered":"2024-09-12T02:12:46.539463+0000","last_clean":"2024-09-12T02:12:46.539463+0000","last_became_active":"2024-09-12T02:12:22.743185+0000","last_became_peered":"2024-09-12T02:12:22.743185+0000","last_unstale":"2024-09-12T02:12:46.539463+0000","last_undegraded":"2024-09-12T02:12:46.539463+0000","last_fullsized":"2024-09-12T02:12:46.539463+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:44.990530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'6","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:16.621998+0000","last_change":"2024-09-12T02:12:09.672316+0000","last_active":"2024-09-12T02:13:16.621998+0000","last_peered":"2024-09-12T02:13:16.621998+0000","last_clean":"2024-09-12T02:13:16.621998+0000","last_became_active":"2024-09-12T02:12:09.671947+0000","last_became_peered":"2024-09-12T02:12:09.671947+0000","last_unstale":"2024-09-12T02:13:16.621998+0000","last_undegraded":"2024-09-12T02:13:16.621998+0000","last_fullsized":"2024-09-12T02:13:16.621998+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:00.632297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532020+0000","last_change":"2024-09-12T02:12:12.689437+0000","last_active":"2024-09-12T02:12:46.532020+0000","last_peered":"2024-09-12T02:12:46.532020+0000","last_clean":"2024-09-12T02:12:46.532020+0000","last_became_active":"2024-09-12T02:12:12.689123+0000","last_became_peered":"2024-09-12T02:12:12.689123+0000","last_unstale":"2024-09-12T02:12:46.532020+0000","last_undegraded":"2024-09-12T02:12:46.532020+0000","last_fullsized":"2024-09-12T02:12:46.532020+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:07.635955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539587+0000","last_change":"2024-09-12T02:12:22.733472+0000","last_active":"2024-09-12T02:12:46.539587+0000","last_peered":"2024-09-12T02:12:46.539587+0000","last_clean":"2024-09-12T02:12:46.539587+0000","last_became_active":"2024-09-12T02:12:22.733040+0000","last_became_peered":"2024-09-12T02:12:22.733040+0000","last_unstale":"2024-09-12T02:12:46.539587+0000","last_undegraded":"2024-09-12T02:12:46.539587+0000","last_fullsized":"2024-09-12T02:12:46.539587+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:15.556414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536418+0000","last_change":"2024-09-12T02:12:12.684758+0000","last_active":"2024-09-12T02:12:46.536418+0000","last_peered":"2024-09-12T02:12:46.536418+0000","last_clean":"2024-09-12T02:12:46.536418+0000","last_became_active":"2024-09-12T02:12:12.684430+0000","last_became_peered":"2024-09-12T02:12:12.684430+0000","last_unstale":"2024-09-12T02:12:46.536418+0000","last_undegraded":"2024-09-12T02:12:46.536418+0000","last_fullsized":"2024-09-12T02:12:46.536418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:26.209634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539454+0000","last_change":"2024-09-12T02:12:12.688350+0000","last_active":"2024-09-12T02:12:46.539454+0000","last_peered":"2024-09-12T02:12:46.539454+0000","last_clean":"2024-09-12T02:12:46.539454+0000","last_became_active":"2024-09-12T02:12:12.688037+0000","last_became_peered":"2024-09-12T02:12:12.688037+0000","last_unstale":"2024-09-12T02:12:46.539454+0000","last_undegraded":"2024-09-12T02:12:46.539454+0000","last_fullsized":"2024-09-12T02:12:46.539454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:02.133024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539236+0000","last_change":"2024-09-12T02:12:12.686031+0000","last_active":"2024-09-12T02:12:46.539236+0000","last_peered":"2024-09-12T02:12:46.539236+0000","last_clean":"2024-09-12T02:12:46.539236+0000","last_became_active":"2024-09-12T02:12:12.685690+0000","last_became_peered":"2024-09-12T02:12:12.685690+0000","last_unstale":"2024-09-12T02:12:46.539236+0000","last_undegraded":"2024-09-12T02:12:46.539236+0000","last_fullsized":"2024-09-12T02:12:46.539236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:43.406506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537802+0000","last_change":"2024-09-12T02:12:12.695698+0000","last_active":"2024-09-12T02:12:46.537802+0000","last_peered":"2024-09-12T02:12:46.537802+0000","last_clean":"2024-09-12T02:12:46.537802+0000","last_became_active":"2024-09-12T02:12:12.694277+0000","last_became_peered":"2024-09-12T02:12:12.694277+0000","last_unstale":"2024-09-12T02:12:46.537802+0000","last_undegraded":"2024-09-12T02:12:46.537802+0000","last_fullsized":"2024-09-12T02:12:46.537802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:55.013973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993505+0000","last_change":"2024-09-12T02:12:12.699761+0000","last_active":"2024-09-12T02:12:46.993505+0000","last_peered":"2024-09-12T02:12:46.993505+0000","last_clean":"2024-09-12T02:12:46.993505+0000","last_became_active":"2024-09-12T02:12:12.699433+0000","last_became_peered":"2024-09-12T02:12:12.699433+0000","last_unstale":"2024-09-12T02:12:46.993505+0000","last_undegraded":"2024-09-12T02:12:46.993505+0000","last_fullsized":"2024-09-12T02:12:46.993505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:34.863112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537040+0000","last_change":"2024-09-12T02:12:12.683057+0000","last_active":"2024-09-12T02:12:46.537040+0000","last_peered":"2024-09-12T02:12:46.537040+0000","last_clean":"2024-09-12T02:12:46.537040+0000","last_became_active":"2024-09-12T02:12:12.682751+0000","last_became_peered":"2024-09-12T02:12:12.682751+0000","last_unstale":"2024-09-12T02:12:46.537040+0000","last_undegraded":"2024-09-12T02:12:46.537040+0000","last_fullsized":"2024-09-12T02:12:46.537040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:58.642560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539991+0000","last_change":"2024-09-12T02:12:12.682975+0000","last_active":"2024-09-12T02:12:46.539991+0000","last_peered":"2024-09-12T02:12:46.539991+0000","last_clean":"2024-09-12T02:12:46.539991+0000","last_became_active":"2024-09-12T02:12:12.682643+0000","last_became_peered":"2024-09-12T02:12:12.682643+0000","last_unstale":"2024-09-12T02:12:46.539991+0000","last_undegraded":"2024-09-12T02:12:46.539991+0000","last_fullsized":"2024-09-12T02:12:46.539991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:49.859554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532063+0000","last_change":"2024-09-12T02:12:12.680523+0000","last_active":"2024-09-12T02:12:46.532063+0000","last_peered":"2024-09-12T02:12:46.532063+0000","last_clean":"2024-09-12T02:12:46.532063+0000","last_became_active":"2024-09-12T02:12:12.680128+0000","last_became_peered":"2024-09-12T02:12:12.680128+0000","last_unstale":"2024-09-12T02:12:46.532063+0000","last_undegraded":"2024-09-12T02:12:46.532063+0000","last_fullsized":"2024-09-12T02:12:46.532063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:48.660998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536382+0000","last_change":"2024-09-12T02:12:12.687454+0000","last_active":"2024-09-12T02:12:46.536382+0000","last_peered":"2024-09-12T02:12:46.536382+0000","last_clean":"2024-09-12T02:12:46.536382+0000","last_became_active":"2024-09-12T02:12:12.686203+0000","last_became_peered":"2024-09-12T02:12:12.686203+0000","last_unstale":"2024-09-12T02:12:46.536382+0000","last_undegraded":"2024-09-12T02:12:46.536382+0000","last_fullsized":"2024-09-12T02:12:46.536382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:25.029872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531569+0000","last_change":"2024-09-12T02:12:12.683777+0000","last_active":"2024-09-12T02:12:46.531569+0000","last_peered":"2024-09-12T02:12:46.531569+0000","last_clean":"2024-09-12T02:12:46.531569+0000","last_became_active":"2024-09-12T02:12:12.682096+0000","last_became_peered":"2024-09-12T02:12:12.682096+0000","last_unstale":"2024-09-12T02:12:46.531569+0000","last_undegraded":"2024-09-12T02:12:46.531569+0000","last_fullsized":"2024-09-12T02:12:46.531569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:18.624449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.541344+0000","last_change":"2024-09-12T02:12:12.689690+0000","last_active":"2024-09-12T02:12:46.541344+0000","last_peered":"2024-09-12T02:12:46.541344+0000","last_clean":"2024-09-12T02:12:46.541344+0000","last_became_active":"2024-09-12T02:12:12.689339+0000","last_became_peered":"2024-09-12T02:12:12.689339+0000","last_unstale":"2024-09-12T02:12:46.541344+0000","last_undegraded":"2024-09-12T02:12:46.541344+0000","last_fullsized":"2024-09-12T02:12:46.541344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:06.517136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993323+0000","last_change":"2024-09-12T02:12:12.696480+0000","last_active":"2024-09-12T02:12:46.993323+0000","last_peered":"2024-09-12T02:12:46.993323+0000","last_clean":"2024-09-12T02:12:46.993323+0000","last_became_active":"2024-09-12T02:12:12.696163+0000","last_became_peered":"2024-09-12T02:12:12.696163+0000","last_unstale":"2024-09-12T02:12:46.993323+0000","last_undegraded":"2024-09-12T02:12:46.993323+0000","last_fullsized":"2024-09-12T02:12:46.993323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:12.381644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.947998+0000","last_change":"2024-09-12T02:12:46.947998+0000","last_active":"2024-09-12T02:12:46.947998+0000","last_peered":"2024-09-12T02:12:46.947998+0000","last_clean":"2024-09-12T02:12:46.947998+0000","last_became_active":"2024-09-12T02:12:46.947602+0000","last_became_peered":"2024-09-12T02:12:46.947602+0000","last_unstale":"2024-09-12T02:12:46.947998+0000","last_undegraded":"2024-09-12T02:12:46.947998+0000","last_fullsized":"2024-09-12T02:12:46.947998+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:50.123283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539816+0000","last_change":"2024-09-12T02:12:12.689152+0000","last_active":"2024-09-12T02:12:46.539816+0000","last_peered":"2024-09-12T02:12:46.539816+0000","last_clean":"2024-09-12T02:12:46.539816+0000","last_became_active":"2024-09-12T02:12:12.688830+0000","last_became_peered":"2024-09-12T02:12:12.688830+0000","last_unstale":"2024-09-12T02:12:46.539816+0000","last_undegraded":"2024-09-12T02:12:46.539816+0000","last_fullsized":"2024-09-12T02:12:46.539816+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:24.057884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.947306+0000","last_change":"2024-09-12T02:12:12.683089+0000","last_active":"2024-09-12T02:12:46.947306+0000","last_peered":"2024-09-12T02:12:46.947306+0000","last_clean":"2024-09-12T02:12:46.947306+0000","last_became_active":"2024-09-12T02:12:12.682783+0000","last_became_peered":"2024-09-12T02:12:12.682783+0000","last_unstale":"2024-09-12T02:12:46.947306+0000","last_undegraded":"2024-09-12T02:12:46.947306+0000","last_fullsized":"2024-09-12T02:12:46.947306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:07.182958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537652+0000","last_change":"2024-09-12T02:12:12.698373+0000","last_active":"2024-09-12T02:12:46.537652+0000","last_peered":"2024-09-12T02:12:46.537652+0000","last_clean":"2024-09-12T02:12:46.537652+0000","last_became_active":"2024-09-12T02:12:12.698103+0000","last_became_peered":"2024-09-12T02:12:12.698103+0000","last_unstale":"2024-09-12T02:12:46.537652+0000","last_undegraded":"2024-09-12T02:12:46.537652+0000","last_fullsized":"2024-09-12T02:12:46.537652+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:35.776397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.540610+0000","last_change":"2024-09-12T02:12:12.698499+0000","last_active":"2024-09-12T02:12:46.540610+0000","last_peered":"2024-09-12T02:12:46.540610+0000","last_clean":"2024-09-12T02:12:46.540610+0000","last_became_active":"2024-09-12T02:12:12.698103+0000","last_became_peered":"2024-09-12T02:12:12.698103+0000","last_unstale":"2024-09-12T02:12:46.540610+0000","last_undegraded":"2024-09-12T02:12:46.540610+0000","last_fullsized":"2024-09-12T02:12:46.540610+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:59.116424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537444+0000","last_change":"2024-09-12T02:12:12.687918+0000","last_active":"2024-09-12T02:12:46.537444+0000","last_peered":"2024-09-12T02:12:46.537444+0000","last_clean":"2024-09-12T02:12:46.537444+0000","last_became_active":"2024-09-12T02:12:12.684732+0000","last_became_peered":"2024-09-12T02:12:12.684732+0000","last_unstale":"2024-09-12T02:12:46.537444+0000","last_undegraded":"2024-09-12T02:12:46.537444+0000","last_fullsized":"2024-09-12T02:12:46.537444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:06.675996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537431+0000","last_change":"2024-09-12T02:12:12.680429+0000","last_active":"2024-09-12T02:12:46.537431+0000","last_peered":"2024-09-12T02:12:46.537431+0000","last_clean":"2024-09-12T02:12:46.537431+0000","last_became_active":"2024-09-12T02:12:12.680138+0000","last_became_peered":"2024-09-12T02:12:12.680138+0000","last_unstale":"2024-09-12T02:12:46.537431+0000","last_undegraded":"2024-09-12T02:12:46.537431+0000","last_fullsized":"2024-09-12T02:12:46.537431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:16.144740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993305+0000","last_change":"2024-09-12T02:12:12.688403+0000","last_active":"2024-09-12T02:12:46.993305+0000","last_peered":"2024-09-12T02:12:46.993305+0000","last_clean":"2024-09-12T02:12:46.993305+0000","last_became_active":"2024-09-12T02:12:12.686037+0000","last_became_peered":"2024-09-12T02:12:12.686037+0000","last_unstale":"2024-09-12T02:12:46.993305+0000","last_undegraded":"2024-09-12T02:12:46.993305+0000","last_fullsized":"2024-09-12T02:12:46.993305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:01.825875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.533089+0000","last_change":"2024-09-12T02:12:12.677197+0000","last_active":"2024-09-12T02:12:46.533089+0000","last_peered":"2024-09-12T02:12:46.533089+0000","last_clean":"2024-09-12T02:12:46.533089+0000","last_became_active":"2024-09-12T02:12:12.676845+0000","last_became_peered":"2024-09-12T02:12:12.676845+0000","last_unstale":"2024-09-12T02:12:46.533089+0000","last_undegraded":"2024-09-12T02:12:46.533089+0000","last_fullsized":"2024-09-12T02:12:46.533089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:35.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536429+0000","last_change":"2024-09-12T02:12:12.687061+0000","last_active":"2024-09-12T02:12:46.536429+0000","last_peered":"2024-09-12T02:12:46.536429+0000","last_clean":"2024-09-12T02:12:46.536429+0000","last_became_active":"2024-09-12T02:12:12.686616+0000","last_became_peered":"2024-09-12T02:12:12.686616+0000","last_unstale":"2024-09-12T02:12:46.536429+0000","last_undegraded":"2024-09-12T02:12:46.536429+0000","last_fullsized":"2024-09-12T02:12:46.536429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:09.368228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535957+0000","last_change":"2024-09-12T02:12:12.677137+0000","last_active":"2024-09-12T02:12:46.535957+0000","last_peered":"2024-09-12T02:12:46.535957+0000","last_clean":"2024-09-12T02:12:46.535957+0000","last_became_active":"2024-09-12T02:12:12.676818+0000","last_became_peered":"2024-09-12T02:12:12.676818+0000","last_unstale":"2024-09-12T02:12:46.535957+0000","last_undegraded":"2024-09-12T02:12:46.535957+0000","last_fullsized":"2024-09-12T02:12:46.535957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:31.734571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.542138+0000","last_change":"2024-09-12T02:12:12.691436+0000","last_active":"2024-09-12T02:12:46.542138+0000","last_peered":"2024-09-12T02:12:46.542138+0000","last_clean":"2024-09-12T02:12:46.542138+0000","last_became_active":"2024-09-12T02:12:12.691123+0000","last_became_peered":"2024-09-12T02:12:12.691123+0000","last_unstale":"2024-09-12T02:12:46.542138+0000","last_undegraded":"2024-09-12T02:12:46.542138+0000","last_fullsized":"2024-09-12T02:12:46.542138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:40.367825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531441+0000","last_change":"2024-09-12T02:12:12.694662+0000","last_active":"2024-09-12T02:12:46.531441+0000","last_peered":"2024-09-12T02:12:46.531441+0000","last_clean":"2024-09-12T02:12:46.531441+0000","last_became_active":"2024-09-12T02:12:12.693454+0000","last_became_peered":"2024-09-12T02:12:12.693454+0000","last_unstale":"2024-09-12T02:12:46.531441+0000","last_undegraded":"2024-09-12T02:12:46.531441+0000","last_fullsized":"2024-09-12T02:12:46.531441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:14.818573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537146+0000","last_change":"2024-09-12T02:12:12.693045+0000","last_active":"2024-09-12T02:12:46.537146+0000","last_peered":"2024-09-12T02:12:46.537146+0000","last_clean":"2024-09-12T02:12:46.537146+0000","last_became_active":"2024-09-12T02:12:12.692520+0000","last_became_peered":"2024-09-12T02:12:12.692520+0000","last_unstale":"2024-09-12T02:12:46.537146+0000","last_undegraded":"2024-09-12T02:12:46.537146+0000","last_fullsized":"2024-09-12T02:12:46.537146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.613656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535261+0000","last_change":"2024-09-12T02:12:12.677141+0000","last_active":"2024-09-12T02:12:46.535261+0000","last_peered":"2024-09-12T02:12:46.535261+0000","last_clean":"2024-09-12T02:12:46.535261+0000","last_became_active":"2024-09-12T02:12:12.676828+0000","last_became_peered":"2024-09-12T02:12:12.676828+0000","last_unstale":"2024-09-12T02:12:46.535261+0000","last_undegraded":"2024-09-12T02:12:46.535261+0000","last_fullsized":"2024-09-12T02:12:46.535261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:51.355531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532025+0000","last_change":"2024-09-12T02:12:12.688588+0000","last_active":"2024-09-12T02:12:46.532025+0000","last_peered":"2024-09-12T02:12:46.532025+0000","last_clean":"2024-09-12T02:12:46.532025+0000","last_became_active":"2024-09-12T02:12:12.688275+0000","last_became_peered":"2024-09-12T02:12:12.688275+0000","last_unstale":"2024-09-12T02:12:46.532025+0000","last_undegraded":"2024-09-12T02:12:46.532025+0000","last_fullsized":"2024-09-12T02:12:46.532025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:28.540937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532691+0000","last_change":"2024-09-12T02:12:12.685463+0000","last_active":"2024-09-12T02:12:46.532691+0000","last_peered":"2024-09-12T02:12:46.532691+0000","last_clean":"2024-09-12T02:12:46.532691+0000","last_became_active":"2024-09-12T02:12:12.684219+0000","last_became_peered":"2024-09-12T02:12:12.684219+0000","last_unstale":"2024-09-12T02:12:46.532691+0000","last_undegraded":"2024-09-12T02:12:46.532691+0000","last_fullsized":"2024-09-12T02:12:46.532691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:09.512781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537745+0000","last_change":"2024-09-12T02:12:12.699531+0000","last_active":"2024-09-12T02:12:46.537745+0000","last_peered":"2024-09-12T02:12:46.537745+0000","last_clean":"2024-09-12T02:12:46.537745+0000","last_became_active":"2024-09-12T02:12:12.691874+0000","last_became_peered":"2024-09-12T02:12:12.691874+0000","last_unstale":"2024-09-12T02:12:46.537745+0000","last_undegraded":"2024-09-12T02:12:46.537745+0000","last_fullsized":"2024-09-12T02:12:46.537745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:32.484656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537889+0000","last_change":"2024-09-12T02:12:12.691135+0000","last_active":"2024-09-12T02:12:46.537889+0000","last_peered":"2024-09-12T02:12:46.537889+0000","last_clean":"2024-09-12T02:12:46.537889+0000","last_became_active":"2024-09-12T02:12:12.690812+0000","last_became_peered":"2024-09-12T02:12:12.690812+0000","last_unstale":"2024-09-12T02:12:46.537889+0000","last_undegraded":"2024-09-12T02:12:46.537889+0000","last_fullsized":"2024-09-12T02:12:46.537889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:50.835731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537531+0000","last_change":"2024-09-12T02:12:12.697439+0000","last_active":"2024-09-12T02:12:46.537531+0000","last_peered":"2024-09-12T02:12:46.537531+0000","last_clean":"2024-09-12T02:12:46.537531+0000","last_became_active":"2024-09-12T02:12:12.697142+0000","last_became_peered":"2024-09-12T02:12:12.697142+0000","last_unstale":"2024-09-12T02:12:46.537531+0000","last_undegraded":"2024-09-12T02:12:46.537531+0000","last_fullsized":"2024-09-12T02:12:46.537531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:12.032053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":48486,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":157,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":145458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449115,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":538446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678049,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37056,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708096,"statfs":{"total":95995035648,"available":95957090304,"internally_reserved":0,"allocated":1753088,"data_stored":1170085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841574,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1101824,"data_stored":542666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103213,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":538378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332145,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1691648,"data_stored":1134401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495670,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":533746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757309,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28684,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716468,"statfs":{"total":95995035648,"available":95965663232,"internally_reserved":0,"allocated":1699840,"data_stored":1129989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920834,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1089536,"data_stored":538396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":533940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28148,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717004,"statfs":{"total":95995035648,"available":95966212096,"internally_reserved":0,"allocated":1150976,"data_stored":579882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36444,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708708,"statfs":{"total":95995035648,"available":95957716992,"internally_reserved":0,"allocated":1126400,"data_stored":578139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1101824,"data_stored":535134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":44483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":46226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":46061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:13:23.857 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:13:24.223 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:24.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.832+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1648261047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8c8109120 msgr2=0x7fc8c8110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:24.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.832+0000 7fc8cfc00640 1 --2- 172.21.15.110:0/1648261047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8c8109120 0x7fc8c8110ca0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009ca0 tx=0x7fc8c002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:13:24.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.832+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1648261047 shutdown_connections 2024-09-12T02:13:24.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.832+0000 7fc8cfc00640 1 --2- 172.21.15.110:0/1648261047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8c8109120 0x7fc8c8110ca0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:24.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.832+0000 7fc8cfc00640 1 --2- 172.21.15.110:0/1648261047 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8c81049a0 0x7fc8c81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:24.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.832+0000 7fc8cfc00640 1 --2- 172.21.15.110:0/1648261047 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c8103ff0 0x7fc8c81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.832+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1648261047 >> 172.21.15.110:0/1648261047 conn(0x7fc8c80ffa90 msgr2=0x7fc8c8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.832+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1648261047 shutdown_connections 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.832+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1648261047 wait complete. 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.833+0000 7fc8cfc00640 1 Processor -- start 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.833+0000 7fc8cfc00640 1 -- start start 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.833+0000 7fc8cfc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8c8103ff0 0x7fc8c819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.833+0000 7fc8cfc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8c81049a0 0x7fc8c819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.833+0000 7fc8cfc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c8109120 0x7fc8c819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.833+0000 7fc8cfc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c8114150 con 0x7fc8c81049a0 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.833+0000 7fc8cfc00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c8113fd0 con 0x7fc8c8109120 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.833+0000 7fc8cfc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c81142d0 con 0x7fc8c8103ff0 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.834+0000 7fc8cd200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8c8103ff0 0x7fc8c819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:24.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.834+0000 7fc8cd200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8c8103ff0 0x7fc8c819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:43600/0 (socket says 172.21.15.110:43600) 2024-09-12T02:13:24.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.834+0000 7fc8cd200640 1 -- 172.21.15.110:0/1935920636 learned_addr learned my addr 172.21.15.110:0/1935920636 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:24.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.834+0000 7fc8c7e00640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8c81049a0 0x7fc8c819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:24.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.834+0000 7fc8cdc00640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c8109120 0x7fc8c819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:24.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.834+0000 7fc8cd200640 1 -- 172.21.15.110:0/1935920636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c8109120 msgr2=0x7fc8c819ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:24.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.834+0000 7fc8cd200640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c8109120 0x7fc8c819ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:24.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.834+0000 7fc8cd200640 1 -- 172.21.15.110:0/1935920636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8c81049a0 msgr2=0x7fc8c819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:24.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.834+0000 7fc8cd200640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8c81049a0 0x7fc8c819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:24.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.834+0000 7fc8cd200640 1 -- 172.21.15.110:0/1935920636 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c819f560 con 0x7fc8c8103ff0 2024-09-12T02:13:24.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.834+0000 7fc8cd200640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8c8103ff0 0x7fc8c819a5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00e9f0 tx=0x7fc8bc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:24.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.835+0000 7fc8c5600640 1 -- 172.21.15.110:0/1935920636 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00cd80 con 0x7fc8c8103ff0 2024-09-12T02:13:24.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.835+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1935920636 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c819f850 con 0x7fc8c8103ff0 2024-09-12T02:13:24.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.835+0000 7fc8c5600640 1 -- 172.21.15.110:0/1935920636 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8bc010910 con 0x7fc8c8103ff0 2024-09-12T02:13:24.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.835+0000 7fc8c5600640 1 -- 172.21.15.110:0/1935920636 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0188f0 con 0x7fc8c8103ff0 2024-09-12T02:13:24.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.835+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1935920636 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c81a7130 con 0x7fc8c8103ff0 2024-09-12T02:13:24.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.836+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1935920636 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c81043d0 con 0x7fc8c8103ff0 2024-09-12T02:13:24.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.838+0000 7fc8c5600640 1 -- 172.21.15.110:0/1935920636 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc8bc010ac0 con 0x7fc8c8103ff0 2024-09-12T02:13:24.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.839+0000 7fc8c5600640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc8b00a2c10 0x7fc8b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:24.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.839+0000 7fc8c5600640 1 -- 172.21.15.110:0/1935920636 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7fc8bc0cfd30 con 0x7fc8c8103ff0 2024-09-12T02:13:24.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.840+0000 7fc8c7e00640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc8b00a2c10 0x7fc8b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:24.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.840+0000 7fc8c7e00640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc8b00a2c10 0x7fc8b00a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80ffeb0 tx=0x7fc8b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:24.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:24.841+0000 7fc8c5600640 1 -- 172.21.15.110:0/1935920636 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc8bc09c140 con 0x7fc8c8103ff0 2024-09-12T02:13:24.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:24 smithi136 ceph-mon[35814]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:13:24.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:24 smithi136 ceph-mon[35814]: pgmap v344: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-12T02:13:24.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:24 smithi110 ceph-mon[30548]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:13:24.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:24 smithi110 ceph-mon[30548]: pgmap v344: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-12T02:13:25.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.013+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1935920636 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc8c8100d90 con 0x7fc8b00a2c10 2024-09-12T02:13:25.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.021+0000 7fc8c5600640 1 -- 172.21.15.110:0/1935920636 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340364 (secure 0 0 0) 0x7fc8c8100d90 con 0x7fc8b00a2c10 2024-09-12T02:13:25.029 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:13:25.030 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-09-12T02:13:25.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.026+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1935920636 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc8b00a2c10 msgr2=0x7fc8b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:25.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.026+0000 7fc8cfc00640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc8b00a2c10 0x7fc8b00a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80ffeb0 tx=0x7fc8b4005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:25.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.026+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1935920636 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8c8103ff0 msgr2=0x7fc8c819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:25.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.026+0000 7fc8cfc00640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8c8103ff0 0x7fc8c819a5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00e9f0 tx=0x7fc8bc00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:13:25.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.026+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1935920636 shutdown_connections 2024-09-12T02:13:25.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.026+0000 7fc8cfc00640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc8b00a2c10 0x7fc8b00a50d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:25.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.026+0000 7fc8cfc00640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8c8109120 0x7fc8c819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:25.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.026+0000 7fc8cfc00640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8c81049a0 0x7fc8c819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:25.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.026+0000 7fc8cfc00640 1 --2- 172.21.15.110:0/1935920636 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc8c8103ff0 0x7fc8c819a5b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:25.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.026+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1935920636 >> 172.21.15.110:0/1935920636 conn(0x7fc8c80ffa90 msgr2=0x7fc8c8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:25.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.026+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1935920636 shutdown_connections 2024-09-12T02:13:25.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:25.026+0000 7fc8cfc00640 1 -- 172.21.15.110:0/1935920636 wait complete. 2024-09-12T02:13:25.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:24 smithi115 ceph-mon[35351]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:13:25.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:24 smithi115 ceph-mon[35351]: pgmap v344: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-12T02:13:26.133 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-09-12T02:13:23.463558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651354,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":282,"num_read_kb":256,"num_write":343,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":393112,"kb_used_data":14744,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124548712,"statfs":{"total":1151940427776,"available":1151537881088,"internally_reserved":0,"allocated":15097856,"data_stored":8390000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53532,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":99,"num_write":31,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003245"},"pg_stats":[{"pgid":"2.1f","version":"95'9","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.589421+0000","last_change":"2024-09-12T02:12:09.666492+0000","last_active":"2024-09-12T02:13:00.589421+0000","last_peered":"2024-09-12T02:13:00.589421+0000","last_clean":"2024-09-12T02:13:00.589421+0000","last_became_active":"2024-09-12T02:12:09.666198+0000","last_became_peered":"2024-09-12T02:12:09.666198+0000","last_unstale":"2024-09-12T02:13:00.589421+0000","last_undegraded":"2024-09-12T02:13:00.589421+0000","last_fullsized":"2024-09-12T02:13:00.589421+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:01.779452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531924+0000","last_change":"2024-09-12T02:12:12.695888+0000","last_active":"2024-09-12T02:12:46.531924+0000","last_peered":"2024-09-12T02:12:46.531924+0000","last_clean":"2024-09-12T02:12:46.531924+0000","last_became_active":"2024-09-12T02:12:12.695065+0000","last_became_peered":"2024-09-12T02:12:12.695065+0000","last_unstale":"2024-09-12T02:12:46.531924+0000","last_undegraded":"2024-09-12T02:12:46.531924+0000","last_fullsized":"2024-09-12T02:12:46.531924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:09.799039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539140+0000","last_change":"2024-09-12T02:12:22.738585+0000","last_active":"2024-09-12T02:12:46.539140+0000","last_peered":"2024-09-12T02:12:46.539140+0000","last_clean":"2024-09-12T02:12:46.539140+0000","last_became_active":"2024-09-12T02:12:22.738174+0000","last_became_peered":"2024-09-12T02:12:22.738174+0000","last_unstale":"2024-09-12T02:12:46.539140+0000","last_undegraded":"2024-09-12T02:12:46.539140+0000","last_fullsized":"2024-09-12T02:12:46.539140+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:00.875256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"95'2","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532164+0000","last_change":"2024-09-12T02:12:09.735005+0000","last_active":"2024-09-12T02:12:46.532164+0000","last_peered":"2024-09-12T02:12:46.532164+0000","last_clean":"2024-09-12T02:12:46.532164+0000","last_became_active":"2024-09-12T02:12:09.734590+0000","last_became_peered":"2024-09-12T02:12:09.734590+0000","last_unstale":"2024-09-12T02:12:46.532164+0000","last_undegraded":"2024-09-12T02:12:46.532164+0000","last_fullsized":"2024-09-12T02:12:46.532164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:17.079183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.538251+0000","last_change":"2024-09-12T02:12:12.692688+0000","last_active":"2024-09-12T02:12:46.538251+0000","last_peered":"2024-09-12T02:12:46.538251+0000","last_clean":"2024-09-12T02:12:46.538251+0000","last_became_active":"2024-09-12T02:12:12.692252+0000","last_became_peered":"2024-09-12T02:12:12.692252+0000","last_unstale":"2024-09-12T02:12:46.538251+0000","last_undegraded":"2024-09-12T02:12:46.538251+0000","last_fullsized":"2024-09-12T02:12:46.538251+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:40.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531995+0000","last_change":"2024-09-12T02:12:22.738074+0000","last_active":"2024-09-12T02:12:46.531995+0000","last_peered":"2024-09-12T02:12:46.531995+0000","last_clean":"2024-09-12T02:12:46.531995+0000","last_became_active":"2024-09-12T02:12:22.737692+0000","last_became_peered":"2024-09-12T02:12:22.737692+0000","last_unstale":"2024-09-12T02:12:46.531995+0000","last_undegraded":"2024-09-12T02:12:46.531995+0000","last_fullsized":"2024-09-12T02:12:46.531995+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:04.003426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"95'4","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.589299+0000","last_change":"2024-09-12T02:12:09.670228+0000","last_active":"2024-09-12T02:13:00.589299+0000","last_peered":"2024-09-12T02:13:00.589299+0000","last_clean":"2024-09-12T02:13:00.589299+0000","last_became_active":"2024-09-12T02:12:09.669517+0000","last_became_peered":"2024-09-12T02:12:09.669517+0000","last_unstale":"2024-09-12T02:13:00.589299+0000","last_undegraded":"2024-09-12T02:13:00.589299+0000","last_fullsized":"2024-09-12T02:13:00.589299+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:49.547787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.541549+0000","last_change":"2024-09-12T02:12:12.693797+0000","last_active":"2024-09-12T02:12:46.541549+0000","last_peered":"2024-09-12T02:12:46.541549+0000","last_clean":"2024-09-12T02:12:46.541549+0000","last_became_active":"2024-09-12T02:12:12.692757+0000","last_became_peered":"2024-09-12T02:12:12.692757+0000","last_unstale":"2024-09-12T02:12:46.541549+0000","last_undegraded":"2024-09-12T02:12:46.541549+0000","last_fullsized":"2024-09-12T02:12:46.541549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:04.738832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532326+0000","last_change":"2024-09-12T02:12:22.742804+0000","last_active":"2024-09-12T02:12:46.532326+0000","last_peered":"2024-09-12T02:12:46.532326+0000","last_clean":"2024-09-12T02:12:46.532326+0000","last_became_active":"2024-09-12T02:12:22.742478+0000","last_became_peered":"2024-09-12T02:12:22.742478+0000","last_unstale":"2024-09-12T02:12:46.532326+0000","last_undegraded":"2024-09-12T02:12:46.532326+0000","last_fullsized":"2024-09-12T02:12:46.532326+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:25.406069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532754+0000","last_change":"2024-09-12T02:12:09.669360+0000","last_active":"2024-09-12T02:12:46.532754+0000","last_peered":"2024-09-12T02:12:46.532754+0000","last_clean":"2024-09-12T02:12:46.532754+0000","last_became_active":"2024-09-12T02:12:09.668908+0000","last_became_peered":"2024-09-12T02:12:09.668908+0000","last_unstale":"2024-09-12T02:12:46.532754+0000","last_undegraded":"2024-09-12T02:12:46.532754+0000","last_fullsized":"2024-09-12T02:12:46.532754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:48.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.542028+0000","last_change":"2024-09-12T02:12:46.542028+0000","last_active":"2024-09-12T02:12:46.542028+0000","last_peered":"2024-09-12T02:12:46.542028+0000","last_clean":"2024-09-12T02:12:46.542028+0000","last_became_active":"2024-09-12T02:12:46.541630+0000","last_became_peered":"2024-09-12T02:12:46.541630+0000","last_unstale":"2024-09-12T02:12:46.542028+0000","last_undegraded":"2024-09-12T02:12:46.542028+0000","last_fullsized":"2024-09-12T02:12:46.542028+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:08.641424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532137+0000","last_change":"2024-09-12T02:12:22.738663+0000","last_active":"2024-09-12T02:12:46.532137+0000","last_peered":"2024-09-12T02:12:46.532137+0000","last_clean":"2024-09-12T02:12:46.532137+0000","last_became_active":"2024-09-12T02:12:22.738280+0000","last_became_peered":"2024-09-12T02:12:22.738280+0000","last_unstale":"2024-09-12T02:12:46.532137+0000","last_undegraded":"2024-09-12T02:12:46.532137+0000","last_fullsized":"2024-09-12T02:12:46.532137+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:44.271539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537014+0000","last_change":"2024-09-12T02:12:12.687131+0000","last_active":"2024-09-12T02:12:46.537014+0000","last_peered":"2024-09-12T02:12:46.537014+0000","last_clean":"2024-09-12T02:12:46.537014+0000","last_became_active":"2024-09-12T02:12:12.686793+0000","last_became_peered":"2024-09-12T02:12:12.686793+0000","last_unstale":"2024-09-12T02:12:46.537014+0000","last_undegraded":"2024-09-12T02:12:46.537014+0000","last_fullsized":"2024-09-12T02:12:46.537014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:58.370130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"95'4","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.586790+0000","last_change":"2024-09-12T02:12:46.550259+0000","last_active":"2024-09-12T02:12:59.586790+0000","last_peered":"2024-09-12T02:12:59.586790+0000","last_clean":"2024-09-12T02:12:59.586790+0000","last_became_active":"2024-09-12T02:12:46.543047+0000","last_became_peered":"2024-09-12T02:12:46.543047+0000","last_unstale":"2024-09-12T02:12:59.586790+0000","last_undegraded":"2024-09-12T02:12:59.586790+0000","last_fullsized":"2024-09-12T02:12:59.586790+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.359689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532503+0000","last_change":"2024-09-12T02:12:23.023792+0000","last_active":"2024-09-12T02:12:46.532503+0000","last_peered":"2024-09-12T02:12:46.532503+0000","last_clean":"2024-09-12T02:12:46.532503+0000","last_became_active":"2024-09-12T02:12:23.023337+0000","last_became_peered":"2024-09-12T02:12:23.023337+0000","last_unstale":"2024-09-12T02:12:46.532503+0000","last_undegraded":"2024-09-12T02:12:46.532503+0000","last_fullsized":"2024-09-12T02:12:46.532503+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:01.859092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531648+0000","last_change":"2024-09-12T02:12:12.683615+0000","last_active":"2024-09-12T02:12:46.531648+0000","last_peered":"2024-09-12T02:12:46.531648+0000","last_clean":"2024-09-12T02:12:46.531648+0000","last_became_active":"2024-09-12T02:12:12.683279+0000","last_became_peered":"2024-09-12T02:12:12.683279+0000","last_unstale":"2024-09-12T02:12:46.531648+0000","last_undegraded":"2024-09-12T02:12:46.531648+0000","last_fullsized":"2024-09-12T02:12:46.531648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:10.819995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"95'1","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539290+0000","last_change":"2024-09-12T02:12:09.667600+0000","last_active":"2024-09-12T02:12:46.539290+0000","last_peered":"2024-09-12T02:12:46.539290+0000","last_clean":"2024-09-12T02:12:46.539290+0000","last_became_active":"2024-09-12T02:12:09.666053+0000","last_became_peered":"2024-09-12T02:12:09.666053+0000","last_unstale":"2024-09-12T02:12:46.539290+0000","last_undegraded":"2024-09-12T02:12:46.539290+0000","last_fullsized":"2024-09-12T02:12:46.539290+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:01.597906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"95'1","reported_seq":25,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532545+0000","last_change":"2024-09-12T02:12:22.748946+0000","last_active":"2024-09-12T02:12:46.532545+0000","last_peered":"2024-09-12T02:12:46.532545+0000","last_clean":"2024-09-12T02:12:46.532545+0000","last_became_active":"2024-09-12T02:12:22.748163+0000","last_became_peered":"2024-09-12T02:12:22.748163+0000","last_unstale":"2024-09-12T02:12:46.532545+0000","last_undegraded":"2024-09-12T02:12:46.532545+0000","last_fullsized":"2024-09-12T02:12:46.532545+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:49.560905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536543+0000","last_change":"2024-09-12T02:12:12.692275+0000","last_active":"2024-09-12T02:12:46.536543+0000","last_peered":"2024-09-12T02:12:46.536543+0000","last_clean":"2024-09-12T02:12:46.536543+0000","last_became_active":"2024-09-12T02:12:12.691932+0000","last_became_peered":"2024-09-12T02:12:12.691932+0000","last_unstale":"2024-09-12T02:12:46.536543+0000","last_undegraded":"2024-09-12T02:12:46.536543+0000","last_fullsized":"2024-09-12T02:12:46.536543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:01.922677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"95'3","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.586917+0000","last_change":"2024-09-12T02:12:09.665190+0000","last_active":"2024-09-12T02:12:59.586917+0000","last_peered":"2024-09-12T02:12:59.586917+0000","last_clean":"2024-09-12T02:12:59.586917+0000","last_became_active":"2024-09-12T02:12:09.664805+0000","last_became_peered":"2024-09-12T02:12:09.664805+0000","last_unstale":"2024-09-12T02:12:59.586917+0000","last_undegraded":"2024-09-12T02:12:59.586917+0000","last_fullsized":"2024-09-12T02:12:59.586917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:41.770072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.946089+0000","last_change":"2024-09-12T02:12:22.744555+0000","last_active":"2024-09-12T02:12:46.946089+0000","last_peered":"2024-09-12T02:12:46.946089+0000","last_clean":"2024-09-12T02:12:46.946089+0000","last_became_active":"2024-09-12T02:12:22.742530+0000","last_became_peered":"2024-09-12T02:12:22.742530+0000","last_unstale":"2024-09-12T02:12:46.946089+0000","last_undegraded":"2024-09-12T02:12:46.946089+0000","last_fullsized":"2024-09-12T02:12:46.946089+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:45.737376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531852+0000","last_change":"2024-09-12T02:12:12.681891+0000","last_active":"2024-09-12T02:12:46.531852+0000","last_peered":"2024-09-12T02:12:46.531852+0000","last_clean":"2024-09-12T02:12:46.531852+0000","last_became_active":"2024-09-12T02:12:12.681522+0000","last_became_peered":"2024-09-12T02:12:12.681522+0000","last_unstale":"2024-09-12T02:12:46.531852+0000","last_undegraded":"2024-09-12T02:12:46.531852+0000","last_fullsized":"2024-09-12T02:12:46.531852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.363251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"95'2","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.586100+0000","last_change":"2024-09-12T02:12:09.735407+0000","last_active":"2024-09-12T02:12:59.586100+0000","last_peered":"2024-09-12T02:12:59.586100+0000","last_clean":"2024-09-12T02:12:59.586100+0000","last_became_active":"2024-09-12T02:12:09.735010+0000","last_became_peered":"2024-09-12T02:12:09.735010+0000","last_unstale":"2024-09-12T02:12:59.586100+0000","last_undegraded":"2024-09-12T02:12:59.586100+0000","last_fullsized":"2024-09-12T02:12:59.586100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:19.457664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.948014+0000","last_change":"2024-09-12T02:12:46.948014+0000","last_active":"2024-09-12T02:12:46.948014+0000","last_peered":"2024-09-12T02:12:46.948014+0000","last_clean":"2024-09-12T02:12:46.948014+0000","last_became_active":"2024-09-12T02:12:46.947557+0000","last_became_peered":"2024-09-12T02:12:46.947557+0000","last_unstale":"2024-09-12T02:12:46.948014+0000","last_undegraded":"2024-09-12T02:12:46.948014+0000","last_fullsized":"2024-09-12T02:12:46.948014+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:25.012171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537959+0000","last_change":"2024-09-12T02:12:12.691186+0000","last_active":"2024-09-12T02:12:46.537959+0000","last_peered":"2024-09-12T02:12:46.537959+0000","last_clean":"2024-09-12T02:12:46.537959+0000","last_became_active":"2024-09-12T02:12:12.690861+0000","last_became_peered":"2024-09-12T02:12:12.690861+0000","last_unstale":"2024-09-12T02:12:46.537959+0000","last_undegraded":"2024-09-12T02:12:46.537959+0000","last_fullsized":"2024-09-12T02:12:46.537959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:07.126197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"95'4","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.584672+0000","last_change":"2024-09-12T02:12:09.665891+0000","last_active":"2024-09-12T02:12:59.584672+0000","last_peered":"2024-09-12T02:12:59.584672+0000","last_clean":"2024-09-12T02:12:59.584672+0000","last_became_active":"2024-09-12T02:12:09.665474+0000","last_became_peered":"2024-09-12T02:12:09.665474+0000","last_unstale":"2024-09-12T02:12:59.584672+0000","last_undegraded":"2024-09-12T02:12:59.584672+0000","last_fullsized":"2024-09-12T02:12:59.584672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:48.118918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539272+0000","last_change":"2024-09-12T02:12:22.732360+0000","last_active":"2024-09-12T02:12:46.539272+0000","last_peered":"2024-09-12T02:12:46.539272+0000","last_clean":"2024-09-12T02:12:46.539272+0000","last_became_active":"2024-09-12T02:12:22.731908+0000","last_became_peered":"2024-09-12T02:12:22.731908+0000","last_unstale":"2024-09-12T02:12:46.539272+0000","last_undegraded":"2024-09-12T02:12:46.539272+0000","last_fullsized":"2024-09-12T02:12:46.539272+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:25.918921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532089+0000","last_change":"2024-09-12T02:12:12.683478+0000","last_active":"2024-09-12T02:12:46.532089+0000","last_peered":"2024-09-12T02:12:46.532089+0000","last_clean":"2024-09-12T02:12:46.532089+0000","last_became_active":"2024-09-12T02:12:12.683112+0000","last_became_peered":"2024-09-12T02:12:12.683112+0000","last_unstale":"2024-09-12T02:12:46.532089+0000","last_undegraded":"2024-09-12T02:12:46.532089+0000","last_fullsized":"2024-09-12T02:12:46.532089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:54.092216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'9","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:16.698015+0000","last_change":"2024-09-12T02:12:09.665209+0000","last_active":"2024-09-12T02:13:16.698015+0000","last_peered":"2024-09-12T02:13:16.698015+0000","last_clean":"2024-09-12T02:13:16.698015+0000","last_became_active":"2024-09-12T02:12:09.664849+0000","last_became_peered":"2024-09-12T02:12:09.664849+0000","last_unstale":"2024-09-12T02:13:16.698015+0000","last_undegraded":"2024-09-12T02:13:16.698015+0000","last_fullsized":"2024-09-12T02:13:16.698015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:31.415245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531361+0000","last_change":"2024-09-12T02:12:23.024293+0000","last_active":"2024-09-12T02:12:46.531361+0000","last_peered":"2024-09-12T02:12:46.531361+0000","last_clean":"2024-09-12T02:12:46.531361+0000","last_became_active":"2024-09-12T02:12:23.022939+0000","last_became_peered":"2024-09-12T02:12:23.022939+0000","last_unstale":"2024-09-12T02:12:46.531361+0000","last_undegraded":"2024-09-12T02:12:46.531361+0000","last_fullsized":"2024-09-12T02:12:46.531361+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:17.425084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993402+0000","last_change":"2024-09-12T02:12:12.696102+0000","last_active":"2024-09-12T02:12:46.993402+0000","last_peered":"2024-09-12T02:12:46.993402+0000","last_clean":"2024-09-12T02:12:46.993402+0000","last_became_active":"2024-09-12T02:12:12.695789+0000","last_became_peered":"2024-09-12T02:12:12.695789+0000","last_unstale":"2024-09-12T02:12:46.993402+0000","last_undegraded":"2024-09-12T02:12:46.993402+0000","last_fullsized":"2024-09-12T02:12:46.993402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.674070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"95'1","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.588975+0000","last_change":"2024-09-12T02:12:09.736807+0000","last_active":"2024-09-12T02:12:59.588975+0000","last_peered":"2024-09-12T02:12:59.588975+0000","last_clean":"2024-09-12T02:12:59.588975+0000","last_became_active":"2024-09-12T02:12:09.736351+0000","last_became_peered":"2024-09-12T02:12:09.736351+0000","last_unstale":"2024-09-12T02:12:59.588975+0000","last_undegraded":"2024-09-12T02:12:59.588975+0000","last_fullsized":"2024-09-12T02:12:59.588975+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:14.228251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536399+0000","last_change":"2024-09-12T02:12:22.738679+0000","last_active":"2024-09-12T02:12:46.536399+0000","last_peered":"2024-09-12T02:12:46.536399+0000","last_clean":"2024-09-12T02:12:46.536399+0000","last_became_active":"2024-09-12T02:12:22.738221+0000","last_became_peered":"2024-09-12T02:12:22.738221+0000","last_unstale":"2024-09-12T02:12:46.536399+0000","last_undegraded":"2024-09-12T02:12:46.536399+0000","last_fullsized":"2024-09-12T02:12:46.536399+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:41.143026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535192+0000","last_change":"2024-09-12T02:12:12.685853+0000","last_active":"2024-09-12T02:12:46.535192+0000","last_peered":"2024-09-12T02:12:46.535192+0000","last_clean":"2024-09-12T02:12:46.535192+0000","last_became_active":"2024-09-12T02:12:12.685537+0000","last_became_peered":"2024-09-12T02:12:12.685537+0000","last_unstale":"2024-09-12T02:12:46.535192+0000","last_undegraded":"2024-09-12T02:12:46.535192+0000","last_fullsized":"2024-09-12T02:12:46.535192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:01.159056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.947151+0000","last_change":"2024-09-12T02:12:09.736953+0000","last_active":"2024-09-12T02:12:46.947151+0000","last_peered":"2024-09-12T02:12:46.947151+0000","last_clean":"2024-09-12T02:12:46.947151+0000","last_became_active":"2024-09-12T02:12:09.736584+0000","last_became_peered":"2024-09-12T02:12:09.736584+0000","last_unstale":"2024-09-12T02:12:46.947151+0000","last_undegraded":"2024-09-12T02:12:46.947151+0000","last_fullsized":"2024-09-12T02:12:46.947151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:26.923372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531896+0000","last_change":"2024-09-12T02:12:23.023892+0000","last_active":"2024-09-12T02:12:46.531896+0000","last_peered":"2024-09-12T02:12:46.531896+0000","last_clean":"2024-09-12T02:12:46.531896+0000","last_became_active":"2024-09-12T02:12:23.023377+0000","last_became_peered":"2024-09-12T02:12:23.023377+0000","last_unstale":"2024-09-12T02:12:46.531896+0000","last_undegraded":"2024-09-12T02:12:46.531896+0000","last_fullsized":"2024-09-12T02:12:46.531896+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:06.944269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535106+0000","last_change":"2024-09-12T02:12:12.680026+0000","last_active":"2024-09-12T02:12:46.535106+0000","last_peered":"2024-09-12T02:12:46.535106+0000","last_clean":"2024-09-12T02:12:46.535106+0000","last_became_active":"2024-09-12T02:12:12.679683+0000","last_became_peered":"2024-09-12T02:12:12.679683+0000","last_unstale":"2024-09-12T02:12:46.535106+0000","last_undegraded":"2024-09-12T02:12:46.535106+0000","last_fullsized":"2024-09-12T02:12:46.535106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:10.911026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"95'1","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537252+0000","last_change":"2024-09-12T02:12:09.666246+0000","last_active":"2024-09-12T02:12:46.537252+0000","last_peered":"2024-09-12T02:12:46.537252+0000","last_clean":"2024-09-12T02:12:46.537252+0000","last_became_active":"2024-09-12T02:12:09.665095+0000","last_became_peered":"2024-09-12T02:12:09.665095+0000","last_unstale":"2024-09-12T02:12:46.537252+0000","last_undegraded":"2024-09-12T02:12:46.537252+0000","last_fullsized":"2024-09-12T02:12:46.537252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:40.468381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.992715+0000","last_change":"2024-09-12T02:12:22.739778+0000","last_active":"2024-09-12T02:12:46.992715+0000","last_peered":"2024-09-12T02:12:46.992715+0000","last_clean":"2024-09-12T02:12:46.992715+0000","last_became_active":"2024-09-12T02:12:22.739402+0000","last_became_peered":"2024-09-12T02:12:22.739402+0000","last_unstale":"2024-09-12T02:12:46.992715+0000","last_undegraded":"2024-09-12T02:12:46.992715+0000","last_fullsized":"2024-09-12T02:12:46.992715+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:10.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536468+0000","last_change":"2024-09-12T02:12:12.686121+0000","last_active":"2024-09-12T02:12:46.536468+0000","last_peered":"2024-09-12T02:12:46.536468+0000","last_clean":"2024-09-12T02:12:46.536468+0000","last_became_active":"2024-09-12T02:12:12.682209+0000","last_became_peered":"2024-09-12T02:12:12.682209+0000","last_unstale":"2024-09-12T02:12:46.536468+0000","last_undegraded":"2024-09-12T02:12:46.536468+0000","last_fullsized":"2024-09-12T02:12:46.536468+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:28.068552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"95'4","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:20.629039+0000","last_change":"2024-09-12T02:12:09.736820+0000","last_active":"2024-09-12T02:13:20.629039+0000","last_peered":"2024-09-12T02:13:20.629039+0000","last_clean":"2024-09-12T02:13:20.629039+0000","last_became_active":"2024-09-12T02:12:09.736472+0000","last_became_peered":"2024-09-12T02:12:09.736472+0000","last_unstale":"2024-09-12T02:13:20.629039+0000","last_undegraded":"2024-09-12T02:13:20.629039+0000","last_fullsized":"2024-09-12T02:13:20.629039+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:37.753089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993545+0000","last_change":"2024-09-12T02:12:23.024329+0000","last_active":"2024-09-12T02:12:46.993545+0000","last_peered":"2024-09-12T02:12:46.993545+0000","last_clean":"2024-09-12T02:12:46.993545+0000","last_became_active":"2024-09-12T02:12:23.023494+0000","last_became_peered":"2024-09-12T02:12:23.023494+0000","last_unstale":"2024-09-12T02:12:46.993545+0000","last_undegraded":"2024-09-12T02:12:46.993545+0000","last_fullsized":"2024-09-12T02:12:46.993545+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:56.650693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.992900+0000","last_change":"2024-09-12T02:12:12.687520+0000","last_active":"2024-09-12T02:12:46.992900+0000","last_peered":"2024-09-12T02:12:46.992900+0000","last_clean":"2024-09-12T02:12:46.992900+0000","last_became_active":"2024-09-12T02:12:12.687147+0000","last_became_peered":"2024-09-12T02:12:12.687147+0000","last_unstale":"2024-09-12T02:12:46.992900+0000","last_undegraded":"2024-09-12T02:12:46.992900+0000","last_fullsized":"2024-09-12T02:12:46.992900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:40.391396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"95'3","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.586704+0000","last_change":"2024-09-12T02:12:09.668841+0000","last_active":"2024-09-12T02:13:00.586704+0000","last_peered":"2024-09-12T02:13:00.586704+0000","last_clean":"2024-09-12T02:13:00.586704+0000","last_became_active":"2024-09-12T02:12:09.668488+0000","last_became_peered":"2024-09-12T02:12:09.668488+0000","last_unstale":"2024-09-12T02:13:00.586704+0000","last_undegraded":"2024-09-12T02:13:00.586704+0000","last_fullsized":"2024-09-12T02:13:00.586704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:28.259068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535798+0000","last_change":"2024-09-12T02:12:23.023804+0000","last_active":"2024-09-12T02:12:46.535798+0000","last_peered":"2024-09-12T02:12:46.535798+0000","last_clean":"2024-09-12T02:12:46.535798+0000","last_became_active":"2024-09-12T02:12:23.023331+0000","last_became_peered":"2024-09-12T02:12:23.023331+0000","last_unstale":"2024-09-12T02:12:46.535798+0000","last_undegraded":"2024-09-12T02:12:46.535798+0000","last_fullsized":"2024-09-12T02:12:46.535798+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:50.133965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531645+0000","last_change":"2024-09-12T02:12:12.695881+0000","last_active":"2024-09-12T02:12:46.531645+0000","last_peered":"2024-09-12T02:12:46.531645+0000","last_clean":"2024-09-12T02:12:46.531645+0000","last_became_active":"2024-09-12T02:12:12.695321+0000","last_became_peered":"2024-09-12T02:12:12.695321+0000","last_unstale":"2024-09-12T02:12:46.531645+0000","last_undegraded":"2024-09-12T02:12:46.531645+0000","last_fullsized":"2024-09-12T02:12:46.531645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:24.938014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"95'3","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:02.599585+0000","last_change":"2024-09-12T02:12:09.667252+0000","last_active":"2024-09-12T02:13:02.599585+0000","last_peered":"2024-09-12T02:13:02.599585+0000","last_clean":"2024-09-12T02:13:02.599585+0000","last_became_active":"2024-09-12T02:12:09.666892+0000","last_became_peered":"2024-09-12T02:12:09.666892+0000","last_unstale":"2024-09-12T02:13:02.599585+0000","last_undegraded":"2024-09-12T02:13:02.599585+0000","last_fullsized":"2024-09-12T02:13:02.599585+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:52.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":364,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536208+0000","last_change":"2024-09-12T02:10:50.611240+0000","last_active":"2024-09-12T02:12:46.536208+0000","last_peered":"2024-09-12T02:12:46.536208+0000","last_clean":"2024-09-12T02:12:46.536208+0000","last_became_active":"2024-09-12T02:10:50.610769+0000","last_became_peered":"2024-09-12T02:10:50.610769+0000","last_unstale":"2024-09-12T02:12:46.536208+0000","last_undegraded":"2024-09-12T02:12:46.536208+0000","last_fullsized":"2024-09-12T02:12:46.536208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:07.996202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:07.996202+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.996202+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.113749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"95'1","reported_seq":25,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536759+0000","last_change":"2024-09-12T02:12:22.734156+0000","last_active":"2024-09-12T02:12:46.536759+0000","last_peered":"2024-09-12T02:12:46.536759+0000","last_clean":"2024-09-12T02:12:46.536759+0000","last_became_active":"2024-09-12T02:12:22.733679+0000","last_became_peered":"2024-09-12T02:12:22.733679+0000","last_unstale":"2024-09-12T02:12:46.536759+0000","last_undegraded":"2024-09-12T02:12:46.536759+0000","last_fullsized":"2024-09-12T02:12:46.536759+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:38.764902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536590+0000","last_change":"2024-09-12T02:12:12.686957+0000","last_active":"2024-09-12T02:12:46.536590+0000","last_peered":"2024-09-12T02:12:46.536590+0000","last_clean":"2024-09-12T02:12:46.536590+0000","last_became_active":"2024-09-12T02:12:12.686160+0000","last_became_peered":"2024-09-12T02:12:12.686160+0000","last_unstale":"2024-09-12T02:12:46.536590+0000","last_undegraded":"2024-09-12T02:12:46.536590+0000","last_fullsized":"2024-09-12T02:12:46.536590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:29.390487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"95'3","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.590925+0000","last_change":"2024-09-12T02:12:09.737061+0000","last_active":"2024-09-12T02:13:00.590925+0000","last_peered":"2024-09-12T02:13:00.590925+0000","last_clean":"2024-09-12T02:13:00.590925+0000","last_became_active":"2024-09-12T02:12:09.736550+0000","last_became_peered":"2024-09-12T02:12:09.736550+0000","last_unstale":"2024-09-12T02:13:00.590925+0000","last_undegraded":"2024-09-12T02:13:00.590925+0000","last_fullsized":"2024-09-12T02:13:00.590925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:27.859724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.541038+0000","last_change":"2024-09-12T02:12:22.734200+0000","last_active":"2024-09-12T02:12:46.541038+0000","last_peered":"2024-09-12T02:12:46.541038+0000","last_clean":"2024-09-12T02:12:46.541038+0000","last_became_active":"2024-09-12T02:12:22.733679+0000","last_became_peered":"2024-09-12T02:12:22.733679+0000","last_unstale":"2024-09-12T02:12:46.541038+0000","last_undegraded":"2024-09-12T02:12:46.541038+0000","last_fullsized":"2024-09-12T02:12:46.541038+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:33.308512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536307+0000","last_change":"2024-09-12T02:12:12.691852+0000","last_active":"2024-09-12T02:12:46.536307+0000","last_peered":"2024-09-12T02:12:46.536307+0000","last_clean":"2024-09-12T02:12:46.536307+0000","last_became_active":"2024-09-12T02:12:12.691461+0000","last_became_peered":"2024-09-12T02:12:12.691461+0000","last_unstale":"2024-09-12T02:12:46.536307+0000","last_undegraded":"2024-09-12T02:12:46.536307+0000","last_fullsized":"2024-09-12T02:12:46.536307+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:28.587845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'1","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535566+0000","last_change":"2024-09-12T02:12:09.668230+0000","last_active":"2024-09-12T02:12:46.535566+0000","last_peered":"2024-09-12T02:12:46.535566+0000","last_clean":"2024-09-12T02:12:46.535566+0000","last_became_active":"2024-09-12T02:12:09.667802+0000","last_became_peered":"2024-09-12T02:12:09.667802+0000","last_unstale":"2024-09-12T02:12:46.535566+0000","last_undegraded":"2024-09-12T02:12:46.535566+0000","last_fullsized":"2024-09-12T02:12:46.535566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:58.505854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537775+0000","last_change":"2024-09-12T02:12:22.743207+0000","last_active":"2024-09-12T02:12:46.537775+0000","last_peered":"2024-09-12T02:12:46.537775+0000","last_clean":"2024-09-12T02:12:46.537775+0000","last_became_active":"2024-09-12T02:12:22.742820+0000","last_became_peered":"2024-09-12T02:12:22.742820+0000","last_unstale":"2024-09-12T02:12:46.537775+0000","last_undegraded":"2024-09-12T02:12:46.537775+0000","last_fullsized":"2024-09-12T02:12:46.537775+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:09.469987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536452+0000","last_change":"2024-09-12T02:12:12.681966+0000","last_active":"2024-09-12T02:12:46.536452+0000","last_peered":"2024-09-12T02:12:46.536452+0000","last_clean":"2024-09-12T02:12:46.536452+0000","last_became_active":"2024-09-12T02:12:12.681603+0000","last_became_peered":"2024-09-12T02:12:12.681603+0000","last_unstale":"2024-09-12T02:12:46.536452+0000","last_undegraded":"2024-09-12T02:12:46.536452+0000","last_fullsized":"2024-09-12T02:12:46.536452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:00.236008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993528+0000","last_change":"2024-09-12T02:12:09.665620+0000","last_active":"2024-09-12T02:12:46.993528+0000","last_peered":"2024-09-12T02:12:46.993528+0000","last_clean":"2024-09-12T02:12:46.993528+0000","last_became_active":"2024-09-12T02:12:09.665306+0000","last_became_peered":"2024-09-12T02:12:09.665306+0000","last_unstale":"2024-09-12T02:12:46.993528+0000","last_undegraded":"2024-09-12T02:12:46.993528+0000","last_fullsized":"2024-09-12T02:12:46.993528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.910141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536232+0000","last_change":"2024-09-12T02:12:22.732559+0000","last_active":"2024-09-12T02:12:46.536232+0000","last_peered":"2024-09-12T02:12:46.536232+0000","last_clean":"2024-09-12T02:12:46.536232+0000","last_became_active":"2024-09-12T02:12:22.732005+0000","last_became_peered":"2024-09-12T02:12:22.732005+0000","last_unstale":"2024-09-12T02:12:46.536232+0000","last_undegraded":"2024-09-12T02:12:46.536232+0000","last_fullsized":"2024-09-12T02:12:46.536232+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:14.101574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537272+0000","last_change":"2024-09-12T02:12:12.689448+0000","last_active":"2024-09-12T02:12:46.537272+0000","last_peered":"2024-09-12T02:12:46.537272+0000","last_clean":"2024-09-12T02:12:46.537272+0000","last_became_active":"2024-09-12T02:12:12.689112+0000","last_became_peered":"2024-09-12T02:12:12.689112+0000","last_unstale":"2024-09-12T02:12:46.537272+0000","last_undegraded":"2024-09-12T02:12:46.537272+0000","last_fullsized":"2024-09-12T02:12:46.537272+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.802911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"95'2","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:02.585417+0000","last_change":"2024-09-12T02:12:09.666062+0000","last_active":"2024-09-12T02:13:02.585417+0000","last_peered":"2024-09-12T02:13:02.585417+0000","last_clean":"2024-09-12T02:13:02.585417+0000","last_became_active":"2024-09-12T02:12:09.665632+0000","last_became_peered":"2024-09-12T02:12:09.665632+0000","last_unstale":"2024-09-12T02:13:02.585417+0000","last_undegraded":"2024-09-12T02:13:02.585417+0000","last_fullsized":"2024-09-12T02:13:02.585417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:23.794505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.534894+0000","last_change":"2024-09-12T02:12:22.733650+0000","last_active":"2024-09-12T02:12:46.534894+0000","last_peered":"2024-09-12T02:12:46.534894+0000","last_clean":"2024-09-12T02:12:46.534894+0000","last_became_active":"2024-09-12T02:12:22.733258+0000","last_became_peered":"2024-09-12T02:12:22.733258+0000","last_unstale":"2024-09-12T02:12:46.534894+0000","last_undegraded":"2024-09-12T02:12:46.534894+0000","last_fullsized":"2024-09-12T02:12:46.534894+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:56.885431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535840+0000","last_change":"2024-09-12T02:12:12.687166+0000","last_active":"2024-09-12T02:12:46.535840+0000","last_peered":"2024-09-12T02:12:46.535840+0000","last_clean":"2024-09-12T02:12:46.535840+0000","last_became_active":"2024-09-12T02:12:12.686646+0000","last_became_peered":"2024-09-12T02:12:12.686646+0000","last_unstale":"2024-09-12T02:12:46.535840+0000","last_undegraded":"2024-09-12T02:12:46.535840+0000","last_fullsized":"2024-09-12T02:12:46.535840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.038063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"95'15","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.591073+0000","last_change":"2024-09-12T02:12:46.547259+0000","last_active":"2024-09-12T02:13:00.591073+0000","last_peered":"2024-09-12T02:13:00.591073+0000","last_clean":"2024-09-12T02:13:00.591073+0000","last_became_active":"2024-09-12T02:12:46.540288+0000","last_became_peered":"2024-09-12T02:12:46.540288+0000","last_unstale":"2024-09-12T02:13:00.591073+0000","last_undegraded":"2024-09-12T02:13:00.591073+0000","last_fullsized":"2024-09-12T02:13:00.591073+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:10.251191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.992871+0000","last_change":"2024-09-12T02:12:22.745382+0000","last_active":"2024-09-12T02:12:46.992871+0000","last_peered":"2024-09-12T02:12:46.992871+0000","last_clean":"2024-09-12T02:12:46.992871+0000","last_became_active":"2024-09-12T02:12:22.740850+0000","last_became_peered":"2024-09-12T02:12:22.740850+0000","last_unstale":"2024-09-12T02:12:46.992871+0000","last_undegraded":"2024-09-12T02:12:46.992871+0000","last_fullsized":"2024-09-12T02:12:46.992871+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:40.207459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535998+0000","last_change":"2024-09-12T02:12:12.692745+0000","last_active":"2024-09-12T02:12:46.535998+0000","last_peered":"2024-09-12T02:12:46.535998+0000","last_clean":"2024-09-12T02:12:46.535998+0000","last_became_active":"2024-09-12T02:12:12.692213+0000","last_became_peered":"2024-09-12T02:12:12.692213+0000","last_unstale":"2024-09-12T02:12:46.535998+0000","last_undegraded":"2024-09-12T02:12:46.535998+0000","last_fullsized":"2024-09-12T02:12:46.535998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:11.869094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"95'3","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:19.628319+0000","last_change":"2024-09-12T02:12:09.668239+0000","last_active":"2024-09-12T02:13:19.628319+0000","last_peered":"2024-09-12T02:13:19.628319+0000","last_clean":"2024-09-12T02:13:19.628319+0000","last_became_active":"2024-09-12T02:12:09.667870+0000","last_became_peered":"2024-09-12T02:12:09.667870+0000","last_unstale":"2024-09-12T02:13:19.628319+0000","last_undegraded":"2024-09-12T02:13:19.628319+0000","last_fullsized":"2024-09-12T02:13:19.628319+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:55.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.945857+0000","last_change":"2024-09-12T02:12:22.743248+0000","last_active":"2024-09-12T02:12:46.945857+0000","last_peered":"2024-09-12T02:12:46.945857+0000","last_clean":"2024-09-12T02:12:46.945857+0000","last_became_active":"2024-09-12T02:12:22.742861+0000","last_became_peered":"2024-09-12T02:12:22.742861+0000","last_unstale":"2024-09-12T02:12:46.945857+0000","last_undegraded":"2024-09-12T02:12:46.945857+0000","last_fullsized":"2024-09-12T02:12:46.945857+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:07.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536287+0000","last_change":"2024-09-12T02:12:12.687994+0000","last_active":"2024-09-12T02:12:46.536287+0000","last_peered":"2024-09-12T02:12:46.536287+0000","last_clean":"2024-09-12T02:12:46.536287+0000","last_became_active":"2024-09-12T02:12:12.687652+0000","last_became_peered":"2024-09-12T02:12:12.687652+0000","last_unstale":"2024-09-12T02:12:46.536287+0000","last_undegraded":"2024-09-12T02:12:46.536287+0000","last_fullsized":"2024-09-12T02:12:46.536287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:16.168879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"95'3","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.587176+0000","last_change":"2024-09-12T02:12:09.670281+0000","last_active":"2024-09-12T02:12:59.587176+0000","last_peered":"2024-09-12T02:12:59.587176+0000","last_clean":"2024-09-12T02:12:59.587176+0000","last_became_active":"2024-09-12T02:12:09.669953+0000","last_became_peered":"2024-09-12T02:12:09.669953+0000","last_unstale":"2024-09-12T02:12:59.587176+0000","last_undegraded":"2024-09-12T02:12:59.587176+0000","last_fullsized":"2024-09-12T02:12:59.587176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.189591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535519+0000","last_change":"2024-09-12T02:12:22.747973+0000","last_active":"2024-09-12T02:12:46.535519+0000","last_peered":"2024-09-12T02:12:46.535519+0000","last_clean":"2024-09-12T02:12:46.535519+0000","last_became_active":"2024-09-12T02:12:22.747635+0000","last_became_peered":"2024-09-12T02:12:22.747635+0000","last_unstale":"2024-09-12T02:12:46.535519+0000","last_undegraded":"2024-09-12T02:12:46.535519+0000","last_fullsized":"2024-09-12T02:12:46.535519+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:11.310108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993091+0000","last_change":"2024-09-12T02:12:12.697466+0000","last_active":"2024-09-12T02:12:46.993091+0000","last_peered":"2024-09-12T02:12:46.993091+0000","last_clean":"2024-09-12T02:12:46.993091+0000","last_became_active":"2024-09-12T02:12:12.697119+0000","last_became_peered":"2024-09-12T02:12:12.697119+0000","last_unstale":"2024-09-12T02:12:46.993091+0000","last_undegraded":"2024-09-12T02:12:46.993091+0000","last_fullsized":"2024-09-12T02:12:46.993091+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:37.396793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"95'6","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.590195+0000","last_change":"2024-09-12T02:12:09.670895+0000","last_active":"2024-09-12T02:13:00.590195+0000","last_peered":"2024-09-12T02:13:00.590195+0000","last_clean":"2024-09-12T02:13:00.590195+0000","last_became_active":"2024-09-12T02:12:09.670301+0000","last_became_peered":"2024-09-12T02:12:09.670301+0000","last_unstale":"2024-09-12T02:13:00.590195+0000","last_undegraded":"2024-09-12T02:13:00.590195+0000","last_fullsized":"2024-09-12T02:13:00.590195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:06.693381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535287+0000","last_change":"2024-09-12T02:12:22.740419+0000","last_active":"2024-09-12T02:12:46.535287+0000","last_peered":"2024-09-12T02:12:46.535287+0000","last_clean":"2024-09-12T02:12:46.535287+0000","last_became_active":"2024-09-12T02:12:22.739966+0000","last_became_peered":"2024-09-12T02:12:22.739966+0000","last_unstale":"2024-09-12T02:12:46.535287+0000","last_undegraded":"2024-09-12T02:12:46.535287+0000","last_fullsized":"2024-09-12T02:12:46.535287+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.556038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532237+0000","last_change":"2024-09-12T02:12:12.681814+0000","last_active":"2024-09-12T02:12:46.532237+0000","last_peered":"2024-09-12T02:12:46.532237+0000","last_clean":"2024-09-12T02:12:46.532237+0000","last_became_active":"2024-09-12T02:12:12.681468+0000","last_became_peered":"2024-09-12T02:12:12.681468+0000","last_unstale":"2024-09-12T02:12:46.532237+0000","last_undegraded":"2024-09-12T02:12:46.532237+0000","last_fullsized":"2024-09-12T02:12:46.532237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:31.964646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'29","reported_seq":115,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:21.631742+0000","last_change":"2024-09-12T02:12:09.664324+0000","last_active":"2024-09-12T02:13:21.631742+0000","last_peered":"2024-09-12T02:13:21.631742+0000","last_clean":"2024-09-12T02:13:21.631742+0000","last_became_active":"2024-09-12T02:12:09.663970+0000","last_became_peered":"2024-09-12T02:12:09.663970+0000","last_unstale":"2024-09-12T02:13:21.631742+0000","last_undegraded":"2024-09-12T02:13:21.631742+0000","last_fullsized":"2024-09-12T02:13:21.631742+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:03.408761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56749,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":78,"num_write":30,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.538629+0000","last_change":"2024-09-12T02:12:46.538194+0000","last_active":"2024-09-12T02:12:46.538629+0000","last_peered":"2024-09-12T02:12:46.538629+0000","last_clean":"2024-09-12T02:12:46.538629+0000","last_became_active":"2024-09-12T02:12:46.537669+0000","last_became_peered":"2024-09-12T02:12:46.537669+0000","last_unstale":"2024-09-12T02:12:46.538629+0000","last_undegraded":"2024-09-12T02:12:46.538629+0000","last_fullsized":"2024-09-12T02:12:46.538629+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:05.394149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.541661+0000","last_change":"2024-09-12T02:12:12.690126+0000","last_active":"2024-09-12T02:12:46.541661+0000","last_peered":"2024-09-12T02:12:46.541661+0000","last_clean":"2024-09-12T02:12:46.541661+0000","last_became_active":"2024-09-12T02:12:12.689821+0000","last_became_peered":"2024-09-12T02:12:12.689821+0000","last_unstale":"2024-09-12T02:12:46.541661+0000","last_undegraded":"2024-09-12T02:12:46.541661+0000","last_fullsized":"2024-09-12T02:12:46.541661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:39.503772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"95'4","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.587144+0000","last_change":"2024-09-12T02:12:09.735571+0000","last_active":"2024-09-12T02:12:59.587144+0000","last_peered":"2024-09-12T02:12:59.587144+0000","last_clean":"2024-09-12T02:12:59.587144+0000","last_became_active":"2024-09-12T02:12:09.735150+0000","last_became_peered":"2024-09-12T02:12:09.735150+0000","last_unstale":"2024-09-12T02:12:59.587144+0000","last_undegraded":"2024-09-12T02:12:59.587144+0000","last_fullsized":"2024-09-12T02:12:59.587144+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:44.840395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":31,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.543628+0000","last_change":"2024-09-12T02:12:46.543628+0000","last_active":"2024-09-12T02:12:46.543628+0000","last_peered":"2024-09-12T02:12:46.543628+0000","last_clean":"2024-09-12T02:12:46.543628+0000","last_became_active":"2024-09-12T02:12:46.543158+0000","last_became_peered":"2024-09-12T02:12:46.543158+0000","last_unstale":"2024-09-12T02:12:46.543628+0000","last_undegraded":"2024-09-12T02:12:46.543628+0000","last_fullsized":"2024-09-12T02:12:46.543628+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:05.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.538252+0000","last_change":"2024-09-12T02:12:12.683253+0000","last_active":"2024-09-12T02:12:46.538252+0000","last_peered":"2024-09-12T02:12:46.538252+0000","last_clean":"2024-09-12T02:12:46.538252+0000","last_became_active":"2024-09-12T02:12:12.682761+0000","last_became_peered":"2024-09-12T02:12:12.682761+0000","last_unstale":"2024-09-12T02:12:46.538252+0000","last_undegraded":"2024-09-12T02:12:46.538252+0000","last_fullsized":"2024-09-12T02:12:46.538252+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:56.321662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"95'2","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:59.586154+0000","last_change":"2024-09-12T02:12:46.542190+0000","last_active":"2024-09-12T02:12:59.586154+0000","last_peered":"2024-09-12T02:12:59.586154+0000","last_clean":"2024-09-12T02:12:59.586154+0000","last_became_active":"2024-09-12T02:12:46.541755+0000","last_became_peered":"2024-09-12T02:12:46.541755+0000","last_unstale":"2024-09-12T02:12:59.586154+0000","last_undegraded":"2024-09-12T02:12:59.586154+0000","last_fullsized":"2024-09-12T02:12:59.586154+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:53.224512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.541107+0000","last_change":"2024-09-12T02:12:46.540620+0000","last_active":"2024-09-12T02:12:46.541107+0000","last_peered":"2024-09-12T02:12:46.541107+0000","last_clean":"2024-09-12T02:12:46.541107+0000","last_became_active":"2024-09-12T02:12:46.540177+0000","last_became_peered":"2024-09-12T02:12:46.540177+0000","last_unstale":"2024-09-12T02:12:46.541107+0000","last_undegraded":"2024-09-12T02:12:46.541107+0000","last_fullsized":"2024-09-12T02:12:46.541107+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:30.701052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.541878+0000","last_change":"2024-09-12T02:12:12.686728+0000","last_active":"2024-09-12T02:12:46.541878+0000","last_peered":"2024-09-12T02:12:46.541878+0000","last_clean":"2024-09-12T02:12:46.541878+0000","last_became_active":"2024-09-12T02:12:12.686159+0000","last_became_peered":"2024-09-12T02:12:12.686159+0000","last_unstale":"2024-09-12T02:12:46.541878+0000","last_undegraded":"2024-09-12T02:12:46.541878+0000","last_fullsized":"2024-09-12T02:12:46.541878+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:51.567343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'3","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:20.626782+0000","last_change":"2024-09-12T02:12:09.665179+0000","last_active":"2024-09-12T02:13:20.626782+0000","last_peered":"2024-09-12T02:13:20.626782+0000","last_clean":"2024-09-12T02:13:20.626782+0000","last_became_active":"2024-09-12T02:12:09.664794+0000","last_became_peered":"2024-09-12T02:12:09.664794+0000","last_unstale":"2024-09-12T02:13:20.626782+0000","last_undegraded":"2024-09-12T02:13:20.626782+0000","last_fullsized":"2024-09-12T02:13:20.626782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:36.646536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531492+0000","last_change":"2024-09-12T02:12:22.735715+0000","last_active":"2024-09-12T02:12:46.531492+0000","last_peered":"2024-09-12T02:12:46.531492+0000","last_clean":"2024-09-12T02:12:46.531492+0000","last_became_active":"2024-09-12T02:12:22.735341+0000","last_became_peered":"2024-09-12T02:12:22.735341+0000","last_unstale":"2024-09-12T02:12:46.531492+0000","last_undegraded":"2024-09-12T02:12:46.531492+0000","last_fullsized":"2024-09-12T02:12:46.531492+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:36.141512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537857+0000","last_change":"2024-09-12T02:12:22.743286+0000","last_active":"2024-09-12T02:12:46.537857+0000","last_peered":"2024-09-12T02:12:46.537857+0000","last_clean":"2024-09-12T02:12:46.537857+0000","last_became_active":"2024-09-12T02:12:22.742804+0000","last_became_peered":"2024-09-12T02:12:22.742804+0000","last_unstale":"2024-09-12T02:12:46.537857+0000","last_undegraded":"2024-09-12T02:12:46.537857+0000","last_fullsized":"2024-09-12T02:12:46.537857+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:26.133009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.946622+0000","last_change":"2024-09-12T02:12:12.682970+0000","last_active":"2024-09-12T02:12:46.946622+0000","last_peered":"2024-09-12T02:12:46.946622+0000","last_clean":"2024-09-12T02:12:46.946622+0000","last_became_active":"2024-09-12T02:12:12.682625+0000","last_became_peered":"2024-09-12T02:12:12.682625+0000","last_unstale":"2024-09-12T02:12:46.946622+0000","last_undegraded":"2024-09-12T02:12:46.946622+0000","last_fullsized":"2024-09-12T02:12:46.946622+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:44.585654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"95'1","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536678+0000","last_change":"2024-09-12T02:12:09.669380+0000","last_active":"2024-09-12T02:12:46.536678+0000","last_peered":"2024-09-12T02:12:46.536678+0000","last_clean":"2024-09-12T02:12:46.536678+0000","last_became_active":"2024-09-12T02:12:09.669052+0000","last_became_peered":"2024-09-12T02:12:09.669052+0000","last_unstale":"2024-09-12T02:12:46.536678+0000","last_undegraded":"2024-09-12T02:12:46.536678+0000","last_fullsized":"2024-09-12T02:12:46.536678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:35.828558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537304+0000","last_change":"2024-09-12T02:12:22.745871+0000","last_active":"2024-09-12T02:12:46.537304+0000","last_peered":"2024-09-12T02:12:46.537304+0000","last_clean":"2024-09-12T02:12:46.537304+0000","last_became_active":"2024-09-12T02:12:22.745370+0000","last_became_peered":"2024-09-12T02:12:22.745370+0000","last_unstale":"2024-09-12T02:12:46.537304+0000","last_undegraded":"2024-09-12T02:12:46.537304+0000","last_fullsized":"2024-09-12T02:12:46.537304+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:20.579806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531491+0000","last_change":"2024-09-12T02:12:12.684996+0000","last_active":"2024-09-12T02:12:46.531491+0000","last_peered":"2024-09-12T02:12:46.531491+0000","last_clean":"2024-09-12T02:12:46.531491+0000","last_became_active":"2024-09-12T02:12:12.684663+0000","last_became_peered":"2024-09-12T02:12:12.684663+0000","last_unstale":"2024-09-12T02:12:46.531491+0000","last_undegraded":"2024-09-12T02:12:46.531491+0000","last_fullsized":"2024-09-12T02:12:46.531491+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:35.054435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"95'2","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.590695+0000","last_change":"2024-09-12T02:12:09.668939+0000","last_active":"2024-09-12T02:13:00.590695+0000","last_peered":"2024-09-12T02:13:00.590695+0000","last_clean":"2024-09-12T02:13:00.590695+0000","last_became_active":"2024-09-12T02:12:09.665857+0000","last_became_peered":"2024-09-12T02:12:09.665857+0000","last_unstale":"2024-09-12T02:13:00.590695+0000","last_undegraded":"2024-09-12T02:13:00.590695+0000","last_fullsized":"2024-09-12T02:13:00.590695+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:42.311387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"95'3","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:00.590676+0000","last_change":"2024-09-12T02:12:09.666892+0000","last_active":"2024-09-12T02:13:00.590676+0000","last_peered":"2024-09-12T02:13:00.590676+0000","last_clean":"2024-09-12T02:13:00.590676+0000","last_became_active":"2024-09-12T02:12:09.666503+0000","last_became_peered":"2024-09-12T02:12:09.666503+0000","last_unstale":"2024-09-12T02:13:00.590676+0000","last_undegraded":"2024-09-12T02:13:00.590676+0000","last_fullsized":"2024-09-12T02:13:00.590676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:16.010778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.534849+0000","last_change":"2024-09-12T02:12:12.683323+0000","last_active":"2024-09-12T02:12:46.534849+0000","last_peered":"2024-09-12T02:12:46.534849+0000","last_clean":"2024-09-12T02:12:46.534849+0000","last_became_active":"2024-09-12T02:12:12.683017+0000","last_became_peered":"2024-09-12T02:12:12.683017+0000","last_unstale":"2024-09-12T02:12:46.534849+0000","last_undegraded":"2024-09-12T02:12:46.534849+0000","last_fullsized":"2024-09-12T02:12:46.534849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:00.287600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539463+0000","last_change":"2024-09-12T02:12:22.743509+0000","last_active":"2024-09-12T02:12:46.539463+0000","last_peered":"2024-09-12T02:12:46.539463+0000","last_clean":"2024-09-12T02:12:46.539463+0000","last_became_active":"2024-09-12T02:12:22.743185+0000","last_became_peered":"2024-09-12T02:12:22.743185+0000","last_unstale":"2024-09-12T02:12:46.539463+0000","last_undegraded":"2024-09-12T02:12:46.539463+0000","last_fullsized":"2024-09-12T02:12:46.539463+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:44.990530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'6","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:13:21.628766+0000","last_change":"2024-09-12T02:12:09.672316+0000","last_active":"2024-09-12T02:13:21.628766+0000","last_peered":"2024-09-12T02:13:21.628766+0000","last_clean":"2024-09-12T02:13:21.628766+0000","last_became_active":"2024-09-12T02:12:09.671947+0000","last_became_peered":"2024-09-12T02:12:09.671947+0000","last_unstale":"2024-09-12T02:13:21.628766+0000","last_undegraded":"2024-09-12T02:13:21.628766+0000","last_fullsized":"2024-09-12T02:13:21.628766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:00.632297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532020+0000","last_change":"2024-09-12T02:12:12.689437+0000","last_active":"2024-09-12T02:12:46.532020+0000","last_peered":"2024-09-12T02:12:46.532020+0000","last_clean":"2024-09-12T02:12:46.532020+0000","last_became_active":"2024-09-12T02:12:12.689123+0000","last_became_peered":"2024-09-12T02:12:12.689123+0000","last_unstale":"2024-09-12T02:12:46.532020+0000","last_undegraded":"2024-09-12T02:12:46.532020+0000","last_fullsized":"2024-09-12T02:12:46.532020+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:07.635955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539587+0000","last_change":"2024-09-12T02:12:22.733472+0000","last_active":"2024-09-12T02:12:46.539587+0000","last_peered":"2024-09-12T02:12:46.539587+0000","last_clean":"2024-09-12T02:12:46.539587+0000","last_became_active":"2024-09-12T02:12:22.733040+0000","last_became_peered":"2024-09-12T02:12:22.733040+0000","last_unstale":"2024-09-12T02:12:46.539587+0000","last_undegraded":"2024-09-12T02:12:46.539587+0000","last_fullsized":"2024-09-12T02:12:46.539587+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:15.556414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536418+0000","last_change":"2024-09-12T02:12:12.684758+0000","last_active":"2024-09-12T02:12:46.536418+0000","last_peered":"2024-09-12T02:12:46.536418+0000","last_clean":"2024-09-12T02:12:46.536418+0000","last_became_active":"2024-09-12T02:12:12.684430+0000","last_became_peered":"2024-09-12T02:12:12.684430+0000","last_unstale":"2024-09-12T02:12:46.536418+0000","last_undegraded":"2024-09-12T02:12:46.536418+0000","last_fullsized":"2024-09-12T02:12:46.536418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:26.209634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539454+0000","last_change":"2024-09-12T02:12:12.688350+0000","last_active":"2024-09-12T02:12:46.539454+0000","last_peered":"2024-09-12T02:12:46.539454+0000","last_clean":"2024-09-12T02:12:46.539454+0000","last_became_active":"2024-09-12T02:12:12.688037+0000","last_became_peered":"2024-09-12T02:12:12.688037+0000","last_unstale":"2024-09-12T02:12:46.539454+0000","last_undegraded":"2024-09-12T02:12:46.539454+0000","last_fullsized":"2024-09-12T02:12:46.539454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:02.133024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539236+0000","last_change":"2024-09-12T02:12:12.686031+0000","last_active":"2024-09-12T02:12:46.539236+0000","last_peered":"2024-09-12T02:12:46.539236+0000","last_clean":"2024-09-12T02:12:46.539236+0000","last_became_active":"2024-09-12T02:12:12.685690+0000","last_became_peered":"2024-09-12T02:12:12.685690+0000","last_unstale":"2024-09-12T02:12:46.539236+0000","last_undegraded":"2024-09-12T02:12:46.539236+0000","last_fullsized":"2024-09-12T02:12:46.539236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:43.406506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537802+0000","last_change":"2024-09-12T02:12:12.695698+0000","last_active":"2024-09-12T02:12:46.537802+0000","last_peered":"2024-09-12T02:12:46.537802+0000","last_clean":"2024-09-12T02:12:46.537802+0000","last_became_active":"2024-09-12T02:12:12.694277+0000","last_became_peered":"2024-09-12T02:12:12.694277+0000","last_unstale":"2024-09-12T02:12:46.537802+0000","last_undegraded":"2024-09-12T02:12:46.537802+0000","last_fullsized":"2024-09-12T02:12:46.537802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:55.013973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993505+0000","last_change":"2024-09-12T02:12:12.699761+0000","last_active":"2024-09-12T02:12:46.993505+0000","last_peered":"2024-09-12T02:12:46.993505+0000","last_clean":"2024-09-12T02:12:46.993505+0000","last_became_active":"2024-09-12T02:12:12.699433+0000","last_became_peered":"2024-09-12T02:12:12.699433+0000","last_unstale":"2024-09-12T02:12:46.993505+0000","last_undegraded":"2024-09-12T02:12:46.993505+0000","last_fullsized":"2024-09-12T02:12:46.993505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:34.863112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537040+0000","last_change":"2024-09-12T02:12:12.683057+0000","last_active":"2024-09-12T02:12:46.537040+0000","last_peered":"2024-09-12T02:12:46.537040+0000","last_clean":"2024-09-12T02:12:46.537040+0000","last_became_active":"2024-09-12T02:12:12.682751+0000","last_became_peered":"2024-09-12T02:12:12.682751+0000","last_unstale":"2024-09-12T02:12:46.537040+0000","last_undegraded":"2024-09-12T02:12:46.537040+0000","last_fullsized":"2024-09-12T02:12:46.537040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:58.642560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539991+0000","last_change":"2024-09-12T02:12:12.682975+0000","last_active":"2024-09-12T02:12:46.539991+0000","last_peered":"2024-09-12T02:12:46.539991+0000","last_clean":"2024-09-12T02:12:46.539991+0000","last_became_active":"2024-09-12T02:12:12.682643+0000","last_became_peered":"2024-09-12T02:12:12.682643+0000","last_unstale":"2024-09-12T02:12:46.539991+0000","last_undegraded":"2024-09-12T02:12:46.539991+0000","last_fullsized":"2024-09-12T02:12:46.539991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:49.859554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532063+0000","last_change":"2024-09-12T02:12:12.680523+0000","last_active":"2024-09-12T02:12:46.532063+0000","last_peered":"2024-09-12T02:12:46.532063+0000","last_clean":"2024-09-12T02:12:46.532063+0000","last_became_active":"2024-09-12T02:12:12.680128+0000","last_became_peered":"2024-09-12T02:12:12.680128+0000","last_unstale":"2024-09-12T02:12:46.532063+0000","last_undegraded":"2024-09-12T02:12:46.532063+0000","last_fullsized":"2024-09-12T02:12:46.532063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:48.660998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536382+0000","last_change":"2024-09-12T02:12:12.687454+0000","last_active":"2024-09-12T02:12:46.536382+0000","last_peered":"2024-09-12T02:12:46.536382+0000","last_clean":"2024-09-12T02:12:46.536382+0000","last_became_active":"2024-09-12T02:12:12.686203+0000","last_became_peered":"2024-09-12T02:12:12.686203+0000","last_unstale":"2024-09-12T02:12:46.536382+0000","last_undegraded":"2024-09-12T02:12:46.536382+0000","last_fullsized":"2024-09-12T02:12:46.536382+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:25.029872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531569+0000","last_change":"2024-09-12T02:12:12.683777+0000","last_active":"2024-09-12T02:12:46.531569+0000","last_peered":"2024-09-12T02:12:46.531569+0000","last_clean":"2024-09-12T02:12:46.531569+0000","last_became_active":"2024-09-12T02:12:12.682096+0000","last_became_peered":"2024-09-12T02:12:12.682096+0000","last_unstale":"2024-09-12T02:12:46.531569+0000","last_undegraded":"2024-09-12T02:12:46.531569+0000","last_fullsized":"2024-09-12T02:12:46.531569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:18.624449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.541344+0000","last_change":"2024-09-12T02:12:12.689690+0000","last_active":"2024-09-12T02:12:46.541344+0000","last_peered":"2024-09-12T02:12:46.541344+0000","last_clean":"2024-09-12T02:12:46.541344+0000","last_became_active":"2024-09-12T02:12:12.689339+0000","last_became_peered":"2024-09-12T02:12:12.689339+0000","last_unstale":"2024-09-12T02:12:46.541344+0000","last_undegraded":"2024-09-12T02:12:46.541344+0000","last_fullsized":"2024-09-12T02:12:46.541344+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:06.517136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993323+0000","last_change":"2024-09-12T02:12:12.696480+0000","last_active":"2024-09-12T02:12:46.993323+0000","last_peered":"2024-09-12T02:12:46.993323+0000","last_clean":"2024-09-12T02:12:46.993323+0000","last_became_active":"2024-09-12T02:12:12.696163+0000","last_became_peered":"2024-09-12T02:12:12.696163+0000","last_unstale":"2024-09-12T02:12:46.993323+0000","last_undegraded":"2024-09-12T02:12:46.993323+0000","last_fullsized":"2024-09-12T02:12:46.993323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:12.381644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.947998+0000","last_change":"2024-09-12T02:12:46.947998+0000","last_active":"2024-09-12T02:12:46.947998+0000","last_peered":"2024-09-12T02:12:46.947998+0000","last_clean":"2024-09-12T02:12:46.947998+0000","last_became_active":"2024-09-12T02:12:46.947602+0000","last_became_peered":"2024-09-12T02:12:46.947602+0000","last_unstale":"2024-09-12T02:12:46.947998+0000","last_undegraded":"2024-09-12T02:12:46.947998+0000","last_fullsized":"2024-09-12T02:12:46.947998+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:50.123283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.539816+0000","last_change":"2024-09-12T02:12:12.689152+0000","last_active":"2024-09-12T02:12:46.539816+0000","last_peered":"2024-09-12T02:12:46.539816+0000","last_clean":"2024-09-12T02:12:46.539816+0000","last_became_active":"2024-09-12T02:12:12.688830+0000","last_became_peered":"2024-09-12T02:12:12.688830+0000","last_unstale":"2024-09-12T02:12:46.539816+0000","last_undegraded":"2024-09-12T02:12:46.539816+0000","last_fullsized":"2024-09-12T02:12:46.539816+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:24.057884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.947306+0000","last_change":"2024-09-12T02:12:12.683089+0000","last_active":"2024-09-12T02:12:46.947306+0000","last_peered":"2024-09-12T02:12:46.947306+0000","last_clean":"2024-09-12T02:12:46.947306+0000","last_became_active":"2024-09-12T02:12:12.682783+0000","last_became_peered":"2024-09-12T02:12:12.682783+0000","last_unstale":"2024-09-12T02:12:46.947306+0000","last_undegraded":"2024-09-12T02:12:46.947306+0000","last_fullsized":"2024-09-12T02:12:46.947306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:07.182958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537652+0000","last_change":"2024-09-12T02:12:12.698373+0000","last_active":"2024-09-12T02:12:46.537652+0000","last_peered":"2024-09-12T02:12:46.537652+0000","last_clean":"2024-09-12T02:12:46.537652+0000","last_became_active":"2024-09-12T02:12:12.698103+0000","last_became_peered":"2024-09-12T02:12:12.698103+0000","last_unstale":"2024-09-12T02:12:46.537652+0000","last_undegraded":"2024-09-12T02:12:46.537652+0000","last_fullsized":"2024-09-12T02:12:46.537652+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:35.776397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.540610+0000","last_change":"2024-09-12T02:12:12.698499+0000","last_active":"2024-09-12T02:12:46.540610+0000","last_peered":"2024-09-12T02:12:46.540610+0000","last_clean":"2024-09-12T02:12:46.540610+0000","last_became_active":"2024-09-12T02:12:12.698103+0000","last_became_peered":"2024-09-12T02:12:12.698103+0000","last_unstale":"2024-09-12T02:12:46.540610+0000","last_undegraded":"2024-09-12T02:12:46.540610+0000","last_fullsized":"2024-09-12T02:12:46.540610+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:59.116424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537444+0000","last_change":"2024-09-12T02:12:12.687918+0000","last_active":"2024-09-12T02:12:46.537444+0000","last_peered":"2024-09-12T02:12:46.537444+0000","last_clean":"2024-09-12T02:12:46.537444+0000","last_became_active":"2024-09-12T02:12:12.684732+0000","last_became_peered":"2024-09-12T02:12:12.684732+0000","last_unstale":"2024-09-12T02:12:46.537444+0000","last_undegraded":"2024-09-12T02:12:46.537444+0000","last_fullsized":"2024-09-12T02:12:46.537444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:06.675996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537431+0000","last_change":"2024-09-12T02:12:12.680429+0000","last_active":"2024-09-12T02:12:46.537431+0000","last_peered":"2024-09-12T02:12:46.537431+0000","last_clean":"2024-09-12T02:12:46.537431+0000","last_became_active":"2024-09-12T02:12:12.680138+0000","last_became_peered":"2024-09-12T02:12:12.680138+0000","last_unstale":"2024-09-12T02:12:46.537431+0000","last_undegraded":"2024-09-12T02:12:46.537431+0000","last_fullsized":"2024-09-12T02:12:46.537431+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:16.144740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.993305+0000","last_change":"2024-09-12T02:12:12.688403+0000","last_active":"2024-09-12T02:12:46.993305+0000","last_peered":"2024-09-12T02:12:46.993305+0000","last_clean":"2024-09-12T02:12:46.993305+0000","last_became_active":"2024-09-12T02:12:12.686037+0000","last_became_peered":"2024-09-12T02:12:12.686037+0000","last_unstale":"2024-09-12T02:12:46.993305+0000","last_undegraded":"2024-09-12T02:12:46.993305+0000","last_fullsized":"2024-09-12T02:12:46.993305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:01.825875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.533089+0000","last_change":"2024-09-12T02:12:12.677197+0000","last_active":"2024-09-12T02:12:46.533089+0000","last_peered":"2024-09-12T02:12:46.533089+0000","last_clean":"2024-09-12T02:12:46.533089+0000","last_became_active":"2024-09-12T02:12:12.676845+0000","last_became_peered":"2024-09-12T02:12:12.676845+0000","last_unstale":"2024-09-12T02:12:46.533089+0000","last_undegraded":"2024-09-12T02:12:46.533089+0000","last_fullsized":"2024-09-12T02:12:46.533089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:35.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.536429+0000","last_change":"2024-09-12T02:12:12.687061+0000","last_active":"2024-09-12T02:12:46.536429+0000","last_peered":"2024-09-12T02:12:46.536429+0000","last_clean":"2024-09-12T02:12:46.536429+0000","last_became_active":"2024-09-12T02:12:12.686616+0000","last_became_peered":"2024-09-12T02:12:12.686616+0000","last_unstale":"2024-09-12T02:12:46.536429+0000","last_undegraded":"2024-09-12T02:12:46.536429+0000","last_fullsized":"2024-09-12T02:12:46.536429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:09.368228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535957+0000","last_change":"2024-09-12T02:12:12.677137+0000","last_active":"2024-09-12T02:12:46.535957+0000","last_peered":"2024-09-12T02:12:46.535957+0000","last_clean":"2024-09-12T02:12:46.535957+0000","last_became_active":"2024-09-12T02:12:12.676818+0000","last_became_peered":"2024-09-12T02:12:12.676818+0000","last_unstale":"2024-09-12T02:12:46.535957+0000","last_undegraded":"2024-09-12T02:12:46.535957+0000","last_fullsized":"2024-09-12T02:12:46.535957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:31.734571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.542138+0000","last_change":"2024-09-12T02:12:12.691436+0000","last_active":"2024-09-12T02:12:46.542138+0000","last_peered":"2024-09-12T02:12:46.542138+0000","last_clean":"2024-09-12T02:12:46.542138+0000","last_became_active":"2024-09-12T02:12:12.691123+0000","last_became_peered":"2024-09-12T02:12:12.691123+0000","last_unstale":"2024-09-12T02:12:46.542138+0000","last_undegraded":"2024-09-12T02:12:46.542138+0000","last_fullsized":"2024-09-12T02:12:46.542138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:40.367825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.531441+0000","last_change":"2024-09-12T02:12:12.694662+0000","last_active":"2024-09-12T02:12:46.531441+0000","last_peered":"2024-09-12T02:12:46.531441+0000","last_clean":"2024-09-12T02:12:46.531441+0000","last_became_active":"2024-09-12T02:12:12.693454+0000","last_became_peered":"2024-09-12T02:12:12.693454+0000","last_unstale":"2024-09-12T02:12:46.531441+0000","last_undegraded":"2024-09-12T02:12:46.531441+0000","last_fullsized":"2024-09-12T02:12:46.531441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:14.818573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537146+0000","last_change":"2024-09-12T02:12:12.693045+0000","last_active":"2024-09-12T02:12:46.537146+0000","last_peered":"2024-09-12T02:12:46.537146+0000","last_clean":"2024-09-12T02:12:46.537146+0000","last_became_active":"2024-09-12T02:12:12.692520+0000","last_became_peered":"2024-09-12T02:12:12.692520+0000","last_unstale":"2024-09-12T02:12:46.537146+0000","last_undegraded":"2024-09-12T02:12:46.537146+0000","last_fullsized":"2024-09-12T02:12:46.537146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.613656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.535261+0000","last_change":"2024-09-12T02:12:12.677141+0000","last_active":"2024-09-12T02:12:46.535261+0000","last_peered":"2024-09-12T02:12:46.535261+0000","last_clean":"2024-09-12T02:12:46.535261+0000","last_became_active":"2024-09-12T02:12:12.676828+0000","last_became_peered":"2024-09-12T02:12:12.676828+0000","last_unstale":"2024-09-12T02:12:46.535261+0000","last_undegraded":"2024-09-12T02:12:46.535261+0000","last_fullsized":"2024-09-12T02:12:46.535261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:51.355531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532025+0000","last_change":"2024-09-12T02:12:12.688588+0000","last_active":"2024-09-12T02:12:46.532025+0000","last_peered":"2024-09-12T02:12:46.532025+0000","last_clean":"2024-09-12T02:12:46.532025+0000","last_became_active":"2024-09-12T02:12:12.688275+0000","last_became_peered":"2024-09-12T02:12:12.688275+0000","last_unstale":"2024-09-12T02:12:46.532025+0000","last_undegraded":"2024-09-12T02:12:46.532025+0000","last_fullsized":"2024-09-12T02:12:46.532025+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:28.540937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.532691+0000","last_change":"2024-09-12T02:12:12.685463+0000","last_active":"2024-09-12T02:12:46.532691+0000","last_peered":"2024-09-12T02:12:46.532691+0000","last_clean":"2024-09-12T02:12:46.532691+0000","last_became_active":"2024-09-12T02:12:12.684219+0000","last_became_peered":"2024-09-12T02:12:12.684219+0000","last_unstale":"2024-09-12T02:12:46.532691+0000","last_undegraded":"2024-09-12T02:12:46.532691+0000","last_fullsized":"2024-09-12T02:12:46.532691+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:09.512781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537745+0000","last_change":"2024-09-12T02:12:12.699531+0000","last_active":"2024-09-12T02:12:46.537745+0000","last_peered":"2024-09-12T02:12:46.537745+0000","last_clean":"2024-09-12T02:12:46.537745+0000","last_became_active":"2024-09-12T02:12:12.691874+0000","last_became_peered":"2024-09-12T02:12:12.691874+0000","last_unstale":"2024-09-12T02:12:46.537745+0000","last_undegraded":"2024-09-12T02:12:46.537745+0000","last_fullsized":"2024-09-12T02:12:46.537745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:32.484656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537889+0000","last_change":"2024-09-12T02:12:12.691135+0000","last_active":"2024-09-12T02:12:46.537889+0000","last_peered":"2024-09-12T02:12:46.537889+0000","last_clean":"2024-09-12T02:12:46.537889+0000","last_became_active":"2024-09-12T02:12:12.690812+0000","last_became_peered":"2024-09-12T02:12:12.690812+0000","last_unstale":"2024-09-12T02:12:46.537889+0000","last_undegraded":"2024-09-12T02:12:46.537889+0000","last_fullsized":"2024-09-12T02:12:46.537889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:50.835731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T02:12:46.537531+0000","last_change":"2024-09-12T02:12:12.697439+0000","last_active":"2024-09-12T02:12:46.537531+0000","last_peered":"2024-09-12T02:12:46.537531+0000","last_clean":"2024-09-12T02:12:46.537531+0000","last_became_active":"2024-09-12T02:12:12.697142+0000","last_became_peered":"2024-09-12T02:12:12.697142+0000","last_unstale":"2024-09-12T02:12:46.537531+0000","last_undegraded":"2024-09-12T02:12:46.537531+0000","last_fullsized":"2024-09-12T02:12:46.537531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:12.032053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60752,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":146,"num_read_kb":137,"num_write":160,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":182256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449116,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":538446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678050,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37068,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708084,"statfs":{"total":95995035648,"available":95957078016,"internally_reserved":0,"allocated":1765376,"data_stored":1182351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841574,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1101824,"data_stored":542666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103213,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":538378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332145,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1691648,"data_stored":1134401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495671,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1077248,"data_stored":533746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757310,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28684,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716468,"statfs":{"total":95995035648,"available":95965663232,"internally_reserved":0,"allocated":1699840,"data_stored":1129989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920835,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1089536,"data_stored":538396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149767,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1089536,"data_stored":533940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1163264,"data_stored":592148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36456,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708696,"statfs":{"total":95995035648,"available":95957704704,"internally_reserved":0,"allocated":1138688,"data_stored":590405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1101824,"data_stored":535134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:13:26.139 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:13:26.139 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T02:13:26.140 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T02:13:26.510 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:26.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:26 smithi136 ceph-mon[35814]: from='client.24772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:13:26.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:26 smithi136 ceph-mon[35814]: pgmap v345: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-09-12T02:13:26.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:26 smithi110 ceph-mon[30548]: from='client.24772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:13:26.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:26 smithi110 ceph-mon[30548]: pgmap v345: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-09-12T02:13:27.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:26 smithi115 ceph-mon[35351]: from='client.24772 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:13:27.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:26 smithi115 ceph-mon[35351]: pgmap v345: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-09-12T02:13:27.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.098+0000 7faa60e00640 1 -- 172.21.15.110:0/2903554454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5c1037c0 msgr2=0x7faa5c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:27.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.098+0000 7faa60e00640 1 --2- 172.21.15.110:0/2903554454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5c1037c0 0x7faa5c10a050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faa54009900 tx=0x7faa5402a410 comp rx=0 tx=0).stop 2024-09-12T02:13:27.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.098+0000 7faa60e00640 1 -- 172.21.15.110:0/2903554454 shutdown_connections 2024-09-12T02:13:27.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.098+0000 7faa60e00640 1 --2- 172.21.15.110:0/2903554454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5c1037c0 0x7faa5c10a050 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:27.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.098+0000 7faa60e00640 1 --2- 172.21.15.110:0/2903554454 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa5c102e00 0x7faa5c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:27.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.098+0000 7faa60e00640 1 --2- 172.21.15.110:0/2903554454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa5c101c00 0x7faa5c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:27.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.098+0000 7faa60e00640 1 -- 172.21.15.110:0/2903554454 >> 172.21.15.110:0/2903554454 conn(0x7faa5c0fd390 msgr2=0x7faa5c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:27.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.099+0000 7faa60e00640 1 -- 172.21.15.110:0/2903554454 shutdown_connections 2024-09-12T02:13:27.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.099+0000 7faa60e00640 1 -- 172.21.15.110:0/2903554454 wait complete. 2024-09-12T02:13:27.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.100+0000 7faa60e00640 1 Processor -- start 2024-09-12T02:13:27.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.100+0000 7faa60e00640 1 -- start start 2024-09-12T02:13:27.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.100+0000 7faa60e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5c101c00 0x7faa5c197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.100+0000 7faa60e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa5c102e00 0x7faa5c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.100+0000 7faa60e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa5c1037c0 0x7faa5c19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.100+0000 7faa60e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c10d8b0 con 0x7faa5c101c00 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.100+0000 7faa60e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c10d730 con 0x7faa5c1037c0 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.100+0000 7faa60e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7faa5c10da30 con 0x7faa5c102e00 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa59e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5c101c00 0x7faa5c197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa51400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa5c102e00 0x7faa5c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa59e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5c101c00 0x7faa5c197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52582/0 (socket says 172.21.15.110:52582) 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa59e00640 1 -- 172.21.15.110:0/3084337414 learned_addr learned my addr 172.21.15.110:0/3084337414 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa51400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa5c102e00 0x7faa5c1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:43630/0 (socket says 172.21.15.110:43630) 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa5a800640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa5c1037c0 0x7faa5c19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa51400640 1 -- 172.21.15.110:0/3084337414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa5c1037c0 msgr2=0x7faa5c19f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:27.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa51400640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa5c1037c0 0x7faa5c19f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:27.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa51400640 1 -- 172.21.15.110:0/3084337414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5c101c00 msgr2=0x7faa5c197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:27.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa51400640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5c101c00 0x7faa5c197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:27.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa51400640 1 -- 172.21.15.110:0/3084337414 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa5c19faa0 con 0x7faa5c102e00 2024-09-12T02:13:27.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa59e00640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5c101c00 0x7faa5c197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:13:27.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.101+0000 7faa51400640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa5c102e00 0x7faa5c1983b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faa4400e9f0 tx=0x7faa4400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:27.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.102+0000 7faa53400640 1 -- 172.21.15.110:0/3084337414 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4400ccc0 con 0x7faa5c102e00 2024-09-12T02:13:27.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.102+0000 7faa60e00640 1 -- 172.21.15.110:0/3084337414 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa5c19fd90 con 0x7faa5c102e00 2024-09-12T02:13:27.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.102+0000 7faa53400640 1 -- 172.21.15.110:0/3084337414 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa44010910 con 0x7faa5c102e00 2024-09-12T02:13:27.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.102+0000 7faa53400640 1 -- 172.21.15.110:0/3084337414 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa44018960 con 0x7faa5c102e00 2024-09-12T02:13:27.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.102+0000 7faa60e00640 1 -- 172.21.15.110:0/3084337414 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa5c1a0250 con 0x7faa5c102e00 2024-09-12T02:13:27.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.103+0000 7faa60e00640 1 -- 172.21.15.110:0/3084337414 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa5c108fb0 con 0x7faa5c102e00 2024-09-12T02:13:27.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.105+0000 7faa53400640 1 -- 172.21.15.110:0/3084337414 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7faa44010ac0 con 0x7faa5c102e00 2024-09-12T02:13:27.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.106+0000 7faa53400640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7faa400a2cc0 0x7faa400a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:27.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.106+0000 7faa53400640 1 -- 172.21.15.110:0/3084337414 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7faa440cfb60 con 0x7faa5c102e00 2024-09-12T02:13:27.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.106+0000 7faa59e00640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7faa400a2cc0 0x7faa400a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:27.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.107+0000 7faa59e00640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7faa400a2cc0 0x7faa400a5180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00f7b0 tx=0x7faa4c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:27.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.108+0000 7faa53400640 1 -- 172.21.15.110:0/3084337414 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa4409bf70 con 0x7faa5c102e00 2024-09-12T02:13:27.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.343+0000 7faa60e00640 1 -- 172.21.15.110:0/3084337414 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7faa5c062e90 con 0x7faa5c102e00 2024-09-12T02:13:27.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.349+0000 7faa53400640 1 -- 172.21.15.110:0/3084337414 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7faa440a0270 con 0x7faa5c102e00 2024-09-12T02:13:27.350 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-09-12T02:13:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQBHTuJmNbmcFBAAel4RJONge5OXxDauY3HURQ== 2024-09-12T02:13:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.352+0000 7faa60e00640 1 -- 172.21.15.110:0/3084337414 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7faa400a2cc0 msgr2=0x7faa400a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:27.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.352+0000 7faa60e00640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7faa400a2cc0 0x7faa400a5180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00f7b0 tx=0x7faa4c009500 comp rx=0 tx=0).stop 2024-09-12T02:13:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.352+0000 7faa60e00640 1 -- 172.21.15.110:0/3084337414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa5c102e00 msgr2=0x7faa5c1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.352+0000 7faa60e00640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa5c102e00 0x7faa5c1983b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faa4400e9f0 tx=0x7faa4400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:13:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.352+0000 7faa60e00640 1 -- 172.21.15.110:0/3084337414 shutdown_connections 2024-09-12T02:13:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.352+0000 7faa60e00640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7faa400a2cc0 0x7faa400a5180 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.352+0000 7faa60e00640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa5c1037c0 0x7faa5c19f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.352+0000 7faa60e00640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa5c102e00 0x7faa5c1983b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.352+0000 7faa60e00640 1 --2- 172.21.15.110:0/3084337414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5c101c00 0x7faa5c197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.352+0000 7faa60e00640 1 -- 172.21.15.110:0/3084337414 >> 172.21.15.110:0/3084337414 conn(0x7faa5c0fd390 msgr2=0x7faa5c106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.352+0000 7faa60e00640 1 -- 172.21.15.110:0/3084337414 shutdown_connections 2024-09-12T02:13:27.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:27.352+0000 7faa60e00640 1 -- 172.21.15.110:0/3084337414 wait complete. 2024-09-12T02:13:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:27 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3084337414' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:13:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:27 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:13:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:27 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:13:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:27 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3084337414' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:13:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:27 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:13:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:27 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:13:28.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:27 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3084337414' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:13:28.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:27 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T02:13:28.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:27 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T02:13:28.310 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:13:28.310 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T02:13:28.310 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T02:13:28.392 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T02:13:28.393 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T02:13:28.393 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T02:13:28.800 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:28.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:28 smithi136 ceph-mon[35814]: pgmap v346: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-09-12T02:13:28.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:28 smithi110 ceph-mon[30548]: pgmap v346: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-09-12T02:13:28.945 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:28 smithi115 ceph-mon[35351]: pgmap v346: 129 pgs: 129 active+clean; 636 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-09-12T02:13:29.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.392+0000 7f5ca7800640 1 -- 172.21.15.110:0/2492693803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca010e3c0 msgr2=0x7f5ca0110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:29.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.392+0000 7f5ca7800640 1 --2- 172.21.15.110:0/2492693803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca010e3c0 0x7f5ca0110810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009ca0 tx=0x7f5c9802a950 comp rx=0 tx=0).stop 2024-09-12T02:13:29.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.392+0000 7f5ca7800640 1 -- 172.21.15.110:0/2492693803 shutdown_connections 2024-09-12T02:13:29.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.392+0000 7f5ca7800640 1 --2- 172.21.15.110:0/2492693803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca010e3c0 0x7f5ca0110810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:29.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.392+0000 7f5ca7800640 1 --2- 172.21.15.110:0/2492693803 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ca0074f40 0x7f5ca010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:29.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.392+0000 7f5ca7800640 1 --2- 172.21.15.110:0/2492693803 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ca0074620 0x7f5ca0074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:29.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.392+0000 7f5ca7800640 1 -- 172.21.15.110:0/2492693803 >> 172.21.15.110:0/2492693803 conn(0x7f5ca00fd8c0 msgr2=0x7f5ca00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:29.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.392+0000 7f5ca7800640 1 -- 172.21.15.110:0/2492693803 shutdown_connections 2024-09-12T02:13:29.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.393+0000 7f5ca7800640 1 -- 172.21.15.110:0/2492693803 wait complete. 2024-09-12T02:13:29.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.393+0000 7f5ca7800640 1 Processor -- start 2024-09-12T02:13:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.394+0000 7f5ca7800640 1 -- start start 2024-09-12T02:13:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.394+0000 7f5ca7800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ca0074620 0x7f5ca019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.394+0000 7f5ca7800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca0074f40 0x7f5ca019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.394+0000 7f5ca7800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ca010e3c0 0x7f5ca019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.394+0000 7f5ca7800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca01141b0 con 0x7f5ca0074f40 2024-09-12T02:13:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.394+0000 7f5ca7800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0114030 con 0x7f5ca0074620 2024-09-12T02:13:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.394+0000 7f5ca7800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca0114330 con 0x7f5ca010e3c0 2024-09-12T02:13:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.394+0000 7f5c9fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca0074f40 0x7f5ca019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.394+0000 7f5ca5800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ca010e3c0 0x7f5ca019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:29.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.394+0000 7f5ca5800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ca010e3c0 0x7f5ca019ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:55556/0 (socket says 172.21.15.110:55556) 2024-09-12T02:13:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.394+0000 7f5ca5800640 1 -- 172.21.15.110:0/1322303941 learned_addr learned my addr 172.21.15.110:0/1322303941 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.394+0000 7f5ca4e00640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ca0074620 0x7f5ca019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.395+0000 7f5ca5800640 1 -- 172.21.15.110:0/1322303941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ca0074620 msgr2=0x7f5ca019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.395+0000 7f5ca5800640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ca0074620 0x7f5ca019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.395+0000 7f5ca5800640 1 -- 172.21.15.110:0/1322303941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca0074f40 msgr2=0x7f5ca019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.395+0000 7f5ca5800640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca0074f40 0x7f5ca019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.395+0000 7f5ca5800640 1 -- 172.21.15.110:0/1322303941 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca019f600 con 0x7f5ca010e3c0 2024-09-12T02:13:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.395+0000 7f5ca4e00640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ca0074620 0x7f5ca019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:13:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.395+0000 7f5ca5800640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ca010e3c0 0x7f5ca019ef20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009dc0 tx=0x7f5c98003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.395+0000 7f5c9d600640 1 -- 172.21.15.110:0/1322303941 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98034040 con 0x7f5ca010e3c0 2024-09-12T02:13:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.395+0000 7f5c9d600640 1 -- 172.21.15.110:0/1322303941 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c98003e50 con 0x7f5ca010e3c0 2024-09-12T02:13:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.395+0000 7f5c9d600640 1 -- 172.21.15.110:0/1322303941 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c980046c0 con 0x7f5ca010e3c0 2024-09-12T02:13:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.395+0000 7f5ca7800640 1 -- 172.21.15.110:0/1322303941 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca019f890 con 0x7f5ca010e3c0 2024-09-12T02:13:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.395+0000 7f5ca7800640 1 -- 172.21.15.110:0/1322303941 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca01a71d0 con 0x7f5ca010e3c0 2024-09-12T02:13:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.396+0000 7f5ca7800640 1 -- 172.21.15.110:0/1322303941 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca0074a00 con 0x7f5ca010e3c0 2024-09-12T02:13:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.398+0000 7f5c9d600640 1 -- 172.21.15.110:0/1322303941 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5c98037020 con 0x7f5ca010e3c0 2024-09-12T02:13:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.399+0000 7f5c9d600640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5c880a2c90 0x7f5c880a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.400+0000 7f5c9d600640 1 -- 172.21.15.110:0/1322303941 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f5c980f0300 con 0x7f5ca010e3c0 2024-09-12T02:13:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.400+0000 7f5ca4e00640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5c880a2c90 0x7f5c880a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.400+0000 7f5ca4e00640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5c880a2c90 0x7f5c880a5150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009c20 tx=0x7f5c94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:29.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.403+0000 7f5c9d600640 1 -- 172.21.15.110:0/1322303941 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c980bce70 con 0x7f5ca010e3c0 2024-09-12T02:13:29.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.623+0000 7f5ca7800640 1 -- 172.21.15.110:0/1322303941 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5ca01a7490 con 0x7f5ca010e3c0 2024-09-12T02:13:29.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.627+0000 7f5c9d600640 1 -- 172.21.15.110:0/1322303941 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263206 (secure 0 0 0) 0x7f5c980bc770 con 0x7f5ca010e3c0 2024-09-12T02:13:29.631 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:13:29.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.631+0000 7f5ca7800640 1 -- 172.21.15.110:0/1322303941 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5c880a2c90 msgr2=0x7f5c880a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:29.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.631+0000 7f5ca7800640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5c880a2c90 0x7f5c880a5150 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009c20 tx=0x7f5c94005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:29.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.631+0000 7f5ca7800640 1 -- 172.21.15.110:0/1322303941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ca010e3c0 msgr2=0x7f5ca019ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:29.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.631+0000 7f5ca7800640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ca010e3c0 0x7f5ca019ef20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009dc0 tx=0x7f5c98003ce0 comp rx=0 tx=0).stop 2024-09-12T02:13:29.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.631+0000 7f5ca7800640 1 -- 172.21.15.110:0/1322303941 shutdown_connections 2024-09-12T02:13:29.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.631+0000 7f5ca7800640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5c880a2c90 0x7f5c880a5150 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:29.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.631+0000 7f5ca7800640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5ca010e3c0 0x7f5ca019ef20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:29.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.631+0000 7f5ca7800640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca0074f40 0x7f5ca019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:29.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.631+0000 7f5ca7800640 1 --2- 172.21.15.110:0/1322303941 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5ca0074620 0x7f5ca019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:29.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.631+0000 7f5ca7800640 1 -- 172.21.15.110:0/1322303941 >> 172.21.15.110:0/1322303941 conn(0x7f5ca00fd8c0 msgr2=0x7f5ca00fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:29.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.631+0000 7f5ca7800640 1 -- 172.21.15.110:0/1322303941 shutdown_connections 2024-09-12T02:13:29.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:29.632+0000 7f5ca7800640 1 -- 172.21.15.110:0/1322303941 wait complete. 2024-09-12T02:13:29.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:29 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1322303941' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:13:29.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:29 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1322303941' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:13:30.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:29 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1322303941' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T02:13:30.598 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":511769794},{"type":"v1","addr":"172.21.15.110:6801","nonce":511769794}]},"active_addr":"172.21.15.110:6801/511769794","active_change":"2024-09-12T02:04:45.356757+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.110:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":3294226687}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2937283686}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":1450306336}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":1555464732}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":405127763}]}]} 2024-09-12T02:13:30.605 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T02:13:30.605 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T02:13:30.605 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:13:30.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:30 smithi136 ceph-mon[35814]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-12T02:13:30.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:30 smithi110 ceph-mon[30548]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-12T02:13:30.972 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:31.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:30 smithi115 ceph-mon[35351]: pgmap v347: 129 pgs: 129 active+clean; 641 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-12T02:13:31.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.543+0000 7f8ccc400640 1 -- 172.21.15.110:0/3218810082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cc4103ff0 msgr2=0x7f8cc41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.543+0000 7f8ccc400640 1 --2- 172.21.15.110:0/3218810082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cc4103ff0 0x7f8cc41043d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8009900 tx=0x7f8cb802a410 comp rx=0 tx=0).stop 2024-09-12T02:13:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.543+0000 7f8ccc400640 1 -- 172.21.15.110:0/3218810082 shutdown_connections 2024-09-12T02:13:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.543+0000 7f8ccc400640 1 --2- 172.21.15.110:0/3218810082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cc4109120 0x7f8cc4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.543+0000 7f8ccc400640 1 --2- 172.21.15.110:0/3218810082 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc41049a0 0x7f8cc41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.543+0000 7f8ccc400640 1 --2- 172.21.15.110:0/3218810082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cc4103ff0 0x7f8cc41043d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.543+0000 7f8ccc400640 1 -- 172.21.15.110:0/3218810082 >> 172.21.15.110:0/3218810082 conn(0x7f8cc40ffa90 msgr2=0x7f8cc4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.543+0000 7f8ccc400640 1 -- 172.21.15.110:0/3218810082 shutdown_connections 2024-09-12T02:13:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.543+0000 7f8ccc400640 1 -- 172.21.15.110:0/3218810082 wait complete. 2024-09-12T02:13:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.544+0000 7f8ccc400640 1 Processor -- start 2024-09-12T02:13:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.544+0000 7f8ccc400640 1 -- start start 2024-09-12T02:13:31.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.544+0000 7f8ccc400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cc4103ff0 0x7f8cc419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:31.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.544+0000 7f8ccc400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc41049a0 0x7f8cc419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:31.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8ccc400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cc4109120 0x7f8cc419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:31.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8ccc400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc41141a0 con 0x7f8cc4103ff0 2024-09-12T02:13:31.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8ccc400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc4114020 con 0x7f8cc41049a0 2024-09-12T02:13:31.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8ccc400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc4114320 con 0x7f8cc4109120 2024-09-12T02:13:31.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8cc9a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cc4103ff0 0x7f8cc419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:31.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8cc9000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc41049a0 0x7f8cc419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:31.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8cc9a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cc4103ff0 0x7f8cc419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59240/0 (socket says 172.21.15.110:59240) 2024-09-12T02:13:31.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8cc9a00640 1 -- 172.21.15.110:0/1579177219 learned_addr learned my addr 172.21.15.110:0/1579177219 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:31.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8cca400640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cc4109120 0x7f8cc419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:31.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8cc9000640 1 -- 172.21.15.110:0/1579177219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cc4109120 msgr2=0x7f8cc419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8cc9000640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cc4109120 0x7f8cc419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8cc9000640 1 -- 172.21.15.110:0/1579177219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cc4103ff0 msgr2=0x7f8cc419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8cc9000640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cc4103ff0 0x7f8cc419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8cc9000640 1 -- 172.21.15.110:0/1579177219 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc419f5d0 con 0x7f8cc41049a0 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.545+0000 7f8cca400640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cc4109120 0x7f8cc419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.546+0000 7f8cc9000640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc41049a0 0x7f8cc419ab60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000d6d0 tx=0x7f8cb000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.546+0000 7f8cc2000640 1 -- 172.21.15.110:0/1579177219 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0017070 con 0x7f8cc41049a0 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.546+0000 7f8cc2000640 1 -- 172.21.15.110:0/1579177219 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cb0009820 con 0x7f8cc41049a0 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.546+0000 7f8ccc400640 1 -- 172.21.15.110:0/1579177219 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc419f8c0 con 0x7f8cc41049a0 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.546+0000 7f8cc2000640 1 -- 172.21.15.110:0/1579177219 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb0004d00 con 0x7f8cc41049a0 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.546+0000 7f8ccc400640 1 -- 172.21.15.110:0/1579177219 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc41a71a0 con 0x7f8cc41049a0 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.547+0000 7f8ccc400640 1 -- 172.21.15.110:0/1579177219 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc41043d0 con 0x7f8cc41049a0 2024-09-12T02:13:31.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.550+0000 7f8cc2000640 1 -- 172.21.15.110:0/1579177219 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f8cb00099d0 con 0x7f8cc41049a0 2024-09-12T02:13:31.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.551+0000 7f8cc2000640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8cac0a2c10 0x7f8cac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:31.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.551+0000 7f8cc2000640 1 -- 172.21.15.110:0/1579177219 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f8cb00cf240 con 0x7f8cc41049a0 2024-09-12T02:13:31.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.551+0000 7f8cc9a00640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8cac0a2c10 0x7f8cac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:31.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.552+0000 7f8cc9a00640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8cac0a2c10 0x7f8cac0a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80096c0 tx=0x7f8cb80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:31.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.552+0000 7f8cc2000640 1 -- 172.21.15.110:0/1579177219 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8cb009bca0 con 0x7f8cc41049a0 2024-09-12T02:13:31.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.731+0000 7f8ccc400640 1 -- 172.21.15.110:0/1579177219 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cc402d7c0 con 0x7f8cc41049a0 2024-09-12T02:13:31.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.733+0000 7f8cc2000640 1 -- 172.21.15.110:0/1579177219 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24795 (secure 0 0 0) 0x7f8cb009b5a0 con 0x7f8cc41049a0 2024-09-12T02:13:31.733 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:13:31.733 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":95,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:12:46.523937+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:12:08.596125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:12:11.312393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:12:21.215161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:13:31.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.735+0000 7f8ccc400640 1 -- 172.21.15.110:0/1579177219 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8cac0a2c10 msgr2=0x7f8cac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:31.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.735+0000 7f8ccc400640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8cac0a2c10 0x7f8cac0a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80096c0 tx=0x7f8cb80046c0 comp rx=0 tx=0).stop 2024-09-12T02:13:31.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.735+0000 7f8ccc400640 1 -- 172.21.15.110:0/1579177219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc41049a0 msgr2=0x7f8cc419ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:31.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.735+0000 7f8ccc400640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc41049a0 0x7f8cc419ab60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8cb000d6d0 tx=0x7f8cb000db90 comp rx=0 tx=0).stop 2024-09-12T02:13:31.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.735+0000 7f8ccc400640 1 -- 172.21.15.110:0/1579177219 shutdown_connections 2024-09-12T02:13:31.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.735+0000 7f8ccc400640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8cac0a2c10 0x7f8cac0a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:31.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.735+0000 7f8ccc400640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8cc4109120 0x7f8cc419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:31.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.735+0000 7f8ccc400640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8cc41049a0 0x7f8cc419ab60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:31.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.735+0000 7f8ccc400640 1 --2- 172.21.15.110:0/1579177219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cc4103ff0 0x7f8cc419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:31.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.735+0000 7f8ccc400640 1 -- 172.21.15.110:0/1579177219 >> 172.21.15.110:0/1579177219 conn(0x7f8cc40ffa90 msgr2=0x7f8cc4100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:31.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.735+0000 7f8ccc400640 1 -- 172.21.15.110:0/1579177219 shutdown_connections 2024-09-12T02:13:31.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:31.735+0000 7f8ccc400640 1 -- 172.21.15.110:0/1579177219 wait complete. 2024-09-12T02:13:32.533 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T02:13:32.533 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:13:32.908 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:32.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:32 smithi136 ceph-mon[35814]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-12T02:13:32.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:32 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1579177219' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:13:32.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:32 smithi110 ceph-mon[30548]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-12T02:13:32.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:32 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1579177219' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:13:33.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:32 smithi115 ceph-mon[35351]: pgmap v348: 129 pgs: 129 active+clean; 641 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-09-12T02:13:33.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:32 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1579177219' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:13:33.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.490+0000 7f8508400640 1 -- 172.21.15.110:0/4173408960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8500076720 msgr2=0x7f8500076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:33.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.490+0000 7f8508400640 1 --2- 172.21.15.110:0/4173408960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8500076720 0x7f8500076b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009900 tx=0x7f84f402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:13:33.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.490+0000 7f8508400640 1 -- 172.21.15.110:0/4173408960 shutdown_connections 2024-09-12T02:13:33.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.490+0000 7f8508400640 1 --2- 172.21.15.110:0/4173408960 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8500112a30 0x7f8500114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:33.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.490+0000 7f8508400640 1 --2- 172.21.15.110:0/4173408960 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8500077040 0x7f85001124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:33.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.490+0000 7f8508400640 1 --2- 172.21.15.110:0/4173408960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8500076720 0x7f8500076b00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:33.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.490+0000 7f8508400640 1 -- 172.21.15.110:0/4173408960 >> 172.21.15.110:0/4173408960 conn(0x7f85000ffa90 msgr2=0x7f8500101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:33.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.490+0000 7f8508400640 1 -- 172.21.15.110:0/4173408960 shutdown_connections 2024-09-12T02:13:33.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.491+0000 7f8508400640 1 -- 172.21.15.110:0/4173408960 wait complete. 2024-09-12T02:13:33.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.491+0000 7f8508400640 1 Processor -- start 2024-09-12T02:13:33.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8508400640 1 -- start start 2024-09-12T02:13:33.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8508400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8500076720 0x7f85001a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:33.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8508400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8500077040 0x7f85001a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:33.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8508400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8500112a30 0x7f850019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:33.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8508400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8500118610 con 0x7f8500112a30 2024-09-12T02:13:33.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8508400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8500118490 con 0x7f8500077040 2024-09-12T02:13:33.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8508400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8500118790 con 0x7f8500076720 2024-09-12T02:13:33.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8506400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8500112a30 0x7f850019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:33.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8505a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8500076720 0x7f85001a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8506400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8500112a30 0x7f850019e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59250/0 (socket says 172.21.15.110:59250) 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8506400640 1 -- 172.21.15.110:0/3972881792 learned_addr learned my addr 172.21.15.110:0/3972881792 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8505a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8500076720 0x7f85001a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:55600/0 (socket says 172.21.15.110:55600) 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.492+0000 7f8505000640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8500077040 0x7f85001a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.493+0000 7f8506400640 1 -- 172.21.15.110:0/3972881792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8500076720 msgr2=0x7f85001a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.493+0000 7f8506400640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8500076720 0x7f85001a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.493+0000 7f8506400640 1 -- 172.21.15.110:0/3972881792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8500077040 msgr2=0x7f85001a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.493+0000 7f8506400640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8500077040 0x7f85001a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.493+0000 7f8506400640 1 -- 172.21.15.110:0/3972881792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850019efa0 con 0x7f8500112a30 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.493+0000 7f8506400640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8500112a30 0x7f850019e870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009fd0 tx=0x7f84f800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.493+0000 7f84fe000640 1 -- 172.21.15.110:0/3972881792 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8004d20 con 0x7f8500112a30 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.493+0000 7f84fe000640 1 -- 172.21.15.110:0/3972881792 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84f8005020 con 0x7f8500112a30 2024-09-12T02:13:33.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.493+0000 7f84fe000640 1 -- 172.21.15.110:0/3972881792 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f80116d0 con 0x7f8500112a30 2024-09-12T02:13:33.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.493+0000 7f8508400640 1 -- 172.21.15.110:0/3972881792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850019f290 con 0x7f8500112a30 2024-09-12T02:13:33.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.493+0000 7f8508400640 1 -- 172.21.15.110:0/3972881792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85001ab580 con 0x7f8500112a30 2024-09-12T02:13:33.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.494+0000 7f8508400640 1 -- 172.21.15.110:0/3972881792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8500076b00 con 0x7f8500112a30 2024-09-12T02:13:33.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.496+0000 7f84fe000640 1 -- 172.21.15.110:0/3972881792 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f84f80051d0 con 0x7f8500112a30 2024-09-12T02:13:33.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.497+0000 7f84fe000640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f84e80a2c90 0x7f84e80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:33.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.498+0000 7f84fe000640 1 -- 172.21.15.110:0/3972881792 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f84f80cf950 con 0x7f8500112a30 2024-09-12T02:13:33.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.498+0000 7f8505a00640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f84e80a2c90 0x7f84e80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:33.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.498+0000 7f8505a00640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f84e80a2c90 0x7f84e80a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f84f4006010 tx=0x7f84f4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:33.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.502+0000 7f84fe000640 1 -- 172.21.15.110:0/3972881792 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84f8016030 con 0x7f8500112a30 2024-09-12T02:13:33.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.681+0000 7f8508400640 1 -- 172.21.15.110:0/3972881792 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f850002d7c0 con 0x7f8500112a30 2024-09-12T02:13:33.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.682+0000 7f84fe000640 1 -- 172.21.15.110:0/3972881792 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+24795 (secure 0 0 0) 0x7f84f809bd60 con 0x7f8500112a30 2024-09-12T02:13:33.683 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:13:33.683 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":95,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:12:46.523937+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:12:08.596125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:12:11.312393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:12:21.215161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:13:33.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.685+0000 7f8508400640 1 -- 172.21.15.110:0/3972881792 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f84e80a2c90 msgr2=0x7f84e80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:33.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.685+0000 7f8508400640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f84e80a2c90 0x7f84e80a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f84f4006010 tx=0x7f84f4000bc0 comp rx=0 tx=0).stop 2024-09-12T02:13:33.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.685+0000 7f8508400640 1 -- 172.21.15.110:0/3972881792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8500112a30 msgr2=0x7f850019e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:33.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.685+0000 7f8508400640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8500112a30 0x7f850019e870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009fd0 tx=0x7f84f800ee60 comp rx=0 tx=0).stop 2024-09-12T02:13:33.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.685+0000 7f8508400640 1 -- 172.21.15.110:0/3972881792 shutdown_connections 2024-09-12T02:13:33.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.685+0000 7f8508400640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f84e80a2c90 0x7f84e80a5150 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:33.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.685+0000 7f8508400640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8500112a30 0x7f850019e870 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:33.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.685+0000 7f8508400640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8500077040 0x7f85001a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:33.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.685+0000 7f8508400640 1 --2- 172.21.15.110:0/3972881792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8500076720 0x7f85001a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:33.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.685+0000 7f8508400640 1 -- 172.21.15.110:0/3972881792 >> 172.21.15.110:0/3972881792 conn(0x7f85000ffa90 msgr2=0x7f8500101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:33.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.685+0000 7f8508400640 1 -- 172.21.15.110:0/3972881792 shutdown_connections 2024-09-12T02:13:33.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:33.686+0000 7f8508400640 1 -- 172.21.15.110:0/3972881792 wait complete. 2024-09-12T02:13:34.515 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T02:13:34.515 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T02:13:34.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T02:13:34.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T02:13:34.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T02:13:34.517 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T02:13:34.517 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-12T02:13:34.518 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-12T02:13:34.518 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-12T02:13:34.518 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-12T02:13:34.519 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-12T02:13:34.519 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-12T02:13:34.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:34 smithi110 ceph-mon[30548]: pgmap v349: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-12T02:13:34.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:34 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3972881792' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:13:35.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:34 smithi115 ceph-mon[35351]: pgmap v349: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-12T02:13:35.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:34 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3972881792' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:13:35.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:34 smithi136 ceph-mon[35814]: pgmap v349: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-09-12T02:13:35.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:34 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3972881792' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:13:35.531 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:35.539 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:35.540 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:35.542 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:35.543 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:35.643 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:36.020 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:36.020 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:36.021 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:36.551 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:36.819 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:36 smithi110 ceph-mon[30548]: pgmap v350: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-12T02:13:37.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:36 smithi115 ceph-mon[35351]: pgmap v350: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-12T02:13:37.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.064+0000 7f17cac00640 1 -- 172.21.15.110:0/3061755537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c4074ee0 msgr2=0x7f17c410dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:37.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.064+0000 7f17cac00640 1 --2- 172.21.15.110:0/3061755537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c4074ee0 0x7f17c410dd20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009900 tx=0x7f17b002a480 comp rx=0 tx=0).stop 2024-09-12T02:13:37.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.064+0000 7f17cac00640 1 -- 172.21.15.110:0/3061755537 shutdown_connections 2024-09-12T02:13:37.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.064+0000 7f17cac00640 1 --2- 172.21.15.110:0/3061755537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c410e260 0x7f17c4110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.064+0000 7f17cac00640 1 --2- 172.21.15.110:0/3061755537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c4074ee0 0x7f17c410dd20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.064+0000 7f17cac00640 1 --2- 172.21.15.110:0/3061755537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c40745c0 0x7f17c40749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.064+0000 7f17cac00640 1 -- 172.21.15.110:0/3061755537 >> 172.21.15.110:0/3061755537 conn(0x7f17c40fd740 msgr2=0x7f17c40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.064+0000 7f17cac00640 1 -- 172.21.15.110:0/3061755537 shutdown_connections 2024-09-12T02:13:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.064+0000 7f17cac00640 1 -- 172.21.15.110:0/3061755537 wait complete. 2024-09-12T02:13:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.065+0000 7f17cac00640 1 Processor -- start 2024-09-12T02:13:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.065+0000 7f17cac00640 1 -- start start 2024-09-12T02:13:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.066+0000 7f17cac00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c40745c0 0x7f17c419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.066+0000 7f17cac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c4074ee0 0x7f17c419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.066+0000 7f17cac00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c410e260 0x7f17c419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.066+0000 7f17cac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4114000 con 0x7f17c4074ee0 2024-09-12T02:13:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.066+0000 7f17cac00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4113e80 con 0x7f17c410e260 2024-09-12T02:13:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.066+0000 7f17cac00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f17c4114180 con 0x7f17c40745c0 2024-09-12T02:13:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.066+0000 7f17c9800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c40745c0 0x7f17c419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.066+0000 7f17ca200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c410e260 0x7f17c419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.066+0000 7f17ca200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c410e260 0x7f17c419ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:42078/0 (socket says 172.21.15.110:42078) 2024-09-12T02:13:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.066+0000 7f17c9800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c40745c0 0x7f17c419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:55610/0 (socket says 172.21.15.110:55610) 2024-09-12T02:13:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.066+0000 7f17ca200640 1 -- 172.21.15.110:0/1038694995 learned_addr learned my addr 172.21.15.110:0/1038694995 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:37.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.066+0000 7f17c8e00640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c4074ee0 0x7f17c419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:37.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.067+0000 7f17ca200640 1 -- 172.21.15.110:0/1038694995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c40745c0 msgr2=0x7f17c419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:37.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.067+0000 7f17ca200640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c40745c0 0x7f17c419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.067+0000 7f17ca200640 1 -- 172.21.15.110:0/1038694995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c4074ee0 msgr2=0x7f17c419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.067+0000 7f17ca200640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17c4074ee0 0x7f17c419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.067+0000 7f17ca200640 1 -- 172.21.15.110:0/1038694995 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c419f570 con 0x7f17c410e260 2024-09-12T02:13:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.067+0000 7f17c9800640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c40745c0 0x7f17c419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:13:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.067+0000 7f17ca200640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c410e260 0x7f17c419ee90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00e9d0 tx=0x7f17bc00ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.068+0000 7f17c2000640 1 -- 172.21.15.110:0/1038694995 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00cd80 con 0x7f17c410e260 2024-09-12T02:13:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.068+0000 7f17c2000640 1 -- 172.21.15.110:0/1038694995 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17bc005020 con 0x7f17c410e260 2024-09-12T02:13:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.068+0000 7f17c2000640 1 -- 172.21.15.110:0/1038694995 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0116d0 con 0x7f17c410e260 2024-09-12T02:13:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.068+0000 7f17cac00640 1 -- 172.21.15.110:0/1038694995 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c419f860 con 0x7f17c410e260 2024-09-12T02:13:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.068+0000 7f17cac00640 1 -- 172.21.15.110:0/1038694995 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c41a7140 con 0x7f17c410e260 2024-09-12T02:13:37.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.069+0000 7f17cac00640 1 -- 172.21.15.110:0/1038694995 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f17c4062900 con 0x7f17c410e260 2024-09-12T02:13:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.072+0000 7f17c2000640 1 -- 172.21.15.110:0/1038694995 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f17bc0051d0 con 0x7f17c410e260 2024-09-12T02:13:37.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.074+0000 7f17c2000640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f17ac0a2c90 0x7f17ac0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:37.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.074+0000 7f17c2000640 1 -- 172.21.15.110:0/1038694995 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f17bc0cfbb0 con 0x7f17c410e260 2024-09-12T02:13:37.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.074+0000 7f17c9800640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f17ac0a2c90 0x7f17ac0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:37.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.075+0000 7f17c2000640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070] conn(0x7f17ac0adde0 0x7f17ac0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:37.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.075+0000 7f17c2000640 1 -- 172.21.15.110:0/1038694995 --> [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17ac0b0950 con 0x7f17ac0adde0 2024-09-12T02:13:37.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.075+0000 7f17c2000640 1 -- 172.21.15.110:0/1038694995 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f17bc0cff60 con 0x7f17c410e260 2024-09-12T02:13:37.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.075+0000 7f17c8e00640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070] conn(0x7f17ac0adde0 0x7f17ac0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:37.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.075+0000 7f17c9800640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f17ac0a2c90 0x7f17ac0a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f17b8005d00 tx=0x7f17b800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:37.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.076+0000 7f17c8e00640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070] conn(0x7f17ac0adde0 0x7f17ac0b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:37.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.077+0000 7f17c2000640 1 -- 172.21.15.110:0/1038694995 <== osd.1 v2:172.21.15.115:6800/4233466070 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f17ac0b0950 con 0x7f17ac0adde0 2024-09-12T02:13:37.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.104+0000 7f17cac00640 1 -- 172.21.15.110:0/1038694995 --> [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f17c4062d00 con 0x7f17ac0adde0 2024-09-12T02:13:37.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.105+0000 7f17c2000640 1 -- 172.21.15.110:0/1038694995 <== osd.1 v2:172.21.15.115:6800/4233466070 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f17c4062d00 con 0x7f17ac0adde0 2024-09-12T02:13:37.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.105+0000 7f17cac00640 1 -- 172.21.15.110:0/1038694995 >> [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070] conn(0x7f17ac0adde0 msgr2=0x7f17ac0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:37.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.105+0000 7f17cac00640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070] conn(0x7f17ac0adde0 0x7f17ac0b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:37.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.106+0000 7f17cac00640 1 -- 172.21.15.110:0/1038694995 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f17ac0a2c90 msgr2=0x7f17ac0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:37.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.106+0000 7f17cac00640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f17ac0a2c90 0x7f17ac0a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f17b8005d00 tx=0x7f17b800b410 comp rx=0 tx=0).stop 2024-09-12T02:13:37.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.106+0000 7f17cac00640 1 -- 172.21.15.110:0/1038694995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c410e260 msgr2=0x7f17c419ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:37.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.106+0000 7f17cac00640 1 --2- 172.21.15.110:0/1038694995 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17c410e260 0x7f17c419ee90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00e9d0 tx=0x7f17bc00ee90 comp rx=0 tx=0).stop 2024-09-12T02:13:37.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.106+0000 7f17ca200640 1 -- 172.21.15.110:0/1038694995 reap_dead start 2024-09-12T02:13:37.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.106+0000 7f17cac00640 1 -- 172.21.15.110:0/1038694995 shutdown_connections 2024-09-12T02:13:37.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.106+0000 7f17cac00640 1 -- 172.21.15.110:0/1038694995 >> 172.21.15.110:0/1038694995 conn(0x7f17c40fd740 msgr2=0x7f17c40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:37.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.106+0000 7f17cac00640 1 -- 172.21.15.110:0/1038694995 shutdown_connections 2024-09-12T02:13:37.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:37.106+0000 7f17cac00640 1 -- 172.21.15.110:0/1038694995 wait complete. 2024-09-12T02:13:37.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:36 smithi136 ceph-mon[35814]: pgmap v350: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-12T02:13:37.846 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:38.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.417+0000 7efc97200640 1 -- 172.21.15.110:0/944144400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc98103e50 msgr2=0x7efc98104230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:38.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.417+0000 7efc97200640 1 --2- 172.21.15.110:0/944144400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc98103e50 0x7efc98104230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc88009900 tx=0x7efc8802a410 comp rx=0 tx=0).stop 2024-09-12T02:13:38.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.417+0000 7efc97200640 1 -- 172.21.15.110:0/944144400 shutdown_connections 2024-09-12T02:13:38.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.417+0000 7efc97200640 1 --2- 172.21.15.110:0/944144400 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc98109090 0x7efc98110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:38.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.417+0000 7efc97200640 1 --2- 172.21.15.110:0/944144400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc98104800 0x7efc98108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:38.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.417+0000 7efc97200640 1 --2- 172.21.15.110:0/944144400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc98103e50 0x7efc98104230 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:38.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.417+0000 7efc97200640 1 -- 172.21.15.110:0/944144400 >> 172.21.15.110:0/944144400 conn(0x7efc980ff8b0 msgr2=0x7efc98101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:38.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.417+0000 7efc97200640 1 -- 172.21.15.110:0/944144400 shutdown_connections 2024-09-12T02:13:38.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.417+0000 7efc97200640 1 -- 172.21.15.110:0/944144400 wait complete. 2024-09-12T02:13:38.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.418+0000 7efc97200640 1 Processor -- start 2024-09-12T02:13:38.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.418+0000 7efc97200640 1 -- start start 2024-09-12T02:13:38.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.418+0000 7efc97200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc98103e50 0x7efc9819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:38.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.418+0000 7efc97200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc98104800 0x7efc9819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:38.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.418+0000 7efc97200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc98109090 0x7efc9819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:38.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc97200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7efc981140b0 con 0x7efc98104800 2024-09-12T02:13:38.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc97200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efc98113f30 con 0x7efc98103e50 2024-09-12T02:13:38.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc97200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efc98114230 con 0x7efc98109090 2024-09-12T02:13:38.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc95400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc98104800 0x7efc9819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:38.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc95400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc98104800 0x7efc9819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:59308/0 (socket says 172.21.15.110:59308) 2024-09-12T02:13:38.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc95400640 1 -- 172.21.15.110:0/3241769674 learned_addr learned my addr 172.21.15.110:0/3241769674 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:38.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc96800640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc98109090 0x7efc9819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:38.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc95e00640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc98103e50 0x7efc9819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:38.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc95400640 1 -- 172.21.15.110:0/3241769674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc98109090 msgr2=0x7efc9819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:38.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc95400640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efc98109090 0x7efc9819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:38.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc95400640 1 -- 172.21.15.110:0/3241769674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc98103e50 msgr2=0x7efc9819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:38.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc95400640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc98103e50 0x7efc9819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:38.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.419+0000 7efc95400640 1 -- 172.21.15.110:0/3241769674 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9819f5a0 con 0x7efc98104800 2024-09-12T02:13:38.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.420+0000 7efc95400640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc98104800 0x7efc9819ab30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efc8400e9f0 tx=0x7efc8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:38.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.420+0000 7efc8ea00640 1 -- 172.21.15.110:0/3241769674 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8400cd80 con 0x7efc98104800 2024-09-12T02:13:38.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.420+0000 7efc97200640 1 -- 172.21.15.110:0/3241769674 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9819f890 con 0x7efc98104800 2024-09-12T02:13:38.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.420+0000 7efc8ea00640 1 -- 172.21.15.110:0/3241769674 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc84010910 con 0x7efc98104800 2024-09-12T02:13:38.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.420+0000 7efc8ea00640 1 -- 172.21.15.110:0/3241769674 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc840188f0 con 0x7efc98104800 2024-09-12T02:13:38.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.420+0000 7efc97200640 1 -- 172.21.15.110:0/3241769674 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc981a7170 con 0x7efc98104800 2024-09-12T02:13:38.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.421+0000 7efc97200640 1 -- 172.21.15.110:0/3241769674 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc98062900 con 0x7efc98104800 2024-09-12T02:13:38.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.423+0000 7efc8ea00640 1 -- 172.21.15.110:0/3241769674 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7efc84010ac0 con 0x7efc98104800 2024-09-12T02:13:38.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.425+0000 7efc8ea00640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7efc7c0a2c10 0x7efc7c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:38.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.425+0000 7efc8ea00640 1 -- 172.21.15.110:0/3241769674 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7efc840cf900 con 0x7efc98104800 2024-09-12T02:13:38.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.425+0000 7efc95e00640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7efc7c0a2c10 0x7efc7c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:38.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.425+0000 7efc8ea00640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925] conn(0x7efc7c0add60 0x7efc7c0b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:38.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.425+0000 7efc8ea00640 1 -- 172.21.15.110:0/3241769674 --> [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc84012ec0 con 0x7efc7c0add60 2024-09-12T02:13:38.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.425+0000 7efc8ea00640 1 -- 172.21.15.110:0/3241769674 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7efc840d42a0 con 0x7efc98104800 2024-09-12T02:13:38.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.425+0000 7efc96800640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925] conn(0x7efc7c0add60 0x7efc7c0b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:38.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.426+0000 7efc95e00640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7efc7c0a2c10 0x7efc7c0a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc88009230 tx=0x7efc880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:38.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.426+0000 7efc96800640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925] conn(0x7efc7c0add60 0x7efc7c0b0200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:38.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.427+0000 7efc8ea00640 1 -- 172.21.15.110:0/3241769674 <== osd.3 v2:172.21.15.110:6810/938081925 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efc84012ec0 con 0x7efc7c0add60 2024-09-12T02:13:38.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.442+0000 7efc97200640 1 -- 172.21.15.110:0/3241769674 --> [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efc98062d00 con 0x7efc7c0add60 2024-09-12T02:13:38.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.442+0000 7efc8ea00640 1 -- 172.21.15.110:0/3241769674 <== osd.3 v2:172.21.15.110:6810/938081925 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efc98062d00 con 0x7efc7c0add60 2024-09-12T02:13:38.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.442+0000 7efc97200640 1 -- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925] conn(0x7efc7c0add60 msgr2=0x7efc7c0b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:38.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.442+0000 7efc97200640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925] conn(0x7efc7c0add60 0x7efc7c0b0200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:38.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.442+0000 7efc97200640 1 -- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7efc7c0a2c10 msgr2=0x7efc7c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:38.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.442+0000 7efc97200640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7efc7c0a2c10 0x7efc7c0a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc88009230 tx=0x7efc880058d0 comp rx=0 tx=0).stop 2024-09-12T02:13:38.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.442+0000 7efc97200640 1 -- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc98104800 msgr2=0x7efc9819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:38.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.442+0000 7efc97200640 1 --2- 172.21.15.110:0/3241769674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc98104800 0x7efc9819ab30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efc8400e9f0 tx=0x7efc8400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:13:38.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.442+0000 7efc96800640 1 -- 172.21.15.110:0/3241769674 reap_dead start 2024-09-12T02:13:38.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.443+0000 7efc97200640 1 -- 172.21.15.110:0/3241769674 shutdown_connections 2024-09-12T02:13:38.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.443+0000 7efc97200640 1 -- 172.21.15.110:0/3241769674 >> 172.21.15.110:0/3241769674 conn(0x7efc980ff8b0 msgr2=0x7efc98100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:38.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.443+0000 7efc97200640 1 -- 172.21.15.110:0/3241769674 shutdown_connections 2024-09-12T02:13:38.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.443+0000 7efc97200640 1 -- 172.21.15.110:0/3241769674 wait complete. 2024-09-12T02:13:38.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:38 smithi136 ceph-mon[35814]: pgmap v351: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-12T02:13:38.922 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:38 smithi110 ceph-mon[30548]: pgmap v351: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-12T02:13:39.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.031+0000 7f0913e00640 1 -- 172.21.15.110:0/3821814554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090c102790 msgr2=0x7f090c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.031+0000 7f0913e00640 1 --2- 172.21.15.110:0/3821814554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090c102790 0x7f090c1067e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009900 tx=0x7f08f802a410 comp rx=0 tx=0).stop 2024-09-12T02:13:39.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.032+0000 7f0913e00640 1 -- 172.21.15.110:0/3821814554 shutdown_connections 2024-09-12T02:13:39.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.032+0000 7f0913e00640 1 --2- 172.21.15.110:0/3821814554 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f090c106f10 0x7f090c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.032+0000 7f0913e00640 1 --2- 172.21.15.110:0/3821814554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090c102790 0x7f090c1067e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.032+0000 7f0913e00640 1 --2- 172.21.15.110:0/3821814554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f090c101de0 0x7f090c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.032+0000 7f0913e00640 1 -- 172.21.15.110:0/3821814554 >> 172.21.15.110:0/3821814554 conn(0x7f090c0fd8c0 msgr2=0x7f090c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:39.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.032+0000 7f0913e00640 1 -- 172.21.15.110:0/3821814554 shutdown_connections 2024-09-12T02:13:39.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.032+0000 7f0913e00640 1 -- 172.21.15.110:0/3821814554 wait complete. 2024-09-12T02:13:39.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.033+0000 7f0913e00640 1 Processor -- start 2024-09-12T02:13:39.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.033+0000 7f0913e00640 1 -- start start 2024-09-12T02:13:39.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.033+0000 7f0913e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090c101de0 0x7f090c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.033+0000 7f0913e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f090c102790 0x7f090c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.033+0000 7f0913e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f090c106f10 0x7f090c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0913e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f090c111fc0 con 0x7f090c101de0 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0913e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f090c111e40 con 0x7f090c106f10 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0913e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f090c112140 con 0x7f090c102790 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0911400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090c101de0 0x7f090c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0910a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f090c102790 0x7f090c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0911400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090c101de0 0x7f090c198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34932/0 (socket says 172.21.15.110:34932) 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0910a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f090c102790 0x7f090c1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:39074/0 (socket says 172.21.15.110:39074) 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0911400640 1 -- 172.21.15.110:0/382297728 learned_addr learned my addr 172.21.15.110:0/382297728 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0911e00640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f090c106f10 0x7f090c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0910a00640 1 -- 172.21.15.110:0/382297728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f090c106f10 msgr2=0x7f090c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0910a00640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f090c106f10 0x7f090c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0910a00640 1 -- 172.21.15.110:0/382297728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090c101de0 msgr2=0x7f090c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0910a00640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f090c101de0 0x7f090c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.034+0000 7f0910a00640 1 -- 172.21.15.110:0/382297728 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090c19d410 con 0x7f090c102790 2024-09-12T02:13:39.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.035+0000 7f0910a00640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f090c102790 0x7f090c1989a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08f802a930 tx=0x7f08f8003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:39.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.035+0000 7f090a000640 1 -- 172.21.15.110:0/382297728 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f803f070 con 0x7f090c102790 2024-09-12T02:13:39.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.035+0000 7f0913e00640 1 -- 172.21.15.110:0/382297728 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090c19d6a0 con 0x7f090c102790 2024-09-12T02:13:39.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.035+0000 7f090a000640 1 -- 172.21.15.110:0/382297728 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08f8031c90 con 0x7f090c102790 2024-09-12T02:13:39.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.035+0000 7f0913e00640 1 -- 172.21.15.110:0/382297728 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f090c1a4fe0 con 0x7f090c102790 2024-09-12T02:13:39.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.035+0000 7f090a000640 1 -- 172.21.15.110:0/382297728 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8049060 con 0x7f090c102790 2024-09-12T02:13:39.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.036+0000 7f0913e00640 1 -- 172.21.15.110:0/382297728 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f090c062940 con 0x7f090c102790 2024-09-12T02:13:39.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.038+0000 7f090a000640 1 -- 172.21.15.110:0/382297728 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f08f8042070 con 0x7f090c102790 2024-09-12T02:13:39.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.039+0000 7f090a000640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f08f40a2c10 0x7f08f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.039+0000 7f090a000640 1 -- 172.21.15.110:0/382297728 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f08f80efe10 con 0x7f090c102790 2024-09-12T02:13:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.040+0000 7f0911400640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f08f40a2c10 0x7f08f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.040+0000 7f090a000640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118] conn(0x7f08f40add60 0x7f08f40b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.040+0000 7f090a000640 1 -- 172.21.15.110:0/382297728 --> [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08f800b0b0 con 0x7f08f40add60 2024-09-12T02:13:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.040+0000 7f090a000640 1 -- 172.21.15.110:0/382297728 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f08f80f01c0 con 0x7f090c102790 2024-09-12T02:13:39.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.040+0000 7f0911e00640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118] conn(0x7f08f40add60 0x7f08f40b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.040+0000 7f0911400640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f08f40a2c10 0x7f08f40a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0900009cd0 tx=0x7f0900005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:39.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.041+0000 7f0911e00640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118] conn(0x7f08f40add60 0x7f08f40b0200 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:39.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.041+0000 7f090a000640 1 -- 172.21.15.110:0/382297728 <== osd.8 v2:172.21.15.136:6816/3872859118 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f08f800b0b0 con 0x7f08f40add60 2024-09-12T02:13:39.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:38 smithi115 ceph-mon[35351]: pgmap v351: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-12T02:13:39.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.056+0000 7f0913e00640 1 -- 172.21.15.110:0/382297728 --> [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f090c062dc0 con 0x7f08f40add60 2024-09-12T02:13:39.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.057+0000 7f090a000640 1 -- 172.21.15.110:0/382297728 <== osd.8 v2:172.21.15.136:6816/3872859118 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f090c062dc0 con 0x7f08f40add60 2024-09-12T02:13:39.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.057+0000 7f0913e00640 1 -- 172.21.15.110:0/382297728 >> [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118] conn(0x7f08f40add60 msgr2=0x7f08f40b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.057+0000 7f0913e00640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118] conn(0x7f08f40add60 0x7f08f40b0200 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.057+0000 7f0913e00640 1 -- 172.21.15.110:0/382297728 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f08f40a2c10 msgr2=0x7f08f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.057+0000 7f0913e00640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f08f40a2c10 0x7f08f40a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0900009cd0 tx=0x7f0900005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:39.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.057+0000 7f0913e00640 1 -- 172.21.15.110:0/382297728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f090c102790 msgr2=0x7f090c1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.057+0000 7f0913e00640 1 --2- 172.21.15.110:0/382297728 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f090c102790 0x7f090c1989a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f08f802a930 tx=0x7f08f8003b20 comp rx=0 tx=0).stop 2024-09-12T02:13:39.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.057+0000 7f0911e00640 1 -- 172.21.15.110:0/382297728 reap_dead start 2024-09-12T02:13:39.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.057+0000 7f0913e00640 1 -- 172.21.15.110:0/382297728 shutdown_connections 2024-09-12T02:13:39.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.057+0000 7f0913e00640 1 -- 172.21.15.110:0/382297728 >> 172.21.15.110:0/382297728 conn(0x7f090c0fd8c0 msgr2=0x7f090c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:39.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.058+0000 7f0913e00640 1 -- 172.21.15.110:0/382297728 shutdown_connections 2024-09-12T02:13:39.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.058+0000 7f0913e00640 1 -- 172.21.15.110:0/382297728 wait complete. 2024-09-12T02:13:39.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.319+0000 7fe8f7c00640 1 -- 172.21.15.110:0/1560075641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f0100910 msgr2=0x7fe8f0104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.319+0000 7fe8f7c00640 1 --2- 172.21.15.110:0/1560075641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f0100910 0x7fe8f0104f30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc009900 tx=0x7fe8dc02a410 comp rx=0 tx=0).stop 2024-09-12T02:13:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.319+0000 7fe8f7c00640 1 -- 172.21.15.110:0/1560075641 shutdown_connections 2024-09-12T02:13:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.319+0000 7fe8f7c00640 1 --2- 172.21.15.110:0/1560075641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8f010ac90 0x7fe8f010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.319+0000 7fe8f7c00640 1 --2- 172.21.15.110:0/1560075641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f0100910 0x7fe8f0104f30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.319+0000 7fe8f7c00640 1 --2- 172.21.15.110:0/1560075641 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8f0069290 0x7fe8f01049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.319+0000 7fe8f7c00640 1 -- 172.21.15.110:0/1560075641 >> 172.21.15.110:0/1560075641 conn(0x7fe8f00fba90 msgr2=0x7fe8f00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.319+0000 7fe8f7c00640 1 -- 172.21.15.110:0/1560075641 shutdown_connections 2024-09-12T02:13:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.319+0000 7fe8f7c00640 1 -- 172.21.15.110:0/1560075641 wait complete. 2024-09-12T02:13:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.320+0000 7fe8f7c00640 1 Processor -- start 2024-09-12T02:13:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.321+0000 7fe8f7c00640 1 -- start start 2024-09-12T02:13:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.321+0000 7fe8f7c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8f0069290 0x7fe8f010e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.321+0000 7fe8f7c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f0100910 0x7fe8f010ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.321+0000 7fe8f7c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8f010ac90 0x7fe8f010f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.321+0000 7fe8f7c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f0111f40 con 0x7fe8f0100910 2024-09-12T02:13:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.321+0000 7fe8f7c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f0111dc0 con 0x7fe8f010ac90 2024-09-12T02:13:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.321+0000 7fe8f7c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f01120c0 con 0x7fe8f0069290 2024-09-12T02:13:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.321+0000 7fe8f5200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8f0069290 0x7fe8f010e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.322+0000 7fe8efe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f0100910 0x7fe8f010ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.322+0000 7fe8f5c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8f010ac90 0x7fe8f010f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.322+0000 7fe8f5200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8f0069290 0x7fe8f010e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:55622/0 (socket says 172.21.15.110:55622) 2024-09-12T02:13:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.322+0000 7fe8f5200640 1 -- 172.21.15.110:0/117616497 learned_addr learned my addr 172.21.15.110:0/117616497 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.322+0000 7fe8f5c00640 1 -- 172.21.15.110:0/117616497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8f0069290 msgr2=0x7fe8f010e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.322+0000 7fe8f5c00640 1 --2- 172.21.15.110:0/117616497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8f0069290 0x7fe8f010e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.322+0000 7fe8f5c00640 1 -- 172.21.15.110:0/117616497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f0100910 msgr2=0x7fe8f010ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.322+0000 7fe8f5c00640 1 --2- 172.21.15.110:0/117616497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8f0100910 0x7fe8f010ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.322+0000 7fe8f5c00640 1 -- 172.21.15.110:0/117616497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f01a6960 con 0x7fe8f010ac90 2024-09-12T02:13:39.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.322+0000 7fe8f5c00640 1 --2- 172.21.15.110:0/117616497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8f010ac90 0x7fe8f010f3a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8005fd0 tx=0x7fe8e800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:39.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.323+0000 7fe8ed600640 1 -- 172.21.15.110:0/117616497 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e800cdf0 con 0x7fe8f010ac90 2024-09-12T02:13:39.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.323+0000 7fe8ed600640 1 -- 172.21.15.110:0/117616497 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e8005020 con 0x7fe8f010ac90 2024-09-12T02:13:39.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.323+0000 7fe8ed600640 1 -- 172.21.15.110:0/117616497 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80106d0 con 0x7fe8f010ac90 2024-09-12T02:13:39.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.323+0000 7fe8f7c00640 1 -- 172.21.15.110:0/117616497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f01a6c50 con 0x7fe8f010ac90 2024-09-12T02:13:39.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.323+0000 7fe8f7c00640 1 -- 172.21.15.110:0/117616497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f01a7110 con 0x7fe8f010ac90 2024-09-12T02:13:39.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.324+0000 7fe8f7c00640 1 -- 172.21.15.110:0/117616497 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8f010bd00 con 0x7fe8f010ac90 2024-09-12T02:13:39.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.326+0000 7fe8ed600640 1 -- 172.21.15.110:0/117616497 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe8e80054d0 con 0x7fe8f010ac90 2024-09-12T02:13:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.327+0000 7fe8ed600640 1 --2- 172.21.15.110:0/117616497 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe8d80a2c10 0x7fe8d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.327+0000 7fe8ed600640 1 -- 172.21.15.110:0/117616497 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7fe8e80cfd90 con 0x7fe8f010ac90 2024-09-12T02:13:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.327+0000 7fe8f5200640 1 --2- 172.21.15.110:0/117616497 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe8d80a2c10 0x7fe8d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.327+0000 7fe8ed600640 1 --2- 172.21.15.110:0/117616497 >> [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640] conn(0x7fe8d80add60 0x7fe8d80b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.327+0000 7fe8ed600640 1 -- 172.21.15.110:0/117616497 --> [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8d80b08d0 con 0x7fe8d80add60 2024-09-12T02:13:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.327+0000 7fe8ed600640 1 -- 172.21.15.110:0/117616497 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fe8e80d0140 con 0x7fe8f010ac90 2024-09-12T02:13:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.328+0000 7fe8efe00640 1 --2- 172.21.15.110:0/117616497 >> [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640] conn(0x7fe8d80add60 0x7fe8d80b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.328+0000 7fe8f5200640 1 --2- 172.21.15.110:0/117616497 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe8d80a2c10 0x7fe8d80a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009c90 tx=0x7fe8e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.328+0000 7fe8efe00640 1 --2- 172.21.15.110:0/117616497 >> [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640] conn(0x7fe8d80add60 0x7fe8d80b0200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.329+0000 7fe8ed600640 1 -- 172.21.15.110:0/117616497 <== osd.0 v2:172.21.15.110:6802/1183571640 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8d80b08d0 con 0x7fe8d80add60 2024-09-12T02:13:39.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.343+0000 7fe8f7c00640 1 -- 172.21.15.110:0/117616497 --> [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe8f01014d0 con 0x7fe8d80add60 2024-09-12T02:13:39.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.344+0000 7fe8ed600640 1 -- 172.21.15.110:0/117616497 <== osd.0 v2:172.21.15.110:6802/1183571640 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe8f01014d0 con 0x7fe8d80add60 2024-09-12T02:13:39.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.344+0000 7fe8f7c00640 1 -- 172.21.15.110:0/117616497 >> [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640] conn(0x7fe8d80add60 msgr2=0x7fe8d80b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.344+0000 7fe8f7c00640 1 --2- 172.21.15.110:0/117616497 >> [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640] conn(0x7fe8d80add60 0x7fe8d80b0200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.344+0000 7fe8f7c00640 1 -- 172.21.15.110:0/117616497 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe8d80a2c10 msgr2=0x7fe8d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.344+0000 7fe8f7c00640 1 --2- 172.21.15.110:0/117616497 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe8d80a2c10 0x7fe8d80a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009c90 tx=0x7fe8e4005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:39.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.344+0000 7fe8f7c00640 1 -- 172.21.15.110:0/117616497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8f010ac90 msgr2=0x7fe8f010f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.344+0000 7fe8f7c00640 1 --2- 172.21.15.110:0/117616497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe8f010ac90 0x7fe8f010f3a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8005fd0 tx=0x7fe8e800ef10 comp rx=0 tx=0).stop 2024-09-12T02:13:39.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.344+0000 7fe8f5c00640 1 -- 172.21.15.110:0/117616497 reap_dead start 2024-09-12T02:13:39.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.344+0000 7fe8f7c00640 1 -- 172.21.15.110:0/117616497 shutdown_connections 2024-09-12T02:13:39.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.345+0000 7fe8f7c00640 1 -- 172.21.15.110:0/117616497 >> 172.21.15.110:0/117616497 conn(0x7fe8f00fba90 msgr2=0x7fe8f010b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:39.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.345+0000 7fe8f7c00640 1 -- 172.21.15.110:0/117616497 shutdown_connections 2024-09-12T02:13:39.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:38.345+0000 7fe8f7c00640 1 -- 172.21.15.110:0/117616497 wait complete. 2024-09-12T02:13:39.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.780+0000 7fdcbae00640 1 -- 172.21.15.110:0/3647117395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcb4108f60 msgr2=0x7fdcb4110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.780+0000 7fdcbae00640 1 --2- 172.21.15.110:0/3647117395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcb4108f60 0x7fdcb4110ae0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdcac009ca0 tx=0x7fdcac02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.780+0000 7fdcbae00640 1 -- 172.21.15.110:0/3647117395 shutdown_connections 2024-09-12T02:13:39.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.780+0000 7fdcbae00640 1 --2- 172.21.15.110:0/3647117395 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcb4108f60 0x7fdcb4110ae0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.780+0000 7fdcbae00640 1 --2- 172.21.15.110:0/3647117395 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcb41047e0 0x7fdcb4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.780+0000 7fdcbae00640 1 --2- 172.21.15.110:0/3647117395 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcb4103e30 0x7fdcb4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.780+0000 7fdcbae00640 1 -- 172.21.15.110:0/3647117395 >> 172.21.15.110:0/3647117395 conn(0x7fdcb40ff8d0 msgr2=0x7fdcb4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:39.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.780+0000 7fdcbae00640 1 -- 172.21.15.110:0/3647117395 shutdown_connections 2024-09-12T02:13:39.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.780+0000 7fdcbae00640 1 -- 172.21.15.110:0/3647117395 wait complete. 2024-09-12T02:13:39.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.781+0000 7fdcbae00640 1 Processor -- start 2024-09-12T02:13:39.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.781+0000 7fdcbae00640 1 -- start start 2024-09-12T02:13:39.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.782+0000 7fdcbae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcb4103e30 0x7fdcb419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.782+0000 7fdcbae00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcb41047e0 0x7fdcb419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.782+0000 7fdcbae00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcb4108f60 0x7fdcb419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.782+0000 7fdcbae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb4114030 con 0x7fdcb4103e30 2024-09-12T02:13:39.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.782+0000 7fdcbae00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb4113eb0 con 0x7fdcb4108f60 2024-09-12T02:13:39.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.782+0000 7fdcbae00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb41141b0 con 0x7fdcb41047e0 2024-09-12T02:13:39.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.782+0000 7fdcb9a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcb4103e30 0x7fdcb419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.782+0000 7fdcb9a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcb4103e30 0x7fdcb419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34944/0 (socket says 172.21.15.110:34944) 2024-09-12T02:13:39.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.782+0000 7fdcba400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcb4108f60 0x7fdcb419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.782+0000 7fdcb9a00640 1 -- 172.21.15.110:0/2143200356 learned_addr learned my addr 172.21.15.110:0/2143200356 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:39.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.782+0000 7fdcb9000640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcb41047e0 0x7fdcb419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.783+0000 7fdcb9a00640 1 -- 172.21.15.110:0/2143200356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcb41047e0 msgr2=0x7fdcb419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.783+0000 7fdcb9a00640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcb41047e0 0x7fdcb419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.783+0000 7fdcb9a00640 1 -- 172.21.15.110:0/2143200356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcb4108f60 msgr2=0x7fdcb419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.783+0000 7fdcb9a00640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcb4108f60 0x7fdcb419ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.783+0000 7fdcb9a00640 1 -- 172.21.15.110:0/2143200356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb419f430 con 0x7fdcb4103e30 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.783+0000 7fdcb9000640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcb41047e0 0x7fdcb419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.783+0000 7fdcba400640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdcb4108f60 0x7fdcb419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.783+0000 7fdcb9a00640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcb4103e30 0x7fdcb419a480 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdca800b4a0 tx=0x7fdca800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.783+0000 7fdcb2000640 1 -- 172.21.15.110:0/2143200356 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8014070 con 0x7fdcb4103e30 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.783+0000 7fdcb2000640 1 -- 172.21.15.110:0/2143200356 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdca8010af0 con 0x7fdcb4103e30 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.783+0000 7fdcb2000640 1 -- 172.21.15.110:0/2143200356 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8017d10 con 0x7fdcb4103e30 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.783+0000 7fdcbae00640 1 -- 172.21.15.110:0/2143200356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb419f720 con 0x7fdcb4103e30 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.784+0000 7fdcbae00640 1 -- 172.21.15.110:0/2143200356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb41a7000 con 0x7fdcb4103e30 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.784+0000 7fdcbae00640 1 -- 172.21.15.110:0/2143200356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdcb4062900 con 0x7fdcb4103e30 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.786+0000 7fdcb2000640 1 -- 172.21.15.110:0/2143200356 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fdca8017070 con 0x7fdcb4103e30 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.788+0000 7fdcb2000640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdc9c0a2c10 0x7fdc9c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.788+0000 7fdcb2000640 1 -- 172.21.15.110:0/2143200356 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7fdca80cebd0 con 0x7fdcb4103e30 2024-09-12T02:13:39.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.788+0000 7fdcb9000640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdc9c0a2c10 0x7fdc9c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.789+0000 7fdcb2000640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671] conn(0x7fdc9c0add60 0x7fdc9c0b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:39.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.789+0000 7fdcb2000640 1 -- 172.21.15.110:0/2143200356 --> [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdca801ae50 con 0x7fdc9c0add60 2024-09-12T02:13:39.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.789+0000 7fdcb2000640 1 -- 172.21.15.110:0/2143200356 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fdca80cef80 con 0x7fdcb4103e30 2024-09-12T02:13:39.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.789+0000 7fdcba400640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671] conn(0x7fdc9c0add60 0x7fdc9c0b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:39.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.789+0000 7fdcb9000640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdc9c0a2c10 0x7fdc9c0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4100140 tx=0x7fdca000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:39.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.790+0000 7fdcba400640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671] conn(0x7fdc9c0add60 0x7fdc9c0b0200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:39.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.791+0000 7fdcb2000640 1 -- 172.21.15.110:0/2143200356 <== osd.11 v2:172.21.15.136:6824/1064088671 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdca801ae50 con 0x7fdc9c0add60 2024-09-12T02:13:39.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.805+0000 7fdcbae00640 1 -- 172.21.15.110:0/2143200356 --> [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdcb4062d80 con 0x7fdc9c0add60 2024-09-12T02:13:39.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.806+0000 7fdcb2000640 1 -- 172.21.15.110:0/2143200356 <== osd.11 v2:172.21.15.136:6824/1064088671 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdcb4062d80 con 0x7fdc9c0add60 2024-09-12T02:13:39.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.806+0000 7fdcbae00640 1 -- 172.21.15.110:0/2143200356 >> [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671] conn(0x7fdc9c0add60 msgr2=0x7fdc9c0b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.806+0000 7fdcbae00640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671] conn(0x7fdc9c0add60 0x7fdc9c0b0200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.806+0000 7fdcbae00640 1 -- 172.21.15.110:0/2143200356 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdc9c0a2c10 msgr2=0x7fdc9c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.806+0000 7fdcbae00640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdc9c0a2c10 0x7fdc9c0a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4100140 tx=0x7fdca000a5c0 comp rx=0 tx=0).stop 2024-09-12T02:13:39.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.806+0000 7fdcbae00640 1 -- 172.21.15.110:0/2143200356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcb4103e30 msgr2=0x7fdcb419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:39.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.806+0000 7fdcbae00640 1 --2- 172.21.15.110:0/2143200356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcb4103e30 0x7fdcb419a480 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdca800b4a0 tx=0x7fdca800b960 comp rx=0 tx=0).stop 2024-09-12T02:13:39.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.806+0000 7fdcba400640 1 -- 172.21.15.110:0/2143200356 reap_dead start 2024-09-12T02:13:39.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.806+0000 7fdcbae00640 1 -- 172.21.15.110:0/2143200356 shutdown_connections 2024-09-12T02:13:39.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.806+0000 7fdcbae00640 1 -- 172.21.15.110:0/2143200356 >> 172.21.15.110:0/2143200356 conn(0x7fdcb40ff8d0 msgr2=0x7fdcb4100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:39.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.806+0000 7fdcbae00640 1 -- 172.21.15.110:0/2143200356 shutdown_connections 2024-09-12T02:13:39.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.807+0000 7fdcbae00640 1 -- 172.21.15.110:0/2143200356 wait complete. 2024-09-12T02:13:40.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.417+0000 7fb941a00640 1 -- 172.21.15.110:0/2490547609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb93c074f40 msgr2=0x7fb93c10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:40.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.417+0000 7fb941a00640 1 --2- 172.21.15.110:0/2490547609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb93c074f40 0x7fb93c10de80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb928009900 tx=0x7fb92802a480 comp rx=0 tx=0).stop 2024-09-12T02:13:40.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.417+0000 7fb941a00640 1 -- 172.21.15.110:0/2490547609 shutdown_connections 2024-09-12T02:13:40.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.417+0000 7fb941a00640 1 --2- 172.21.15.110:0/2490547609 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb93c10e3c0 0x7fb93c110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.417+0000 7fb941a00640 1 --2- 172.21.15.110:0/2490547609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb93c074f40 0x7fb93c10de80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.417+0000 7fb941a00640 1 --2- 172.21.15.110:0/2490547609 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb93c074620 0x7fb93c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.417+0000 7fb941a00640 1 -- 172.21.15.110:0/2490547609 >> 172.21.15.110:0/2490547609 conn(0x7fb93c0fd8c0 msgr2=0x7fb93c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:40.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.418+0000 7fb941a00640 1 -- 172.21.15.110:0/2490547609 shutdown_connections 2024-09-12T02:13:40.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.418+0000 7fb941a00640 1 -- 172.21.15.110:0/2490547609 wait complete. 2024-09-12T02:13:40.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.419+0000 7fb941a00640 1 Processor -- start 2024-09-12T02:13:40.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.419+0000 7fb941a00640 1 -- start start 2024-09-12T02:13:40.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.419+0000 7fb941a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb93c074620 0x7fb93c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:40.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.419+0000 7fb941a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb93c074f40 0x7fb93c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:40.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.419+0000 7fb941a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb93c10e3c0 0x7fb93c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:40.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.419+0000 7fb941a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c114190 con 0x7fb93c10e3c0 2024-09-12T02:13:40.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.419+0000 7fb941a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c114010 con 0x7fb93c074620 2024-09-12T02:13:40.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.419+0000 7fb941a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb93c114310 con 0x7fb93c074f40 2024-09-12T02:13:40.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb93c10e3c0 0x7fb93c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:40.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb93c074f40 0x7fb93c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:40.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb93c074f40 0x7fb93c19abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:39132/0 (socket says 172.21.15.110:39132) 2024-09-12T02:13:40.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93a000640 1 -- 172.21.15.110:0/2065965450 learned_addr learned my addr 172.21.15.110:0/2065965450 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:40.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93b400640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb93c10e3c0 0x7fb93c19ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34970/0 (socket says 172.21.15.110:34970) 2024-09-12T02:13:40.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93aa00640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb93c074620 0x7fb93c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:40.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93a000640 1 -- 172.21.15.110:0/2065965450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb93c074620 msgr2=0x7fb93c19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:40.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93a000640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb93c074620 0x7fb93c19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93a000640 1 -- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb93c10e3c0 msgr2=0x7fb93c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:40.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93a000640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb93c10e3c0 0x7fb93c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93a000640 1 -- 172.21.15.110:0/2065965450 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93c19f640 con 0x7fb93c074f40 2024-09-12T02:13:40.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93b400640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb93c10e3c0 0x7fb93c19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:13:40.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.420+0000 7fb93a000640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb93c074f40 0x7fb93c19abd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb928004770 tx=0x7fb928003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:40.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.421+0000 7fb933400640 1 -- 172.21.15.110:0/2065965450 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92803f070 con 0x7fb93c074f40 2024-09-12T02:13:40.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.421+0000 7fb933400640 1 -- 172.21.15.110:0/2065965450 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb928031ca0 con 0x7fb93c074f40 2024-09-12T02:13:40.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.421+0000 7fb941a00640 1 -- 172.21.15.110:0/2065965450 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93c19f8d0 con 0x7fb93c074f40 2024-09-12T02:13:40.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.421+0000 7fb933400640 1 -- 172.21.15.110:0/2065965450 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928035030 con 0x7fb93c074f40 2024-09-12T02:13:40.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.421+0000 7fb941a00640 1 -- 172.21.15.110:0/2065965450 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb93c1a7210 con 0x7fb93c074f40 2024-09-12T02:13:40.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.422+0000 7fb941a00640 1 -- 172.21.15.110:0/2065965450 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb93c062980 con 0x7fb93c074f40 2024-09-12T02:13:40.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.424+0000 7fb933400640 1 -- 172.21.15.110:0/2065965450 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb928042070 con 0x7fb93c074f40 2024-09-12T02:13:40.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.426+0000 7fb933400640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb9200a2c10 0x7fb9200a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:40.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.426+0000 7fb933400640 1 -- 172.21.15.110:0/2065965450 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7fb9280efff0 con 0x7fb93c074f40 2024-09-12T02:13:40.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.426+0000 7fb93aa00640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb9200a2c10 0x7fb9200a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:40.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.426+0000 7fb933400640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753] conn(0x7fb9200add60 0x7fb9200b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:40.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.426+0000 7fb933400640 1 -- 172.21.15.110:0/2065965450 --> [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb928038e90 con 0x7fb9200add60 2024-09-12T02:13:40.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.427+0000 7fb933400640 1 -- 172.21.15.110:0/2065965450 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7fb9280f0440 con 0x7fb93c074f40 2024-09-12T02:13:40.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.427+0000 7fb93b400640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753] conn(0x7fb9200add60 0x7fb9200b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:40.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.427+0000 7fb93aa00640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb9200a2c10 0x7fb9200a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb92c005d00 tx=0x7fb92c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:40.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.428+0000 7fb93b400640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753] conn(0x7fb9200add60 0x7fb9200b0200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:40.434 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:40.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.429+0000 7fb933400640 1 -- 172.21.15.110:0/2065965450 <== osd.9 v2:172.21.15.110:6826/558612753 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb928038e90 con 0x7fb9200add60 2024-09-12T02:13:40.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.454+0000 7fb941a00640 1 -- 172.21.15.110:0/2065965450 --> [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb93c062e00 con 0x7fb9200add60 2024-09-12T02:13:40.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.454+0000 7fb933400640 1 -- 172.21.15.110:0/2065965450 <== osd.9 v2:172.21.15.110:6826/558612753 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb93c062e00 con 0x7fb9200add60 2024-09-12T02:13:40.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.454+0000 7fb941a00640 1 -- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753] conn(0x7fb9200add60 msgr2=0x7fb9200b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:40.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.455+0000 7fb941a00640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753] conn(0x7fb9200add60 0x7fb9200b0200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.455+0000 7fb941a00640 1 -- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb9200a2c10 msgr2=0x7fb9200a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:40.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.455+0000 7fb941a00640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fb9200a2c10 0x7fb9200a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb92c005d00 tx=0x7fb92c00b410 comp rx=0 tx=0).stop 2024-09-12T02:13:40.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.455+0000 7fb941a00640 1 -- 172.21.15.110:0/2065965450 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb93c074f40 msgr2=0x7fb93c19abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:40.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.455+0000 7fb941a00640 1 --2- 172.21.15.110:0/2065965450 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb93c074f40 0x7fb93c19abd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb928004770 tx=0x7fb928003c10 comp rx=0 tx=0).stop 2024-09-12T02:13:40.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.455+0000 7fb93b400640 1 -- 172.21.15.110:0/2065965450 reap_dead start 2024-09-12T02:13:40.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.455+0000 7fb941a00640 1 -- 172.21.15.110:0/2065965450 shutdown_connections 2024-09-12T02:13:40.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.455+0000 7fb941a00640 1 -- 172.21.15.110:0/2065965450 >> 172.21.15.110:0/2065965450 conn(0x7fb93c0fd8c0 msgr2=0x7fb93c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:40.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.455+0000 7fb941a00640 1 -- 172.21.15.110:0/2065965450 shutdown_connections 2024-09-12T02:13:40.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:40.455+0000 7fb941a00640 1 -- 172.21.15.110:0/2065965450 wait complete. 2024-09-12T02:13:40.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.905+0000 7f70b4400640 1 -- 172.21.15.110:0/806959853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70ac074620 msgr2=0x7f70ac074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:40.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.905+0000 7f70b4400640 1 --2- 172.21.15.110:0/806959853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70ac074620 0x7f70ac074a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009860 tx=0x7f70a002a3d0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.905+0000 7f70b4400640 1 -- 172.21.15.110:0/806959853 shutdown_connections 2024-09-12T02:13:40.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.905+0000 7f70b4400640 1 --2- 172.21.15.110:0/806959853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac10e3c0 0x7f70ac110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.905+0000 7f70b4400640 1 --2- 172.21.15.110:0/806959853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70ac074f40 0x7f70ac10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.905+0000 7f70b4400640 1 --2- 172.21.15.110:0/806959853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70ac074620 0x7f70ac074a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.905+0000 7f70b4400640 1 -- 172.21.15.110:0/806959853 >> 172.21.15.110:0/806959853 conn(0x7f70ac0fd8c0 msgr2=0x7f70ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.905+0000 7f70b4400640 1 -- 172.21.15.110:0/806959853 shutdown_connections 2024-09-12T02:13:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.905+0000 7f70b4400640 1 -- 172.21.15.110:0/806959853 wait complete. 2024-09-12T02:13:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.906+0000 7f70b4400640 1 Processor -- start 2024-09-12T02:13:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.906+0000 7f70b4400640 1 -- start start 2024-09-12T02:13:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.906+0000 7f70b4400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac074620 0x7f70ac19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b4400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70ac074f40 0x7f70ac19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b4400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70ac10e3c0 0x7f70ac19eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b4400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1141c0 con 0x7f70ac074f40 2024-09-12T02:13:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b4400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac114040 con 0x7f70ac074620 2024-09-12T02:13:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b4400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac114340 con 0x7f70ac10e3c0 2024-09-12T02:13:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b1a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac074620 0x7f70ac19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:40.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b1a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac074620 0x7f70ac19a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:49666/0 (socket says 172.21.15.110:49666) 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b1a00640 1 -- 172.21.15.110:0/2700821050 learned_addr learned my addr 172.21.15.110:0/2700821050 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b1000640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70ac074f40 0x7f70ac19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b2400640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70ac10e3c0 0x7f70ac19eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b1a00640 1 -- 172.21.15.110:0/2700821050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70ac10e3c0 msgr2=0x7f70ac19eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b1a00640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70ac10e3c0 0x7f70ac19eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b1a00640 1 -- 172.21.15.110:0/2700821050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70ac074f40 msgr2=0x7f70ac19ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b1a00640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70ac074f40 0x7f70ac19ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.907+0000 7f70b1a00640 1 -- 172.21.15.110:0/2700821050 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac19f6d0 con 0x7f70ac074620 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.908+0000 7f70b1a00640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac074620 0x7f70ac19a720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009980 tx=0x7f70a00309a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.908+0000 7f70aa000640 1 -- 172.21.15.110:0/2700821050 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0040070 con 0x7f70ac074620 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.908+0000 7f70b4400640 1 -- 172.21.15.110:0/2700821050 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ac19f960 con 0x7f70ac074620 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.908+0000 7f70aa000640 1 -- 172.21.15.110:0/2700821050 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a0005620 con 0x7f70ac074620 2024-09-12T02:13:40.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.908+0000 7f70aa000640 1 -- 172.21.15.110:0/2700821050 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a00049b0 con 0x7f70ac074620 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.908+0000 7f70b4400640 1 -- 172.21.15.110:0/2700821050 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ac1a72a0 con 0x7f70ac074620 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.909+0000 7f70b4400640 1 -- 172.21.15.110:0/2700821050 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f70ac062900 con 0x7f70ac074620 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.911+0000 7f70aa000640 1 -- 172.21.15.110:0/2700821050 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f70a0043070 con 0x7f70ac074620 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.912+0000 7f70aa000640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f70940a2c90 0x7f70940a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.912+0000 7f70aa000640 1 -- 172.21.15.110:0/2700821050 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f70a00f05c0 con 0x7f70ac074620 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.912+0000 7f70b1000640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f70940a2c90 0x7f70940a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.912+0000 7f70aa000640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192] conn(0x7f70940adcb0 0x7f70940b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.913+0000 7f70aa000640 1 -- 172.21.15.110:0/2700821050 --> [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70a0031c80 con 0x7f70940adcb0 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.913+0000 7f70aa000640 1 -- 172.21.15.110:0/2700821050 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f70a00f0970 con 0x7f70ac074620 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.913+0000 7f70b2400640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192] conn(0x7f70940adcb0 0x7f70940b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.913+0000 7f70b1000640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f70940a2c90 0x7f70940a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f70ac10f760 tx=0x7f7098009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.913+0000 7f70b2400640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192] conn(0x7f70940adcb0 0x7f70940b0150 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:40.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.914+0000 7f70aa000640 1 -- 172.21.15.110:0/2700821050 <== osd.2 v2:172.21.15.136:6800/1988990192 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70a0031c80 con 0x7f70940adcb0 2024-09-12T02:13:40.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.928+0000 7f70b4400640 1 -- 172.21.15.110:0/2700821050 --> [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f70ac062d00 con 0x7f70940adcb0 2024-09-12T02:13:40.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.929+0000 7f70aa000640 1 -- 172.21.15.110:0/2700821050 <== osd.2 v2:172.21.15.136:6800/1988990192 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f70ac062d00 con 0x7f70940adcb0 2024-09-12T02:13:40.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.929+0000 7f70b4400640 1 -- 172.21.15.110:0/2700821050 >> [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192] conn(0x7f70940adcb0 msgr2=0x7f70940b0150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:40.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.929+0000 7f70b4400640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192] conn(0x7f70940adcb0 0x7f70940b0150 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.930+0000 7f70b4400640 1 -- 172.21.15.110:0/2700821050 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f70940a2c90 msgr2=0x7f70940a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:40.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.930+0000 7f70b4400640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f70940a2c90 0x7f70940a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f70ac10f760 tx=0x7f7098009260 comp rx=0 tx=0).stop 2024-09-12T02:13:40.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.930+0000 7f70b4400640 1 -- 172.21.15.110:0/2700821050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac074620 msgr2=0x7f70ac19a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:40.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.930+0000 7f70b4400640 1 --2- 172.21.15.110:0/2700821050 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f70ac074620 0x7f70ac19a720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f70a0009980 tx=0x7f70a00309a0 comp rx=0 tx=0).stop 2024-09-12T02:13:40.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.930+0000 7f70b2400640 1 -- 172.21.15.110:0/2700821050 reap_dead start 2024-09-12T02:13:40.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.930+0000 7f70b4400640 1 -- 172.21.15.110:0/2700821050 shutdown_connections 2024-09-12T02:13:40.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.930+0000 7f70b4400640 1 -- 172.21.15.110:0/2700821050 >> 172.21.15.110:0/2700821050 conn(0x7f70ac0fd8c0 msgr2=0x7f70ac0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:40.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.930+0000 7f70b4400640 1 -- 172.21.15.110:0/2700821050 shutdown_connections 2024-09-12T02:13:40.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:39.930+0000 7f70b4400640 1 -- 172.21.15.110:0/2700821050 wait complete. 2024-09-12T02:13:40.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:40 smithi110 ceph-mon[30548]: pgmap v352: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-12T02:13:41.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:40 smithi115 ceph-mon[35351]: pgmap v352: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-12T02:13:41.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:40 smithi136 ceph-mon[35814]: pgmap v352: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-12T02:13:42.663 INFO:teuthology.orchestra.run.smithi110.stdout:111669149771 2024-09-12T02:13:42.663 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T02:13:42.870 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:42 smithi110 ceph-mon[30548]: pgmap v353: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T02:13:42.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.870+0000 7f579fe00640 1 -- 172.21.15.110:0/1704295905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57981049a0 msgr2=0x7f57981089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:42.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.870+0000 7f579fe00640 1 --2- 172.21.15.110:0/1704295905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57981049a0 0x7f57981089f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5784009900 tx=0x7f578402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:13:42.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.870+0000 7f579fe00640 1 -- 172.21.15.110:0/1704295905 shutdown_connections 2024-09-12T02:13:42.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.870+0000 7f579fe00640 1 --2- 172.21.15.110:0/1704295905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5798109120 0x7f5798110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:42.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.870+0000 7f579fe00640 1 --2- 172.21.15.110:0/1704295905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57981049a0 0x7f57981089f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:42.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.870+0000 7f579fe00640 1 --2- 172.21.15.110:0/1704295905 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5798103ff0 0x7f57981043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:42.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.870+0000 7f579fe00640 1 -- 172.21.15.110:0/1704295905 >> 172.21.15.110:0/1704295905 conn(0x7f57980ffa90 msgr2=0x7f5798101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:42.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.870+0000 7f579fe00640 1 -- 172.21.15.110:0/1704295905 shutdown_connections 2024-09-12T02:13:42.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.870+0000 7f579fe00640 1 -- 172.21.15.110:0/1704295905 wait complete. 2024-09-12T02:13:42.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.871+0000 7f579fe00640 1 Processor -- start 2024-09-12T02:13:42.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.871+0000 7f579fe00640 1 -- start start 2024-09-12T02:13:42.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.872+0000 7f579fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5798103ff0 0x7f579819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:42.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.872+0000 7f579fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57981049a0 0x7f579819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:42.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.872+0000 7f579fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5798109120 0x7f579819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:42.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.872+0000 7f579fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5798114120 con 0x7f57981049a0 2024-09-12T02:13:42.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.872+0000 7f579fe00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5798113fa0 con 0x7f5798109120 2024-09-12T02:13:42.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.872+0000 7f579fe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f57981142a0 con 0x7f5798103ff0 2024-09-12T02:13:42.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.872+0000 7f579ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57981049a0 0x7f579819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:42.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.872+0000 7f579ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57981049a0 0x7f579819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35000/0 (socket says 172.21.15.110:35000) 2024-09-12T02:13:42.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.872+0000 7f579ca00640 1 -- 172.21.15.110:0/218060215 learned_addr learned my addr 172.21.15.110:0/218060215 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.872+0000 7f579d400640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5798103ff0 0x7f579819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.872+0000 7f579de00640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5798109120 0x7f579819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.873+0000 7f579ca00640 1 -- 172.21.15.110:0/218060215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5798103ff0 msgr2=0x7f579819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.873+0000 7f579ca00640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5798103ff0 0x7f579819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.873+0000 7f579ca00640 1 -- 172.21.15.110:0/218060215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5798109120 msgr2=0x7f579819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.873+0000 7f579ca00640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5798109120 0x7f579819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.873+0000 7f579ca00640 1 -- 172.21.15.110:0/218060215 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579819f5f0 con 0x7f57981049a0 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.873+0000 7f579de00640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5798109120 0x7f579819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.873+0000 7f579ca00640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57981049a0 0x7f579819ab80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5784006010 tx=0x7f57840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.873+0000 7f5796000640 1 -- 172.21.15.110:0/218060215 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578403f030 con 0x7f57981049a0 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.873+0000 7f5796000640 1 -- 172.21.15.110:0/218060215 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5784003ce0 con 0x7f57981049a0 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.873+0000 7f579fe00640 1 -- 172.21.15.110:0/218060215 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f579819f880 con 0x7f57981049a0 2024-09-12T02:13:42.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.873+0000 7f5796000640 1 -- 172.21.15.110:0/218060215 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784035070 con 0x7f57981049a0 2024-09-12T02:13:42.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.873+0000 7f579fe00640 1 -- 172.21.15.110:0/218060215 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57981a71c0 con 0x7f57981049a0 2024-09-12T02:13:42.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.874+0000 7f579fe00640 1 -- 172.21.15.110:0/218060215 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5798062980 con 0x7f57981049a0 2024-09-12T02:13:42.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.876+0000 7f5796000640 1 -- 172.21.15.110:0/218060215 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5784042030 con 0x7f57981049a0 2024-09-12T02:13:42.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.878+0000 7f5796000640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f57800a2c10 0x7f57800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:42.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.878+0000 7f5796000640 1 -- 172.21.15.110:0/218060215 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f57840f0120 con 0x7f57981049a0 2024-09-12T02:13:42.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.878+0000 7f579d400640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f57800a2c10 0x7f57800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:42.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.878+0000 7f5796000640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814] conn(0x7f57800add60 0x7f57800b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:42.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.878+0000 7f5796000640 1 -- 172.21.15.110:0/218060215 --> [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5784040e70 con 0x7f57800add60 2024-09-12T02:13:42.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.878+0000 7f5796000640 1 -- 172.21.15.110:0/218060215 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f57840f04d0 con 0x7f57981049a0 2024-09-12T02:13:42.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.878+0000 7f579de00640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814] conn(0x7f57800add60 0x7f57800b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:42.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.879+0000 7f579d400640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f57800a2c10 0x7f57800a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f578c00bbe0 tx=0x7f578c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:42.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.879+0000 7f579de00640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814] conn(0x7f57800add60 0x7f57800b0200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:42.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.880+0000 7f5796000640 1 -- 172.21.15.110:0/218060215 <== osd.10 v2:172.21.15.115:6824/4061070814 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5784040e70 con 0x7f57800add60 2024-09-12T02:13:42.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.894+0000 7f579fe00640 1 -- 172.21.15.110:0/218060215 --> [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5798062e00 con 0x7f57800add60 2024-09-12T02:13:42.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.895+0000 7f5796000640 1 -- 172.21.15.110:0/218060215 <== osd.10 v2:172.21.15.115:6824/4061070814 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5798062e00 con 0x7f57800add60 2024-09-12T02:13:42.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.896+0000 7f579fe00640 1 -- 172.21.15.110:0/218060215 >> [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814] conn(0x7f57800add60 msgr2=0x7f57800b0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:42.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.896+0000 7f579fe00640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814] conn(0x7f57800add60 0x7f57800b0200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:42.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.896+0000 7f579fe00640 1 -- 172.21.15.110:0/218060215 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f57800a2c10 msgr2=0x7f57800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:42.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.896+0000 7f579fe00640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f57800a2c10 0x7f57800a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f578c00bbe0 tx=0x7f578c00b390 comp rx=0 tx=0).stop 2024-09-12T02:13:42.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.896+0000 7f579fe00640 1 -- 172.21.15.110:0/218060215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57981049a0 msgr2=0x7f579819ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:42.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.896+0000 7f579fe00640 1 --2- 172.21.15.110:0/218060215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57981049a0 0x7f579819ab80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5784006010 tx=0x7f57840042f0 comp rx=0 tx=0).stop 2024-09-12T02:13:42.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.896+0000 7f579de00640 1 -- 172.21.15.110:0/218060215 reap_dead start 2024-09-12T02:13:42.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.896+0000 7f579fe00640 1 -- 172.21.15.110:0/218060215 shutdown_connections 2024-09-12T02:13:42.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.896+0000 7f579fe00640 1 -- 172.21.15.110:0/218060215 >> 172.21.15.110:0/218060215 conn(0x7f57980ffa90 msgr2=0x7f5798100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:42.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.896+0000 7f579fe00640 1 -- 172.21.15.110:0/218060215 shutdown_connections 2024-09-12T02:13:42.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:42.896+0000 7f579fe00640 1 -- 172.21.15.110:0/218060215 wait complete. 2024-09-12T02:13:43.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:42 smithi115 ceph-mon[35351]: pgmap v353: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T02:13:43.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:42 smithi136 ceph-mon[35814]: pgmap v353: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T02:13:43.615 INFO:teuthology.orchestra.run.smithi110.stdout:249108103217 2024-09-12T02:13:43.615 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-12T02:13:44.385 INFO:teuthology.orchestra.run.smithi110.stdout:77309411410 2024-09-12T02:13:44.386 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T02:13:44.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.223+0000 7f67df000640 1 -- 172.21.15.110:0/1239944805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67d8074620 msgr2=0x7f67d8074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:44.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.223+0000 7f67df000640 1 --2- 172.21.15.110:0/1239944805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67d8074620 0x7f67d8074a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009900 tx=0x7f67c802a480 comp rx=0 tx=0).stop 2024-09-12T02:13:44.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.223+0000 7f67df000640 1 -- 172.21.15.110:0/1239944805 shutdown_connections 2024-09-12T02:13:44.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.224+0000 7f67df000640 1 --2- 172.21.15.110:0/1239944805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67d810e3c0 0x7f67d8110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:44.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.224+0000 7f67df000640 1 --2- 172.21.15.110:0/1239944805 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67d8074f40 0x7f67d810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:44.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.224+0000 7f67df000640 1 --2- 172.21.15.110:0/1239944805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67d8074620 0x7f67d8074a00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:44.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.224+0000 7f67df000640 1 -- 172.21.15.110:0/1239944805 >> 172.21.15.110:0/1239944805 conn(0x7f67d80fd8c0 msgr2=0x7f67d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:44.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.224+0000 7f67df000640 1 -- 172.21.15.110:0/1239944805 shutdown_connections 2024-09-12T02:13:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.224+0000 7f67df000640 1 -- 172.21.15.110:0/1239944805 wait complete. 2024-09-12T02:13:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.225+0000 7f67df000640 1 Processor -- start 2024-09-12T02:13:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.225+0000 7f67df000640 1 -- start start 2024-09-12T02:13:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.225+0000 7f67df000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67d8074620 0x7f67d819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.225+0000 7f67df000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67d8074f40 0x7f67d819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67df000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67d810e3c0 0x7f67d819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67df000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f67d81141c0 con 0x7f67d8074f40 2024-09-12T02:13:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67df000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f67d8114040 con 0x7f67d8074620 2024-09-12T02:13:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67df000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f67d8114340 con 0x7f67d810e3c0 2024-09-12T02:13:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67d7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67d8074f40 0x7f67d819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67d7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67d8074f40 0x7f67d819abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35024/0 (socket says 172.21.15.110:35024) 2024-09-12T02:13:44.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67d7400640 1 -- 172.21.15.110:0/3381050020 learned_addr learned my addr 172.21.15.110:0/3381050020 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67d7e00640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67d8074620 0x7f67d819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67dd000640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67d810e3c0 0x7f67d819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67d7400640 1 -- 172.21.15.110:0/3381050020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67d810e3c0 msgr2=0x7f67d819ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67d7400640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f67d810e3c0 0x7f67d819ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67d7400640 1 -- 172.21.15.110:0/3381050020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67d8074620 msgr2=0x7f67d819a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67d7400640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67d8074620 0x7f67d819a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.226+0000 7f67d7400640 1 -- 172.21.15.110:0/3381050020 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d819f630 con 0x7f67d8074f40 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.227+0000 7f67d7400640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67d8074f40 0x7f67d819abc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f67c400e9f0 tx=0x7f67c400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.227+0000 7f67d4c00640 1 -- 172.21.15.110:0/3381050020 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c400cd80 con 0x7f67d8074f40 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.227+0000 7f67d4c00640 1 -- 172.21.15.110:0/3381050020 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67c4010910 con 0x7f67d8074f40 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.227+0000 7f67df000640 1 -- 172.21.15.110:0/3381050020 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d819f920 con 0x7f67d8074f40 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.227+0000 7f67d4c00640 1 -- 172.21.15.110:0/3381050020 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4018990 con 0x7f67d8074f40 2024-09-12T02:13:44.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.227+0000 7f67df000640 1 -- 172.21.15.110:0/3381050020 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d81a7200 con 0x7f67d8074f40 2024-09-12T02:13:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.228+0000 7f67df000640 1 -- 172.21.15.110:0/3381050020 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67d8062980 con 0x7f67d8074f40 2024-09-12T02:13:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.230+0000 7f67d4c00640 1 -- 172.21.15.110:0/3381050020 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f67c4010ac0 con 0x7f67d8074f40 2024-09-12T02:13:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.232+0000 7f67d4c00640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f67bc0a2c90 0x7f67bc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.232+0000 7f67d4c00640 1 -- 172.21.15.110:0/3381050020 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9071+0+0 (secure 0 0 0) 0x7f67c40cfea0 con 0x7f67d8074f40 2024-09-12T02:13:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.232+0000 7f67d7e00640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f67bc0a2c90 0x7f67bc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.232+0000 7f67d4c00640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265] conn(0x7f67bc0adde0 0x7f67bc0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.232+0000 7f67d4c00640 1 -- 172.21.15.110:0/3381050020 --> [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67c4019ec0 con 0x7f67bc0adde0 2024-09-12T02:13:44.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.232+0000 7f67d4c00640 1 -- 172.21.15.110:0/3381050020 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=95) ==== 24+0+0 (secure 0 0 0) 0x7f67c40d0250 con 0x7f67d8074f40 2024-09-12T02:13:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.233+0000 7f67dd000640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265] conn(0x7f67bc0adde0 0x7f67bc0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.233+0000 7f67d7e00640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f67bc0a2c90 0x7f67bc0a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67c8000c00 tx=0x7f67c8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.233+0000 7f67dd000640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265] conn(0x7f67bc0adde0 0x7f67bc0b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.234+0000 7f67d4c00640 1 -- 172.21.15.110:0/3381050020 <== osd.5 v2:172.21.15.136:6808/3847045265 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f67c4019ec0 con 0x7f67bc0adde0 2024-09-12T02:13:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.248+0000 7f67df000640 1 -- 172.21.15.110:0/3381050020 --> [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f67d8062d80 con 0x7f67bc0adde0 2024-09-12T02:13:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.249+0000 7f67d4c00640 1 -- 172.21.15.110:0/3381050020 <== osd.5 v2:172.21.15.136:6808/3847045265 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f67d8062d80 con 0x7f67bc0adde0 2024-09-12T02:13:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.249+0000 7f67df000640 1 -- 172.21.15.110:0/3381050020 >> [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265] conn(0x7f67bc0adde0 msgr2=0x7f67bc0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.249+0000 7f67df000640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265] conn(0x7f67bc0adde0 0x7f67bc0b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.249+0000 7f67df000640 1 -- 172.21.15.110:0/3381050020 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f67bc0a2c90 msgr2=0x7f67bc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:44.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.249+0000 7f67df000640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f67bc0a2c90 0x7f67bc0a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67c8000c00 tx=0x7f67c8005b50 comp rx=0 tx=0).stop 2024-09-12T02:13:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.249+0000 7f67df000640 1 -- 172.21.15.110:0/3381050020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67d8074f40 msgr2=0x7f67d819abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.249+0000 7f67df000640 1 --2- 172.21.15.110:0/3381050020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67d8074f40 0x7f67d819abc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f67c400e9f0 tx=0x7f67c400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:13:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.249+0000 7f67dd000640 1 -- 172.21.15.110:0/3381050020 reap_dead start 2024-09-12T02:13:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.249+0000 7f67df000640 1 -- 172.21.15.110:0/3381050020 shutdown_connections 2024-09-12T02:13:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.249+0000 7f67df000640 1 -- 172.21.15.110:0/3381050020 >> 172.21.15.110:0/3381050020 conn(0x7f67d80fd8c0 msgr2=0x7f67d80fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.250+0000 7f67df000640 1 -- 172.21.15.110:0/3381050020 shutdown_connections 2024-09-12T02:13:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:44.250+0000 7f67df000640 1 -- 172.21.15.110:0/3381050020 wait complete. 2024-09-12T02:13:44.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:44 smithi110 ceph-mon[30548]: pgmap v354: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T02:13:45.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:44 smithi115 ceph-mon[35351]: pgmap v354: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T02:13:45.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:44 smithi136 ceph-mon[35814]: pgmap v354: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T02:13:45.516 INFO:teuthology.orchestra.run.smithi110.stdout:34359738459 2024-09-12T02:13:45.517 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T02:13:45.725 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T02:13:45.725 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-09-12T02:13:45.725 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:45 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]: dispatch 2024-09-12T02:13:45.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.836+0000 7f329fe00640 1 -- 172.21.15.110:0/471634898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298102790 msgr2=0x7f32981067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.836+0000 7f329fe00640 1 --2- 172.21.15.110:0/471634898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298102790 0x7f32981067e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3284009900 tx=0x7f328402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.836+0000 7f329fe00640 1 -- 172.21.15.110:0/471634898 shutdown_connections 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.836+0000 7f329fe00640 1 --2- 172.21.15.110:0/471634898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3298106f10 0x7f329810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.836+0000 7f329fe00640 1 --2- 172.21.15.110:0/471634898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298102790 0x7f32981067e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.836+0000 7f329fe00640 1 --2- 172.21.15.110:0/471634898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3298101de0 0x7f32981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.836+0000 7f329fe00640 1 -- 172.21.15.110:0/471634898 >> 172.21.15.110:0/471634898 conn(0x7f32980fd8c0 msgr2=0x7f32980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.837+0000 7f329fe00640 1 -- 172.21.15.110:0/471634898 shutdown_connections 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.837+0000 7f329fe00640 1 -- 172.21.15.110:0/471634898 wait complete. 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.837+0000 7f329fe00640 1 Processor -- start 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.838+0000 7f329fe00640 1 -- start start 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.838+0000 7f329fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298101de0 0x7f329819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.838+0000 7f329fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3298102790 0x7f329819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:45.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.838+0000 7f329fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3298106f10 0x7f329819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.838+0000 7f329fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3298111f70 con 0x7f3298101de0 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.838+0000 7f329fe00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3298111df0 con 0x7f3298106f10 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.838+0000 7f329fe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f32981120f0 con 0x7f3298102790 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.838+0000 7f329d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298101de0 0x7f329819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.838+0000 7f329d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298101de0 0x7f329819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35036/0 (socket says 172.21.15.110:35036) 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.838+0000 7f329d400640 1 -- 172.21.15.110:0/3185227479 learned_addr learned my addr 172.21.15.110:0/3185227479 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.838+0000 7f329de00640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3298106f10 0x7f329819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.838+0000 7f329ca00640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3298102790 0x7f329819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.839+0000 7f329d400640 1 -- 172.21.15.110:0/3185227479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3298102790 msgr2=0x7f329819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.839+0000 7f329d400640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3298102790 0x7f329819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.839+0000 7f329d400640 1 -- 172.21.15.110:0/3185227479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3298106f10 msgr2=0x7f329819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.839+0000 7f329d400640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3298106f10 0x7f329819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:45.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.839+0000 7f329d400640 1 -- 172.21.15.110:0/3185227479 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329819f5f0 con 0x7f3298101de0 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.839+0000 7f329d400640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298101de0 0x7f329819a640 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f328c00e9f0 tx=0x7f328c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.839+0000 7f3296000640 1 -- 172.21.15.110:0/3185227479 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c00cd80 con 0x7f3298101de0 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.839+0000 7f329fe00640 1 -- 172.21.15.110:0/3185227479 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329819f8e0 con 0x7f3298101de0 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.839+0000 7f3296000640 1 -- 172.21.15.110:0/3185227479 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f328c005500 con 0x7f3298101de0 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.839+0000 7f3296000640 1 -- 172.21.15.110:0/3185227479 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c010690 con 0x7f3298101de0 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.839+0000 7f329fe00640 1 -- 172.21.15.110:0/3185227479 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32981a71c0 con 0x7f3298101de0 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.840+0000 7f329fe00640 1 -- 172.21.15.110:0/3185227479 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32980fef40 con 0x7f3298101de0 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.843+0000 7f3296000640 1 -- 172.21.15.110:0/3185227479 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f328c0046c0 con 0x7f3298101de0 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.844+0000 7f3296000640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f32800a2c10 0x7f32800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.844+0000 7f3296000640 1 -- 172.21.15.110:0/3185227479 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9158+0+0 (secure 0 0 0) 0x7f328c0cfe10 con 0x7f3298101de0 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.844+0000 7f329ca00640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f32800a2c10 0x7f32800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.844+0000 7f3296000640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119] conn(0x7f32800adee0 0x7f32800b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.844+0000 7f3296000640 1 -- 172.21.15.110:0/3185227479 --> [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f328c005350 con 0x7f32800adee0 2024-09-12T02:13:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.844+0000 7f3296000640 1 -- 172.21.15.110:0/3185227479 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=96) ==== 24+0+0 (secure 0 0 0) 0x7f328c0d01c0 con 0x7f3298101de0 2024-09-12T02:13:45.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.845+0000 7f329de00640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119] conn(0x7f32800adee0 0x7f32800b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:45.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.845+0000 7f329ca00640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f32800a2c10 0x7f32800a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3284009230 tx=0x7f32840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:45.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.845+0000 7f329de00640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119] conn(0x7f32800adee0 0x7f32800b0380 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:45.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.846+0000 7f3296000640 1 -- 172.21.15.110:0/3185227479 <== osd.4 v2:172.21.15.115:6808/3669727119 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f328c005350 con 0x7f32800adee0 2024-09-12T02:13:45.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.860+0000 7f329fe00640 1 -- 172.21.15.110:0/3185227479 --> [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f32981032c0 con 0x7f32800adee0 2024-09-12T02:13:45.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.861+0000 7f3296000640 1 -- 172.21.15.110:0/3185227479 <== osd.4 v2:172.21.15.115:6808/3669727119 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f32981032c0 con 0x7f32800adee0 2024-09-12T02:13:45.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.861+0000 7f329fe00640 1 -- 172.21.15.110:0/3185227479 >> [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119] conn(0x7f32800adee0 msgr2=0x7f32800b0380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:45.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.861+0000 7f329fe00640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119] conn(0x7f32800adee0 0x7f32800b0380 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:45.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.861+0000 7f329fe00640 1 -- 172.21.15.110:0/3185227479 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f32800a2c10 msgr2=0x7f32800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:45.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.861+0000 7f329fe00640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f32800a2c10 0x7f32800a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3284009230 tx=0x7f32840058d0 comp rx=0 tx=0).stop 2024-09-12T02:13:45.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.861+0000 7f329fe00640 1 -- 172.21.15.110:0/3185227479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298101de0 msgr2=0x7f329819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:45.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.861+0000 7f329fe00640 1 --2- 172.21.15.110:0/3185227479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298101de0 0x7f329819a640 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f328c00e9f0 tx=0x7f328c00edf0 comp rx=0 tx=0).stop 2024-09-12T02:13:45.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.861+0000 7f329de00640 1 -- 172.21.15.110:0/3185227479 reap_dead start 2024-09-12T02:13:45.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.862+0000 7f329fe00640 1 -- 172.21.15.110:0/3185227479 shutdown_connections 2024-09-12T02:13:45.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.862+0000 7f329fe00640 1 -- 172.21.15.110:0/3185227479 >> 172.21.15.110:0/3185227479 conn(0x7f32980fd8c0 msgr2=0x7f32980ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:45.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.862+0000 7f329fe00640 1 -- 172.21.15.110:0/3185227479 shutdown_connections 2024-09-12T02:13:45.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:45.862+0000 7f329fe00640 1 -- 172.21.15.110:0/3185227479 wait complete. 2024-09-12T02:13:46.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T02:13:46.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-09-12T02:13:46.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:45 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]: dispatch 2024-09-12T02:13:46.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-12T02:13:46.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]: dispatch 2024-09-12T02:13:46.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:45 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]: dispatch 2024-09-12T02:13:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:46 smithi110 ceph-mon[30548]: pgmap v355: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T02:13:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T02:13:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-12T02:13:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:46 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]': finished 2024-09-12T02:13:46.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:46 smithi110 ceph-mon[30548]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T02:13:47.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:46 smithi115 ceph-mon[35351]: pgmap v355: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T02:13:47.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T02:13:47.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-12T02:13:47.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:46 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]': finished 2024-09-12T02:13:47.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:46 smithi115 ceph-mon[35351]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T02:13:47.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:46 smithi136 ceph-mon[35814]: pgmap v355: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-12T02:13:47.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-12T02:13:47.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [3, 9]}]': finished 2024-09-12T02:13:47.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:46 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]': finished 2024-09-12T02:13:47.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:46 smithi136 ceph-mon[35814]: osdmap e96: 12 total, 12 up, 12 in 2024-09-12T02:13:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.404+0000 7f1ce9400640 1 -- 172.21.15.110:0/4152752430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4101de0 msgr2=0x7f1ce41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:47.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.404+0000 7f1ce9400640 1 --2- 172.21.15.110:0/4152752430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4101de0 0x7f1ce41021c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009900 tx=0x7f1cd402a410 comp rx=0 tx=0).stop 2024-09-12T02:13:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.404+0000 7f1ce9400640 1 -- 172.21.15.110:0/4152752430 shutdown_connections 2024-09-12T02:13:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.404+0000 7f1ce9400640 1 --2- 172.21.15.110:0/4152752430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ce4106f10 0x7f1ce410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.404+0000 7f1ce9400640 1 --2- 172.21.15.110:0/4152752430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce4102790 0x7f1ce41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.404+0000 7f1ce9400640 1 --2- 172.21.15.110:0/4152752430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4101de0 0x7f1ce41021c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.404+0000 7f1ce9400640 1 -- 172.21.15.110:0/4152752430 >> 172.21.15.110:0/4152752430 conn(0x7f1ce40fd8c0 msgr2=0x7f1ce40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.404+0000 7f1ce9400640 1 -- 172.21.15.110:0/4152752430 shutdown_connections 2024-09-12T02:13:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.404+0000 7f1ce9400640 1 -- 172.21.15.110:0/4152752430 wait complete. 2024-09-12T02:13:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.405+0000 7f1ce9400640 1 Processor -- start 2024-09-12T02:13:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.405+0000 7f1ce9400640 1 -- start start 2024-09-12T02:13:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.405+0000 7f1ce9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4101de0 0x7f1ce419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:47.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.405+0000 7f1ce9400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ce4102790 0x7f1ce419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.405+0000 7f1ce9400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce4106f10 0x7f1ce419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.405+0000 7f1ce9400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce4111fc0 con 0x7f1ce4101de0 2024-09-12T02:13:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.405+0000 7f1ce9400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce4111e40 con 0x7f1ce4106f10 2024-09-12T02:13:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.405+0000 7f1ce9400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce4112140 con 0x7f1ce4102790 2024-09-12T02:13:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.406+0000 7f1ce2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4101de0 0x7f1ce419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.406+0000 7f1ce2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4101de0 0x7f1ce419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35052/0 (socket says 172.21.15.110:35052) 2024-09-12T02:13:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.406+0000 7f1ce2800640 1 -- 172.21.15.110:0/1812338514 learned_addr learned my addr 172.21.15.110:0/1812338514 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.406+0000 7f1ce1e00640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ce4102790 0x7f1ce419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.406+0000 7f1ce3200640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce4106f10 0x7f1ce419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.406+0000 7f1ce2800640 1 -- 172.21.15.110:0/1812338514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ce4102790 msgr2=0x7f1ce419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:47.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.406+0000 7f1ce2800640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ce4102790 0x7f1ce419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.406+0000 7f1ce2800640 1 -- 172.21.15.110:0/1812338514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce4106f10 msgr2=0x7f1ce419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.406+0000 7f1ce2800640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ce4106f10 0x7f1ce419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.406+0000 7f1ce2800640 1 -- 172.21.15.110:0/1812338514 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce419f5b0 con 0x7f1ce4101de0 2024-09-12T02:13:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.406+0000 7f1ce2800640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4101de0 0x7f1ce419a600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4004770 tx=0x7f1cd4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.407+0000 7f1cdb400640 1 -- 172.21.15.110:0/1812338514 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd403f070 con 0x7f1ce4101de0 2024-09-12T02:13:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.407+0000 7f1cdb400640 1 -- 172.21.15.110:0/1812338514 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cd4031ca0 con 0x7f1ce4101de0 2024-09-12T02:13:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.407+0000 7f1cdb400640 1 -- 172.21.15.110:0/1812338514 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4035030 con 0x7f1ce4101de0 2024-09-12T02:13:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.407+0000 7f1ce9400640 1 -- 172.21.15.110:0/1812338514 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce419f840 con 0x7f1ce4101de0 2024-09-12T02:13:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.407+0000 7f1ce9400640 1 -- 172.21.15.110:0/1812338514 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce419fcd0 con 0x7f1ce4101de0 2024-09-12T02:13:47.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.408+0000 7f1ce9400640 1 -- 172.21.15.110:0/1812338514 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ce40fef40 con 0x7f1ce4101de0 2024-09-12T02:13:47.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.410+0000 7f1cdb400640 1 -- 172.21.15.110:0/1812338514 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f1cd4042070 con 0x7f1ce4101de0 2024-09-12T02:13:47.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.411+0000 7f1cdb400640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1cc80a2c10 0x7f1cc80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:47.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.411+0000 7f1cdb400640 1 -- 172.21.15.110:0/1812338514 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f1cd40f01e0 con 0x7f1ce4101de0 2024-09-12T02:13:47.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.411+0000 7f1ce1e00640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1cc80a2c10 0x7f1cc80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:47.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.411+0000 7f1cdb400640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086] conn(0x7f1cc80adee0 0x7f1cc80b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:47.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.411+0000 7f1cdb400640 1 -- 172.21.15.110:0/1812338514 --> [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1cd4038e90 con 0x7f1cc80adee0 2024-09-12T02:13:47.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.411+0000 7f1cdb400640 1 -- 172.21.15.110:0/1812338514 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=97) ==== 24+0+0 (secure 0 0 0) 0x7f1cd40f0590 con 0x7f1ce4101de0 2024-09-12T02:13:47.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.412+0000 7f1ce3200640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086] conn(0x7f1cc80adee0 0x7f1cc80b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:47.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.412+0000 7f1ce1e00640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1cc80a2c10 0x7f1cc80a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1ce410eee0 tx=0x7f1cd0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:47.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.412+0000 7f1ce3200640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086] conn(0x7f1cc80adee0 0x7f1cc80b0380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:47.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.413+0000 7f1cdb400640 1 -- 172.21.15.110:0/1812338514 <== osd.7 v2:172.21.15.115:6816/2297193086 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1cd4038e90 con 0x7f1cc80adee0 2024-09-12T02:13:47.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.427+0000 7f1ce9400640 1 -- 172.21.15.110:0/1812338514 --> [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ce41032c0 con 0x7f1cc80adee0 2024-09-12T02:13:47.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.428+0000 7f1cdb400640 1 -- 172.21.15.110:0/1812338514 <== osd.7 v2:172.21.15.115:6816/2297193086 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1ce41032c0 con 0x7f1cc80adee0 2024-09-12T02:13:47.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.428+0000 7f1ce9400640 1 -- 172.21.15.110:0/1812338514 >> [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086] conn(0x7f1cc80adee0 msgr2=0x7f1cc80b0380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:47.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.428+0000 7f1ce9400640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086] conn(0x7f1cc80adee0 0x7f1cc80b0380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:47.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.428+0000 7f1ce9400640 1 -- 172.21.15.110:0/1812338514 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1cc80a2c10 msgr2=0x7f1cc80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:47.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.428+0000 7f1ce9400640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1cc80a2c10 0x7f1cc80a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1ce410eee0 tx=0x7f1cd0005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:47.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.428+0000 7f1ce9400640 1 -- 172.21.15.110:0/1812338514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4101de0 msgr2=0x7f1ce419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:47.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.428+0000 7f1ce9400640 1 --2- 172.21.15.110:0/1812338514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce4101de0 0x7f1ce419a600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4004770 tx=0x7f1cd4003c10 comp rx=0 tx=0).stop 2024-09-12T02:13:47.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.428+0000 7f1ce3200640 1 -- 172.21.15.110:0/1812338514 reap_dead start 2024-09-12T02:13:47.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.429+0000 7f1ce9400640 1 -- 172.21.15.110:0/1812338514 shutdown_connections 2024-09-12T02:13:47.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.429+0000 7f1ce9400640 1 -- 172.21.15.110:0/1812338514 >> 172.21.15.110:0/1812338514 conn(0x7f1ce40fd8c0 msgr2=0x7f1ce40ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:47.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.429+0000 7f1ce9400640 1 -- 172.21.15.110:0/1812338514 shutdown_connections 2024-09-12T02:13:47.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:47.429+0000 7f1ce9400640 1 -- 172.21.15.110:0/1812338514 wait complete. 2024-09-12T02:13:47.933 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:47 smithi110 ceph-mon[30548]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T02:13:47.934 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:47 smithi110 ceph-mon[30548]: pgmap v358: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-12T02:13:48.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:47 smithi115 ceph-mon[35351]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T02:13:48.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:47 smithi115 ceph-mon[35351]: pgmap v358: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-12T02:13:48.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:47 smithi136 ceph-mon[35814]: osdmap e97: 12 total, 12 up, 12 in 2024-09-12T02:13:48.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:47 smithi136 ceph-mon[35814]: pgmap v358: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-12T02:13:48.554 INFO:teuthology.orchestra.run.smithi110.stdout:55834574933 2024-09-12T02:13:48.554 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T02:13:48.920 INFO:teuthology.orchestra.run.smithi110.stdout:283467841578 2024-09-12T02:13:48.920 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-12T02:13:49.294 INFO:teuthology.orchestra.run.smithi110.stdout:141733920840 2024-09-12T02:13:49.294 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T02:13:49.295 INFO:teuthology.orchestra.run.smithi110.stdout:163208757315 2024-09-12T02:13:49.295 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T02:13:49.662 INFO:teuthology.orchestra.run.smithi110.stdout:335007449120 2024-09-12T02:13:49.663 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-12T02:13:50.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.137+0000 7f45bca00640 1 -- 172.21.15.110:0/1256342442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b8102370 msgr2=0x7f45b810e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:50.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.137+0000 7f45bca00640 1 --2- 172.21.15.110:0/1256342442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b8102370 0x7f45b810e8a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009860 tx=0x7f45b002a340 comp rx=0 tx=0).stop 2024-09-12T02:13:50.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.137+0000 7f45bca00640 1 -- 172.21.15.110:0/1256342442 shutdown_connections 2024-09-12T02:13:50.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.137+0000 7f45bca00640 1 --2- 172.21.15.110:0/1256342442 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b8102370 0x7f45b810e8a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:50.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.137+0000 7f45bca00640 1 --2- 172.21.15.110:0/1256342442 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45b81019d0 0x7f45b8101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:50.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.137+0000 7f45bca00640 1 --2- 172.21.15.110:0/1256342442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b81079d0 0x7f45b8107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:50.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.137+0000 7f45bca00640 1 -- 172.21.15.110:0/1256342442 >> 172.21.15.110:0/1256342442 conn(0x7f45b80fd710 msgr2=0x7f45b80ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:50.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.137+0000 7f45bca00640 1 -- 172.21.15.110:0/1256342442 shutdown_connections 2024-09-12T02:13:50.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.137+0000 7f45bca00640 1 -- 172.21.15.110:0/1256342442 wait complete. 2024-09-12T02:13:50.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.138+0000 7f45bca00640 1 Processor -- start 2024-09-12T02:13:50.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.138+0000 7f45bca00640 1 -- start start 2024-09-12T02:13:50.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45bca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b81019d0 0x7f45b819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:50.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45bca00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45b8102370 0x7f45b819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:50.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45bca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b81079d0 0x7f45b819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:50.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45bca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8111dd0 con 0x7f45b81079d0 2024-09-12T02:13:50.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45bca00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8111c50 con 0x7f45b81019d0 2024-09-12T02:13:50.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45bca00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8111f50 con 0x7f45b8102370 2024-09-12T02:13:50.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45b6800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b81019d0 0x7f45b819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:50.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45b7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b81079d0 0x7f45b819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:50.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45b6800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b81019d0 0x7f45b819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:34990/0 (socket says 172.21.15.110:34990) 2024-09-12T02:13:50.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45b6800640 1 -- 172.21.15.110:0/779636008 learned_addr learned my addr 172.21.15.110:0/779636008 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:50.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45b5e00640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45b8102370 0x7f45b819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:50.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45b6800640 1 -- 172.21.15.110:0/779636008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45b8102370 msgr2=0x7f45b819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:50.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.139+0000 7f45b6800640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45b8102370 0x7f45b819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:50.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.140+0000 7f45b6800640 1 -- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b81079d0 msgr2=0x7f45b819ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:50.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.140+0000 7f45b6800640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b81079d0 0x7f45b819ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:50.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.140+0000 7f45b6800640 1 -- 172.21.15.110:0/779636008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b819f3e0 con 0x7f45b81019d0 2024-09-12T02:13:50.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.140+0000 7f45b7200640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45b81079d0 0x7f45b819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:13:50.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.140+0000 7f45b6800640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b81019d0 0x7f45b819a430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f45a800c420 tx=0x7f45a8009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:50.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.140+0000 7f45af400640 1 -- 172.21.15.110:0/779636008 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8003970 con 0x7f45b81019d0 2024-09-12T02:13:50.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.140+0000 7f45af400640 1 -- 172.21.15.110:0/779636008 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45a8004020 con 0x7f45b81019d0 2024-09-12T02:13:50.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.140+0000 7f45af400640 1 -- 172.21.15.110:0/779636008 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a800bad0 con 0x7f45b81019d0 2024-09-12T02:13:50.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.140+0000 7f45bca00640 1 -- 172.21.15.110:0/779636008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b819f6d0 con 0x7f45b81019d0 2024-09-12T02:13:50.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.140+0000 7f45bca00640 1 -- 172.21.15.110:0/779636008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b81a6fb0 con 0x7f45b81019d0 2024-09-12T02:13:50.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.141+0000 7f45bca00640 1 -- 172.21.15.110:0/779636008 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45b80fefb0 con 0x7f45b81019d0 2024-09-12T02:13:50.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.143+0000 7f45af400640 1 -- 172.21.15.110:0/779636008 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f45a801d020 con 0x7f45b81019d0 2024-09-12T02:13:50.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.145+0000 7f45af400640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f459c0a2c90 0x7f459c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:50.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.145+0000 7f45af400640 1 -- 172.21.15.110:0/779636008 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f45a80cfb80 con 0x7f45b81019d0 2024-09-12T02:13:50.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.145+0000 7f45b5e00640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f459c0a2c90 0x7f459c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:50.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.145+0000 7f45af400640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141] conn(0x7f459c0adf60 0x7f459c0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:50.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.145+0000 7f45af400640 1 -- 172.21.15.110:0/779636008 --> [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f459c0b0ad0 con 0x7f459c0adf60 2024-09-12T02:13:50.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.145+0000 7f45af400640 1 -- 172.21.15.110:0/779636008 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=97) ==== 24+0+0 (secure 0 0 0) 0x7f45a80cffd0 con 0x7f45b81019d0 2024-09-12T02:13:50.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.145+0000 7f45b7200640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141] conn(0x7f459c0adf60 0x7f459c0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:50.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.146+0000 7f45b5e00640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f459c0a2c90 0x7f459c0a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f45b810eb00 tx=0x7f45a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:50.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.146+0000 7f45b7200640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141] conn(0x7f459c0adf60 0x7f459c0b0400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:50.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.147+0000 7f45af400640 1 -- 172.21.15.110:0/779636008 <== osd.6 v2:172.21.15.110:6818/2221895141 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f459c0b0ad0 con 0x7f459c0adf60 2024-09-12T02:13:50.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.164+0000 7f45bca00640 1 -- 172.21.15.110:0/779636008 --> [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45b8103110 con 0x7f459c0adf60 2024-09-12T02:13:50.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.164+0000 7f45af400640 1 -- 172.21.15.110:0/779636008 <== osd.6 v2:172.21.15.110:6818/2221895141 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f45b8103110 con 0x7f459c0adf60 2024-09-12T02:13:50.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.165+0000 7f45bca00640 1 -- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141] conn(0x7f459c0adf60 msgr2=0x7f459c0b0400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:50.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.165+0000 7f45bca00640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141] conn(0x7f459c0adf60 0x7f459c0b0400 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:50.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.165+0000 7f45bca00640 1 -- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f459c0a2c90 msgr2=0x7f459c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:50.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.165+0000 7f45bca00640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f459c0a2c90 0x7f459c0a5150 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f45b810eb00 tx=0x7f45a4005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:50.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.165+0000 7f45bca00640 1 -- 172.21.15.110:0/779636008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b81019d0 msgr2=0x7f45b819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:50.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.165+0000 7f45bca00640 1 --2- 172.21.15.110:0/779636008 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45b81019d0 0x7f45b819a430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f45a800c420 tx=0x7f45a8009f90 comp rx=0 tx=0).stop 2024-09-12T02:13:50.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.165+0000 7f45b7200640 1 -- 172.21.15.110:0/779636008 reap_dead start 2024-09-12T02:13:50.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.165+0000 7f45bca00640 1 -- 172.21.15.110:0/779636008 shutdown_connections 2024-09-12T02:13:50.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.165+0000 7f45bca00640 1 -- 172.21.15.110:0/779636008 >> 172.21.15.110:0/779636008 conn(0x7f45b80fd710 msgr2=0x7f45b810d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:50.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.165+0000 7f45bca00640 1 -- 172.21.15.110:0/779636008 shutdown_connections 2024-09-12T02:13:50.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:50.165+0000 7f45bca00640 1 -- 172.21.15.110:0/779636008 wait complete. 2024-09-12T02:13:50.694 INFO:teuthology.orchestra.run.smithi110.stdout:219043332151 2024-09-12T02:13:50.694 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-12T02:13:50.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:50 smithi115 ceph-mon[35351]: pgmap v359: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:13:50.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:50 smithi136 ceph-mon[35814]: pgmap v359: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:13:50.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:50 smithi110 ceph-mon[30548]: pgmap v359: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:13:51.053 INFO:teuthology.orchestra.run.smithi110.stdout:304942678055 2024-09-12T02:13:51.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-12T02:13:51.498 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:51.499 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:52.049 INFO:teuthology.orchestra.run.smithi110.stdout:197568495677 2024-09-12T02:13:52.049 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-12T02:13:52.081 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:52.089 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:52.633 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:52 smithi110 ceph-mon[30548]: pgmap v360: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-12T02:13:52.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.744+0000 7f17aca00640 1 -- 172.21.15.110:0/1121731861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17a8109130 msgr2=0x7f17a8110cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:52.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.744+0000 7f17aca00640 1 --2- 172.21.15.110:0/1121731861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17a8109130 0x7f17a8110cb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009ca0 tx=0x7f17a002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:13:52.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.744+0000 7f17aca00640 1 -- 172.21.15.110:0/1121731861 shutdown_connections 2024-09-12T02:13:52.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.744+0000 7f17aca00640 1 --2- 172.21.15.110:0/1121731861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17a8109130 0x7f17a8110cb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:52.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.744+0000 7f17aca00640 1 --2- 172.21.15.110:0/1121731861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17a81049b0 0x7f17a8108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:52.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.744+0000 7f17aca00640 1 --2- 172.21.15.110:0/1121731861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a8104000 0x7f17a81043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:52.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.744+0000 7f17aca00640 1 -- 172.21.15.110:0/1121731861 >> 172.21.15.110:0/1121731861 conn(0x7f17a80ffa20 msgr2=0x7f17a8101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:52.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.744+0000 7f17aca00640 1 -- 172.21.15.110:0/1121731861 shutdown_connections 2024-09-12T02:13:52.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.744+0000 7f17aca00640 1 -- 172.21.15.110:0/1121731861 wait complete. 2024-09-12T02:13:52.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.745+0000 7f17aca00640 1 Processor -- start 2024-09-12T02:13:52.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.745+0000 7f17aca00640 1 -- start start 2024-09-12T02:13:52.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.745+0000 7f17aca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a8104000 0x7f17a819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:52.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.745+0000 7f17aca00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17a81049b0 0x7f17a819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:52.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.745+0000 7f17aca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17a8109130 0x7f17a819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.745+0000 7f17aca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f17a8114140 con 0x7f17a8109130 2024-09-12T02:13:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.745+0000 7f17aca00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f17a8113fc0 con 0x7f17a8104000 2024-09-12T02:13:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.745+0000 7f17aca00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f17a81142c0 con 0x7f17a81049b0 2024-09-12T02:13:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.746+0000 7f17a6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17a8109130 0x7f17a819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.746+0000 7f17a5e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a8104000 0x7f17a819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.746+0000 7f179d400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17a81049b0 0x7f17a819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.746+0000 7f17a6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17a8109130 0x7f17a819eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58118/0 (socket says 172.21.15.110:58118) 2024-09-12T02:13:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.746+0000 7f17a6800640 1 -- 172.21.15.110:0/3673641958 learned_addr learned my addr 172.21.15.110:0/3673641958 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.746+0000 7f17a6800640 1 -- 172.21.15.110:0/3673641958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17a81049b0 msgr2=0x7f17a819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.746+0000 7f17a6800640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17a81049b0 0x7f17a819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.746+0000 7f17a6800640 1 -- 172.21.15.110:0/3673641958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a8104000 msgr2=0x7f17a819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:52.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.746+0000 7f17a6800640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a8104000 0x7f17a819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:52.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.746+0000 7f17a6800640 1 -- 172.21.15.110:0/3673641958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a819f5b0 con 0x7f17a8109130 2024-09-12T02:13:52.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.746+0000 7f179d400640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17a81049b0 0x7f17a819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:13:52.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.746+0000 7f17a5e00640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a8104000 0x7f17a819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:13:52.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.747+0000 7f17a6800640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17a8109130 0x7f17a819eed0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f17a0031a20 tx=0x7f17a0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:52.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.747+0000 7f179f400640 1 -- 172.21.15.110:0/3673641958 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a0003b70 con 0x7f17a8109130 2024-09-12T02:13:52.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.747+0000 7f179f400640 1 -- 172.21.15.110:0/3673641958 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17a0003d10 con 0x7f17a8109130 2024-09-12T02:13:52.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.747+0000 7f17aca00640 1 -- 172.21.15.110:0/3673641958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a819f840 con 0x7f17a8109130 2024-09-12T02:13:52.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.747+0000 7f179f400640 1 -- 172.21.15.110:0/3673641958 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a002fc40 con 0x7f17a8109130 2024-09-12T02:13:52.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.747+0000 7f17aca00640 1 -- 172.21.15.110:0/3673641958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a81a7180 con 0x7f17a8109130 2024-09-12T02:13:52.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.748+0000 7f17aca00640 1 -- 172.21.15.110:0/3673641958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a81043e0 con 0x7f17a8109130 2024-09-12T02:13:52.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.750+0000 7f179f400640 1 -- 172.21.15.110:0/3673641958 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f17a0004050 con 0x7f17a8109130 2024-09-12T02:13:52.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.752+0000 7f179f400640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f178c0a2c90 0x7f178c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:52.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.752+0000 7f179f400640 1 -- 172.21.15.110:0/3673641958 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f17a00f0690 con 0x7f17a8109130 2024-09-12T02:13:52.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.753+0000 7f17a5e00640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f178c0a2c90 0x7f178c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:52.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.753+0000 7f17a5e00640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f178c0a2c90 0x7f178c0a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1798009fc0 tx=0x7f1798005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:52.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.755+0000 7f179f400640 1 -- 172.21.15.110:0/3673641958 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17a00bd350 con 0x7f17a8109130 2024-09-12T02:13:52.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:52 smithi115 ceph-mon[35351]: pgmap v360: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-12T02:13:52.820 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:52.821 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:52 smithi136 ceph-mon[35814]: pgmap v360: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-12T02:13:52.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.949+0000 7f17aca00640 1 -- 172.21.15.110:0/3673641958 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f17a810c3d0 con 0x7f17a8109130 2024-09-12T02:13:52.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.950+0000 7f179f400640 1 -- 172.21.15.110:0/3673641958 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f17a00bcc50 con 0x7f17a8109130 2024-09-12T02:13:52.950 INFO:teuthology.orchestra.run.smithi110.stdout:249108103220 2024-09-12T02:13:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.952+0000 7f17aca00640 1 -- 172.21.15.110:0/3673641958 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f178c0a2c90 msgr2=0x7f178c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:52.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.952+0000 7f17aca00640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f178c0a2c90 0x7f178c0a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1798009fc0 tx=0x7f1798005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.952+0000 7f17aca00640 1 -- 172.21.15.110:0/3673641958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17a8109130 msgr2=0x7f17a819eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.952+0000 7f17aca00640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17a8109130 0x7f17a819eed0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f17a0031a20 tx=0x7f17a0031a50 comp rx=0 tx=0).stop 2024-09-12T02:13:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.952+0000 7f17aca00640 1 -- 172.21.15.110:0/3673641958 shutdown_connections 2024-09-12T02:13:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.952+0000 7f17aca00640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f178c0a2c90 0x7f178c0a5150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.952+0000 7f17aca00640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17a8109130 0x7f17a819eed0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.952+0000 7f17aca00640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17a81049b0 0x7f17a819ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.952+0000 7f17aca00640 1 --2- 172.21.15.110:0/3673641958 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f17a8104000 0x7f17a819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.952+0000 7f17aca00640 1 -- 172.21.15.110:0/3673641958 >> 172.21.15.110:0/3673641958 conn(0x7f17a80ffa20 msgr2=0x7f17a8100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.952+0000 7f17aca00640 1 -- 172.21.15.110:0/3673641958 shutdown_connections 2024-09-12T02:13:52.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:52.952+0000 7f17aca00640 1 -- 172.21.15.110:0/3673641958 wait complete. 2024-09-12T02:13:53.657 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:53 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3673641958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:13:53.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.771+0000 7f600be00640 1 -- 172.21.15.110:0/966714197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c1079c0 msgr2=0x7f600c107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:53.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.771+0000 7f600be00640 1 --2- 172.21.15.110:0/966714197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c1079c0 0x7f600c107da0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009890 tx=0x7f5ffc02a360 comp rx=0 tx=0).stop 2024-09-12T02:13:53.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.771+0000 7f600be00640 1 -- 172.21.15.110:0/966714197 shutdown_connections 2024-09-12T02:13:53.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.771+0000 7f600be00640 1 --2- 172.21.15.110:0/966714197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c102360 0x7f600c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:53.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.771+0000 7f600be00640 1 --2- 172.21.15.110:0/966714197 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f600c1019c0 0x7f600c101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:53.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.771+0000 7f600be00640 1 --2- 172.21.15.110:0/966714197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c1079c0 0x7f600c107da0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:53.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.771+0000 7f600be00640 1 -- 172.21.15.110:0/966714197 >> 172.21.15.110:0/966714197 conn(0x7f600c0fd740 msgr2=0x7f600c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:53.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.771+0000 7f600be00640 1 -- 172.21.15.110:0/966714197 shutdown_connections 2024-09-12T02:13:53.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.771+0000 7f600be00640 1 -- 172.21.15.110:0/966714197 wait complete. 2024-09-12T02:13:53.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.772+0000 7f600be00640 1 Processor -- start 2024-09-12T02:13:53.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.772+0000 7f600be00640 1 -- start start 2024-09-12T02:13:53.773 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.772+0000 7f600be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c1019c0 0x7f600c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.772+0000 7f600be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c102360 0x7f600c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.772+0000 7f600be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f600c1079c0 0x7f600c19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.772+0000 7f600be00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f600c111dc0 con 0x7f600c1019c0 2024-09-12T02:13:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.772+0000 7f600be00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f600c111c40 con 0x7f600c1079c0 2024-09-12T02:13:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.772+0000 7f600be00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f600c111f40 con 0x7f600c102360 2024-09-12T02:13:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.773+0000 7f600a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c102360 0x7f600c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.773+0000 7f600aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c1019c0 0x7f600c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.773+0000 7f600a000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c102360 0x7f600c19aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:48878/0 (socket says 172.21.15.110:48878) 2024-09-12T02:13:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.773+0000 7f600a000640 1 -- 172.21.15.110:0/1946071381 learned_addr learned my addr 172.21.15.110:0/1946071381 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.773+0000 7f600b400640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f600c1079c0 0x7f600c19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.773+0000 7f600a000640 1 -- 172.21.15.110:0/1946071381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f600c1079c0 msgr2=0x7f600c19edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:53.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.773+0000 7f600a000640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f600c1079c0 0x7f600c19edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:53.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.773+0000 7f600a000640 1 -- 172.21.15.110:0/1946071381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c1019c0 msgr2=0x7f600c19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:53.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.773+0000 7f600a000640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c1019c0 0x7f600c19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:53.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.773+0000 7f600a000640 1 -- 172.21.15.110:0/1946071381 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c19f4d0 con 0x7f600c102360 2024-09-12T02:13:53.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.773+0000 7f600b400640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f600c1079c0 0x7f600c19edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:13:53.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.774+0000 7f600a000640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c102360 0x7f600c19aa60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800e9f0 tx=0x7f5ff800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:53.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.774+0000 7f6003400640 1 -- 172.21.15.110:0/1946071381 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff800cd80 con 0x7f600c102360 2024-09-12T02:13:53.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.774+0000 7f600be00640 1 -- 172.21.15.110:0/1946071381 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600c19f7c0 con 0x7f600c102360 2024-09-12T02:13:53.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.774+0000 7f6003400640 1 -- 172.21.15.110:0/1946071381 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ff8010910 con 0x7f600c102360 2024-09-12T02:13:53.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.774+0000 7f6003400640 1 -- 172.21.15.110:0/1946071381 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80188f0 con 0x7f600c102360 2024-09-12T02:13:53.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.774+0000 7f600be00640 1 -- 172.21.15.110:0/1946071381 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f600c1a70a0 con 0x7f600c102360 2024-09-12T02:13:53.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.775+0000 7f600be00640 1 -- 172.21.15.110:0/1946071381 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f600c101e20 con 0x7f600c102360 2024-09-12T02:13:53.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.777+0000 7f6003400640 1 -- 172.21.15.110:0/1946071381 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5ff8010ac0 con 0x7f600c102360 2024-09-12T02:13:53.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.778+0000 7f6003400640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5ff00a2c10 0x7f5ff00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:53.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.778+0000 7f6003400640 1 -- 172.21.15.110:0/1946071381 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f5ff80cfe90 con 0x7f600c102360 2024-09-12T02:13:53.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.778+0000 7f600aa00640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5ff00a2c10 0x7f5ff00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:53.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.780+0000 7f600aa00640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5ff00a2c10 0x7f5ff00a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc035040 tx=0x7f5ffc0056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:53.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.780+0000 7f6003400640 1 -- 172.21.15.110:0/1946071381 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ff809c240 con 0x7f600c102360 2024-09-12T02:13:53.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:53 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3673641958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:13:53.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:53 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3673641958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-12T02:13:53.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.960+0000 7f600be00640 1 -- 172.21.15.110:0/1946071381 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f600c1a7300 con 0x7f600c102360 2024-09-12T02:13:53.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.961+0000 7f6003400640 1 -- 172.21.15.110:0/1946071381 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ff80a0540 con 0x7f600c102360 2024-09-12T02:13:53.961 INFO:teuthology.orchestra.run.smithi110.stdout:77309411413 2024-09-12T02:13:53.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.963+0000 7f600be00640 1 -- 172.21.15.110:0/1946071381 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5ff00a2c10 msgr2=0x7f5ff00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:53.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.963+0000 7f600be00640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5ff00a2c10 0x7f5ff00a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc035040 tx=0x7f5ffc0056d0 comp rx=0 tx=0).stop 2024-09-12T02:13:53.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.963+0000 7f600be00640 1 -- 172.21.15.110:0/1946071381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c102360 msgr2=0x7f600c19aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:53.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.963+0000 7f600be00640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c102360 0x7f600c19aa60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ff800e9f0 tx=0x7f5ff800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:13:53.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.963+0000 7f600be00640 1 -- 172.21.15.110:0/1946071381 shutdown_connections 2024-09-12T02:13:53.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.963+0000 7f600be00640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5ff00a2c10 0x7f5ff00a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:53.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.963+0000 7f600be00640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f600c1079c0 0x7f600c19edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:53.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.963+0000 7f600be00640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c102360 0x7f600c19aa60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:53.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.963+0000 7f600be00640 1 --2- 172.21.15.110:0/1946071381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c1019c0 0x7f600c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:53.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.963+0000 7f600be00640 1 -- 172.21.15.110:0/1946071381 >> 172.21.15.110:0/1946071381 conn(0x7f600c0fd740 msgr2=0x7f600c0fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:53.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.963+0000 7f600be00640 1 -- 172.21.15.110:0/1946071381 shutdown_connections 2024-09-12T02:13:53.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:53.963+0000 7f600be00640 1 -- 172.21.15.110:0/1946071381 wait complete. 2024-09-12T02:13:54.665 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:54 smithi110 ceph-mon[30548]: pgmap v361: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-12T02:13:54.665 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:54 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1946071381' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:13:54.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.777+0000 7fd8f2400640 1 -- 172.21.15.110:0/2121512986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8ec103e30 msgr2=0x7fd8ec104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:54.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.777+0000 7fd8f2400640 1 --2- 172.21.15.110:0/2121512986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8ec103e30 0x7fd8ec104210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc009900 tx=0x7fd8dc02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:13:54.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.777+0000 7fd8f2400640 1 -- 172.21.15.110:0/2121512986 shutdown_connections 2024-09-12T02:13:54.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.777+0000 7fd8f2400640 1 --2- 172.21.15.110:0/2121512986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8ec108f60 0x7fd8ec110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:54.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.777+0000 7fd8f2400640 1 --2- 172.21.15.110:0/2121512986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8ec1047e0 0x7fd8ec108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:54.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.777+0000 7fd8f2400640 1 --2- 172.21.15.110:0/2121512986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8ec103e30 0x7fd8ec104210 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:54.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.777+0000 7fd8f2400640 1 -- 172.21.15.110:0/2121512986 >> 172.21.15.110:0/2121512986 conn(0x7fd8ec0ff8d0 msgr2=0x7fd8ec101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:54.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.777+0000 7fd8f2400640 1 -- 172.21.15.110:0/2121512986 shutdown_connections 2024-09-12T02:13:54.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.777+0000 7fd8f2400640 1 -- 172.21.15.110:0/2121512986 wait complete. 2024-09-12T02:13:54.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.778+0000 7fd8f2400640 1 Processor -- start 2024-09-12T02:13:54.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.778+0000 7fd8f2400640 1 -- start start 2024-09-12T02:13:54.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.778+0000 7fd8f2400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8ec103e30 0x7fd8ec19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:54.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.778+0000 7fd8f2400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8ec1047e0 0x7fd8ec19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:54.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.778+0000 7fd8f2400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8ec108f60 0x7fd8ec19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:54.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.778+0000 7fd8f2400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec114010 con 0x7fd8ec103e30 2024-09-12T02:13:54.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.778+0000 7fd8f2400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec113e90 con 0x7fd8ec1047e0 2024-09-12T02:13:54.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.778+0000 7fd8f2400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec114190 con 0x7fd8ec108f60 2024-09-12T02:13:54.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.779+0000 7fd8f1000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8ec103e30 0x7fd8ec19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:54.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.779+0000 7fd8f1000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8ec103e30 0x7fd8ec19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58148/0 (socket says 172.21.15.110:58148) 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.779+0000 7fd8f1000640 1 -- 172.21.15.110:0/486449527 learned_addr learned my addr 172.21.15.110:0/486449527 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.779+0000 7fd8e3e00640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8ec1047e0 0x7fd8ec19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.779+0000 7fd8f1a00640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8ec108f60 0x7fd8ec19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.779+0000 7fd8f1000640 1 -- 172.21.15.110:0/486449527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8ec108f60 msgr2=0x7fd8ec19ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.779+0000 7fd8f1000640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8ec108f60 0x7fd8ec19ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.779+0000 7fd8f1000640 1 -- 172.21.15.110:0/486449527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8ec1047e0 msgr2=0x7fd8ec19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.779+0000 7fd8f1000640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8ec1047e0 0x7fd8ec19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.779+0000 7fd8f1000640 1 -- 172.21.15.110:0/486449527 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec19f440 con 0x7fd8ec103e30 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.779+0000 7fd8f1000640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8ec103e30 0x7fd8ec19a490 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc004770 tx=0x7fd8dc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.780+0000 7fd8ea000640 1 -- 172.21.15.110:0/486449527 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc03f070 con 0x7fd8ec103e30 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.780+0000 7fd8ea000640 1 -- 172.21.15.110:0/486449527 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8dc031ca0 con 0x7fd8ec103e30 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.780+0000 7fd8f2400640 1 -- 172.21.15.110:0/486449527 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ec19f6d0 con 0x7fd8ec103e30 2024-09-12T02:13:54.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.780+0000 7fd8ea000640 1 -- 172.21.15.110:0/486449527 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc035030 con 0x7fd8ec103e30 2024-09-12T02:13:54.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.780+0000 7fd8f2400640 1 -- 172.21.15.110:0/486449527 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ec1a7010 con 0x7fd8ec103e30 2024-09-12T02:13:54.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.781+0000 7fd8f2400640 1 -- 172.21.15.110:0/486449527 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8ec105310 con 0x7fd8ec103e30 2024-09-12T02:13:54.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.783+0000 7fd8ea000640 1 -- 172.21.15.110:0/486449527 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd8dc042070 con 0x7fd8ec103e30 2024-09-12T02:13:54.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.784+0000 7fd8ea000640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd8d00a2c10 0x7fd8d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:54.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.784+0000 7fd8ea000640 1 -- 172.21.15.110:0/486449527 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fd8dc0ef680 con 0x7fd8ec103e30 2024-09-12T02:13:54.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.784+0000 7fd8e3e00640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd8d00a2c10 0x7fd8d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:54.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.785+0000 7fd8e3e00640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd8d00a2c10 0x7fd8d00a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0ffcf0 tx=0x7fd8d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:54.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.788+0000 7fd8ea000640 1 -- 172.21.15.110:0/486449527 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd8dc0bbb50 con 0x7fd8ec103e30 2024-09-12T02:13:54.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:54 smithi115 ceph-mon[35351]: pgmap v361: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-12T02:13:54.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:54 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1946071381' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:13:54.855 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:54.859 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:54.860 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:54.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:54 smithi136 ceph-mon[35814]: pgmap v361: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-12T02:13:54.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:54 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1946071381' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T02:13:54.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.997+0000 7fd8f2400640 1 -- 172.21.15.110:0/486449527 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd8ec10c140 con 0x7fd8ec103e30 2024-09-12T02:13:54.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:54.998+0000 7fd8ea000640 1 -- 172.21.15.110:0/486449527 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd8dc0bfe50 con 0x7fd8ec103e30 2024-09-12T02:13:54.998 INFO:teuthology.orchestra.run.smithi110.stdout:55834574937 2024-09-12T02:13:55.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:55.000+0000 7fd8f2400640 1 -- 172.21.15.110:0/486449527 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd8d00a2c10 msgr2=0x7fd8d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:55.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:55.000+0000 7fd8f2400640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd8d00a2c10 0x7fd8d00a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec0ffcf0 tx=0x7fd8d4005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:55.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:55.000+0000 7fd8f2400640 1 -- 172.21.15.110:0/486449527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8ec103e30 msgr2=0x7fd8ec19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:55.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:55.000+0000 7fd8f2400640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8ec103e30 0x7fd8ec19a490 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc004770 tx=0x7fd8dc003c10 comp rx=0 tx=0).stop 2024-09-12T02:13:55.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:55.000+0000 7fd8f2400640 1 -- 172.21.15.110:0/486449527 shutdown_connections 2024-09-12T02:13:55.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:55.000+0000 7fd8f2400640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd8d00a2c10 0x7fd8d00a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:55.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:55.000+0000 7fd8f2400640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd8ec108f60 0x7fd8ec19ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:55.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:55.000+0000 7fd8f2400640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd8ec1047e0 0x7fd8ec19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:55.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:55.000+0000 7fd8f2400640 1 --2- 172.21.15.110:0/486449527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8ec103e30 0x7fd8ec19a490 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:55.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:55.000+0000 7fd8f2400640 1 -- 172.21.15.110:0/486449527 >> 172.21.15.110:0/486449527 conn(0x7fd8ec0ff8d0 msgr2=0x7fd8ec100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:55.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:55.001+0000 7fd8f2400640 1 -- 172.21.15.110:0/486449527 shutdown_connections 2024-09-12T02:13:55.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:55.001+0000 7fd8f2400640 1 -- 172.21.15.110:0/486449527 wait complete. 2024-09-12T02:13:55.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:55 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/486449527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:13:55.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:55 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/486449527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:13:56.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:55 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/486449527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T02:13:56.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.549+0000 7fc482a00640 1 -- 172.21.15.110:0/434717185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c102b90 msgr2=0x7fc47c102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:56.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.549+0000 7fc482a00640 1 --2- 172.21.15.110:0/434717185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c102b90 0x7fc47c102f70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc470009900 tx=0x7fc47002a490 comp rx=0 tx=0).stop 2024-09-12T02:13:56.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.549+0000 7fc482a00640 1 -- 172.21.15.110:0/434717185 shutdown_connections 2024-09-12T02:13:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.550+0000 7fc482a00640 1 --2- 172.21.15.110:0/434717185 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc47c10bfc0 0x7fc47c10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.550+0000 7fc482a00640 1 --2- 172.21.15.110:0/434717185 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc47c1034b0 0x7fc47c10b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.550+0000 7fc482a00640 1 --2- 172.21.15.110:0/434717185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c102b90 0x7fc47c102f70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.550+0000 7fc482a00640 1 -- 172.21.15.110:0/434717185 >> 172.21.15.110:0/434717185 conn(0x7fc47c0fc610 msgr2=0x7fc47c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.550+0000 7fc482a00640 1 -- 172.21.15.110:0/434717185 shutdown_connections 2024-09-12T02:13:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.550+0000 7fc482a00640 1 -- 172.21.15.110:0/434717185 wait complete. 2024-09-12T02:13:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.551+0000 7fc482a00640 1 Processor -- start 2024-09-12T02:13:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.551+0000 7fc482a00640 1 -- start start 2024-09-12T02:13:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.551+0000 7fc482a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c102b90 0x7fc47c1007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.551+0000 7fc482a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc47c1034b0 0x7fc47c100d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:56.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.551+0000 7fc482a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc47c10bfc0 0x7fc47c101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.551+0000 7fc482a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c111e10 con 0x7fc47c10bfc0 2024-09-12T02:13:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.551+0000 7fc482a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c111c90 con 0x7fc47c102b90 2024-09-12T02:13:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.552+0000 7fc482a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c111f90 con 0x7fc47c1034b0 2024-09-12T02:13:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.552+0000 7fc481600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c102b90 0x7fc47c1007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.552+0000 7fc481600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c102b90 0x7fc47c1007f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:35086/0 (socket says 172.21.15.110:35086) 2024-09-12T02:13:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.552+0000 7fc481600640 1 -- 172.21.15.110:0/2270251756 learned_addr learned my addr 172.21.15.110:0/2270251756 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.552+0000 7fc480c00640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc47c1034b0 0x7fc47c100d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.552+0000 7fc482000640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc47c10bfc0 0x7fc47c101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.552+0000 7fc481600640 1 -- 172.21.15.110:0/2270251756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc47c1034b0 msgr2=0x7fc47c100d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.552+0000 7fc481600640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc47c1034b0 0x7fc47c100d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:56.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.552+0000 7fc481600640 1 -- 172.21.15.110:0/2270251756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc47c10bfc0 msgr2=0x7fc47c101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.552+0000 7fc481600640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc47c10bfc0 0x7fc47c101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.552+0000 7fc481600640 1 -- 172.21.15.110:0/2270251756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47c1a6790 con 0x7fc47c102b90 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.552+0000 7fc481600640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c102b90 0x7fc47c1007f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc470004770 tx=0x7fc470003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.553+0000 7fc47a000640 1 -- 172.21.15.110:0/2270251756 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47003f070 con 0x7fc47c102b90 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.553+0000 7fc47a000640 1 -- 172.21.15.110:0/2270251756 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc470031ca0 con 0x7fc47c102b90 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.553+0000 7fc47a000640 1 -- 172.21.15.110:0/2270251756 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470035030 con 0x7fc47c102b90 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.553+0000 7fc482a00640 1 -- 172.21.15.110:0/2270251756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc47c1a6a20 con 0x7fc47c102b90 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.553+0000 7fc482a00640 1 -- 172.21.15.110:0/2270251756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc47c1a6eb0 con 0x7fc47c102b90 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.554+0000 7fc482a00640 1 -- 172.21.15.110:0/2270251756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc47c102f70 con 0x7fc47c102b90 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.556+0000 7fc47a000640 1 -- 172.21.15.110:0/2270251756 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc470042070 con 0x7fc47c102b90 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.557+0000 7fc47a000640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc4640a2c90 0x7fc4640a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.557+0000 7fc47a000640 1 -- 172.21.15.110:0/2270251756 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fc4700efb90 con 0x7fc47c102b90 2024-09-12T02:13:56.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.557+0000 7fc480c00640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc4640a2c90 0x7fc4640a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:56.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.558+0000 7fc480c00640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc4640a2c90 0x7fc4640a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc47c102280 tx=0x7fc468005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:56.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.561+0000 7fc47a000640 1 -- 172.21.15.110:0/2270251756 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc4700bc650 con 0x7fc47c102b90 2024-09-12T02:13:56.583 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:56 smithi110 ceph-mon[30548]: pgmap v362: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:13:56.598 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:13:56.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.771+0000 7fc482a00640 1 -- 172.21.15.110:0/2270251756 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc47c107060 con 0x7fc47c102b90 2024-09-12T02:13:56.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.772+0000 7fc47a000640 1 -- 172.21.15.110:0/2270251756 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc4700bbf50 con 0x7fc47c102b90 2024-09-12T02:13:56.772 INFO:teuthology.orchestra.run.smithi110.stdout:283467841581 2024-09-12T02:13:56.774 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.774+0000 7fc482a00640 1 -- 172.21.15.110:0/2270251756 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc4640a2c90 msgr2=0x7fc4640a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:56.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.774+0000 7fc482a00640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc4640a2c90 0x7fc4640a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc47c102280 tx=0x7fc468005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:56.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.774+0000 7fc482a00640 1 -- 172.21.15.110:0/2270251756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c102b90 msgr2=0x7fc47c1007f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:56.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.774+0000 7fc482a00640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c102b90 0x7fc47c1007f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc470004770 tx=0x7fc470003c10 comp rx=0 tx=0).stop 2024-09-12T02:13:56.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.774+0000 7fc482a00640 1 -- 172.21.15.110:0/2270251756 shutdown_connections 2024-09-12T02:13:56.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.774+0000 7fc482a00640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc4640a2c90 0x7fc4640a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:56.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.774+0000 7fc482a00640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc47c10bfc0 0x7fc47c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:56.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.774+0000 7fc482a00640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc47c1034b0 0x7fc47c100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:56.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.774+0000 7fc482a00640 1 --2- 172.21.15.110:0/2270251756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc47c102b90 0x7fc47c1007f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:56.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.774+0000 7fc482a00640 1 -- 172.21.15.110:0/2270251756 >> 172.21.15.110:0/2270251756 conn(0x7fc47c0fc610 msgr2=0x7fc47c0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:56.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.774+0000 7fc482a00640 1 -- 172.21.15.110:0/2270251756 shutdown_connections 2024-09-12T02:13:56.775 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.774+0000 7fc482a00640 1 -- 172.21.15.110:0/2270251756 wait complete. 2024-09-12T02:13:56.809 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:56 smithi136 ceph-mon[35814]: pgmap v362: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:13:57.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:56 smithi115 ceph-mon[35351]: pgmap v362: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-12T02:13:57.556 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103217 got 249108103220 for osd.8 2024-09-12T02:13:57.556 DEBUG:teuthology.parallel:result is None 2024-09-12T02:13:57.862 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:57 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2610541006' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:13:57.862 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:57 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2270251756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:13:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:57 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2610541006' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:13:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:57 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2270251756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:13:58.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:57 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2610541006' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-12T02:13:58.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:57 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2270251756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-12T02:13:58.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.094+0000 7f65b3000640 1 -- 172.21.15.110:0/332181774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65ac103ff0 msgr2=0x7f65ac1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.094+0000 7f65b3000640 1 --2- 172.21.15.110:0/332181774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65ac103ff0 0x7f65ac1043d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f659c009900 tx=0x7f659c02a410 comp rx=0 tx=0).stop 2024-09-12T02:13:58.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.094+0000 7f65b3000640 1 -- 172.21.15.110:0/332181774 shutdown_connections 2024-09-12T02:13:58.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.094+0000 7f65b3000640 1 --2- 172.21.15.110:0/332181774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65ac109120 0x7f65ac110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.094+0000 7f65b3000640 1 --2- 172.21.15.110:0/332181774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65ac1049a0 0x7f65ac1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.094+0000 7f65b3000640 1 --2- 172.21.15.110:0/332181774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65ac103ff0 0x7f65ac1043d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.094+0000 7f65b3000640 1 -- 172.21.15.110:0/332181774 >> 172.21.15.110:0/332181774 conn(0x7f65ac0ffa90 msgr2=0x7f65ac101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:58.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.094+0000 7f65b3000640 1 -- 172.21.15.110:0/332181774 shutdown_connections 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.094+0000 7f65b3000640 1 -- 172.21.15.110:0/332181774 wait complete. 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.095+0000 7f65b3000640 1 Processor -- start 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.096+0000 7f65b3000640 1 -- start start 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.096+0000 7f65b3000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65ac103ff0 0x7f65ac19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.096+0000 7f65b3000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65ac1049a0 0x7f65ac19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.096+0000 7f65b3000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65ac109120 0x7f65ac19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.096+0000 7f65b3000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac114170 con 0x7f65ac103ff0 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.096+0000 7f65b3000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac113ff0 con 0x7f65ac109120 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.096+0000 7f65b3000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac1142f0 con 0x7f65ac1049a0 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.096+0000 7f65abe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65ac103ff0 0x7f65ac19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.096+0000 7f65abe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65ac103ff0 0x7f65ac19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58198/0 (socket says 172.21.15.110:58198) 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.096+0000 7f65abe00640 1 -- 172.21.15.110:0/1797348861 learned_addr learned my addr 172.21.15.110:0/1797348861 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:58.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.096+0000 7f65ab400640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65ac1049a0 0x7f65ac19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:58.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.096+0000 7f65b1000640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65ac109120 0x7f65ac19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:58.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.097+0000 7f65abe00640 1 -- 172.21.15.110:0/1797348861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65ac1049a0 msgr2=0x7f65ac19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.097+0000 7f65abe00640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65ac1049a0 0x7f65ac19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.097+0000 7f65abe00640 1 -- 172.21.15.110:0/1797348861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65ac109120 msgr2=0x7f65ac19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.097+0000 7f65abe00640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65ac109120 0x7f65ac19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.097+0000 7f65abe00640 1 -- 172.21.15.110:0/1797348861 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ac19f5e0 con 0x7f65ac103ff0 2024-09-12T02:13:58.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.097+0000 7f65abe00640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65ac103ff0 0x7f65ac19a630 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f659c004770 tx=0x7f659c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:58.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.097+0000 7f65a8c00640 1 -- 172.21.15.110:0/1797348861 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c03f070 con 0x7f65ac103ff0 2024-09-12T02:13:58.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.097+0000 7f65a8c00640 1 -- 172.21.15.110:0/1797348861 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f659c031ca0 con 0x7f65ac103ff0 2024-09-12T02:13:58.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.097+0000 7f65b3000640 1 -- 172.21.15.110:0/1797348861 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65ac19f870 con 0x7f65ac103ff0 2024-09-12T02:13:58.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.097+0000 7f65a8c00640 1 -- 172.21.15.110:0/1797348861 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c035030 con 0x7f65ac103ff0 2024-09-12T02:13:58.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.098+0000 7f65b3000640 1 -- 172.21.15.110:0/1797348861 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ac1a71b0 con 0x7f65ac103ff0 2024-09-12T02:13:58.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.099+0000 7f65b3000640 1 -- 172.21.15.110:0/1797348861 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65ac1054d0 con 0x7f65ac103ff0 2024-09-12T02:13:58.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.100+0000 7f65a8c00640 1 -- 172.21.15.110:0/1797348861 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f659c042070 con 0x7f65ac103ff0 2024-09-12T02:13:58.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.102+0000 7f65a8c00640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f65900a2c10 0x7f65900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:58.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.102+0000 7f65a8c00640 1 -- 172.21.15.110:0/1797348861 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f659c0efc50 con 0x7f65ac103ff0 2024-09-12T02:13:58.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.102+0000 7f65ab400640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f65900a2c10 0x7f65900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:58.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.103+0000 7f65ab400640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f65900a2c10 0x7f65900a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0fff90 tx=0x7f6598005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:58.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.106+0000 7f65a8c00640 1 -- 172.21.15.110:0/1797348861 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f659c0bc000 con 0x7f65ac103ff0 2024-09-12T02:13:58.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.504+0000 7f2cc6600640 1 -- 172.21.15.110:0/2335043177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc0101de0 msgr2=0x7f2cc01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.504+0000 7f2cc6600640 1 --2- 172.21.15.110:0/2335043177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc0101de0 0x7f2cc01021c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2cb0009900 tx=0x7f2cb002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.504+0000 7f2cc6600640 1 -- 172.21.15.110:0/2335043177 shutdown_connections 2024-09-12T02:13:58.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.504+0000 7f2cc6600640 1 --2- 172.21.15.110:0/2335043177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cc0106f10 0x7f2cc010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.504+0000 7f2cc6600640 1 --2- 172.21.15.110:0/2335043177 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc0102790 0x7f2cc01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.504+0000 7f2cc6600640 1 --2- 172.21.15.110:0/2335043177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc0101de0 0x7f2cc01021c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.504+0000 7f2cc6600640 1 -- 172.21.15.110:0/2335043177 >> 172.21.15.110:0/2335043177 conn(0x7f2cc00fd8c0 msgr2=0x7f2cc00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:58.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.504+0000 7f2cc6600640 1 -- 172.21.15.110:0/2335043177 shutdown_connections 2024-09-12T02:13:58.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.504+0000 7f2cc6600640 1 -- 172.21.15.110:0/2335043177 wait complete. 2024-09-12T02:13:58.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.505+0000 7f2cc6600640 1 Processor -- start 2024-09-12T02:13:58.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.505+0000 7f2cc6600640 1 -- start start 2024-09-12T02:13:58.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.505+0000 7f2cc6600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cc0101de0 0x7f2cc0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:58.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.505+0000 7f2cc6600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc0102790 0x7f2cc0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:58.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.505+0000 7f2cc6600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc0106f10 0x7f2cc019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:58.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.505+0000 7f2cc6600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc0111fc0 con 0x7f2cc0102790 2024-09-12T02:13:58.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.505+0000 7f2cc6600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc0111e40 con 0x7f2cc0106f10 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.505+0000 7f2cc6600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc0112140 con 0x7f2cc0101de0 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.505+0000 7f2cbea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc0102790 0x7f2cc0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.506+0000 7f2cbfe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc0106f10 0x7f2cc019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.506+0000 7f2cbf400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cc0101de0 0x7f2cc0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.506+0000 7f2cbfe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc0106f10 0x7f2cc019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:35116/0 (socket says 172.21.15.110:35116) 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.506+0000 7f2cbfe00640 1 -- 172.21.15.110:0/2161901523 learned_addr learned my addr 172.21.15.110:0/2161901523 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.506+0000 7f2cbea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc0102790 0x7f2cc0198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58182/0 (socket says 172.21.15.110:58182) 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.506+0000 7f2cbf400640 1 -- 172.21.15.110:0/2161901523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc0106f10 msgr2=0x7f2cc019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.506+0000 7f2cbf400640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc0106f10 0x7f2cc019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.506+0000 7f2cbf400640 1 -- 172.21.15.110:0/2161901523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc0102790 msgr2=0x7f2cc0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.506+0000 7f2cbf400640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc0102790 0x7f2cc0198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.506+0000 7f2cbf400640 1 -- 172.21.15.110:0/2161901523 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc019d3f0 con 0x7f2cc0101de0 2024-09-12T02:13:58.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.506+0000 7f2cbfe00640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc0106f10 0x7f2cc019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:13:58.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.506+0000 7f2cbf400640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cc0101de0 0x7f2cc0198440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2cb002a910 tx=0x7f2cb0003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:58.219 INFO:teuthology.orchestra.run.smithi110.stdout:335007449123 2024-09-12T02:13:58.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.507+0000 7f2cb7e00640 1 -- 172.21.15.110:0/2161901523 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb003f070 con 0x7f2cc0101de0 2024-09-12T02:13:58.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.507+0000 7f2cc6600640 1 -- 172.21.15.110:0/2161901523 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc019d680 con 0x7f2cc0101de0 2024-09-12T02:13:58.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.507+0000 7f2cb7e00640 1 -- 172.21.15.110:0/2161901523 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cb0031c90 con 0x7f2cc0101de0 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.507+0000 7f2cb7e00640 1 -- 172.21.15.110:0/2161901523 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0035030 con 0x7f2cc0101de0 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.507+0000 7f2cc6600640 1 -- 172.21.15.110:0/2161901523 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc01a4fc0 con 0x7f2cc0101de0 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.508+0000 7f2cc6600640 1 -- 172.21.15.110:0/2161901523 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc01032c0 con 0x7f2cc0101de0 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.510+0000 7f2cb7e00640 1 -- 172.21.15.110:0/2161901523 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2cb0042070 con 0x7f2cc0101de0 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.512+0000 7f2cb7e00640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2ca40a2c10 0x7f2ca40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.512+0000 7f2cb7e00640 1 -- 172.21.15.110:0/2161901523 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f2cb00f04b0 con 0x7f2cc0101de0 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.512+0000 7f2cbea00640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2ca40a2c10 0x7f2ca40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.513+0000 7f2cb7e00640 1 -- 172.21.15.110:0/2161901523 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2cb00bc860 con 0x7f2cc0101de0 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.513+0000 7f2cbea00640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2ca40a2c10 0x7f2ca40a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00fdce0 tx=0x7f2cac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.703+0000 7f2cc6600640 1 -- 172.21.15.110:0/2161901523 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f2cc010a0f0 con 0x7f2cc0101de0 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.703+0000 7f2cb7e00640 1 -- 172.21.15.110:0/2161901523 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f2cb00c0b60 con 0x7f2cc0101de0 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.706+0000 7f2cc6600640 1 -- 172.21.15.110:0/2161901523 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2ca40a2c10 msgr2=0x7f2ca40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.706+0000 7f2cc6600640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2ca40a2c10 0x7f2ca40a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00fdce0 tx=0x7f2cac005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.706+0000 7f2cc6600640 1 -- 172.21.15.110:0/2161901523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cc0101de0 msgr2=0x7f2cc0198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.706+0000 7f2cc6600640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cc0101de0 0x7f2cc0198440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2cb002a910 tx=0x7f2cb0003b20 comp rx=0 tx=0).stop 2024-09-12T02:13:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.706+0000 7f2cc6600640 1 -- 172.21.15.110:0/2161901523 shutdown_connections 2024-09-12T02:13:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.706+0000 7f2cc6600640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2ca40a2c10 0x7f2ca40a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.706+0000 7f2cc6600640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2cc0106f10 0x7f2cc019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.706+0000 7f2cc6600640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cc0102790 0x7f2cc0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.706+0000 7f2cc6600640 1 --2- 172.21.15.110:0/2161901523 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cc0101de0 0x7f2cc0198440 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.706+0000 7f2cc6600640 1 -- 172.21.15.110:0/2161901523 >> 172.21.15.110:0/2161901523 conn(0x7f2cc00fd8c0 msgr2=0x7f2cc00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.706+0000 7f2cc6600640 1 -- 172.21.15.110:0/2161901523 shutdown_connections 2024-09-12T02:13:58.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:57.706+0000 7f2cc6600640 1 -- 172.21.15.110:0/2161901523 wait complete. 2024-09-12T02:13:58.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.288+0000 7f65b3000640 1 -- 172.21.15.110:0/1797348861 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f65ac10c300 con 0x7f65ac103ff0 2024-09-12T02:13:58.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.289+0000 7f65a8c00640 1 -- 172.21.15.110:0/1797348861 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f659c0c0300 con 0x7f65ac103ff0 2024-09-12T02:13:58.289 INFO:teuthology.orchestra.run.smithi110.stdout:34359738463 2024-09-12T02:13:58.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.291+0000 7f65b3000640 1 -- 172.21.15.110:0/1797348861 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f65900a2c10 msgr2=0x7f65900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.291+0000 7f65b3000640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f65900a2c10 0x7f65900a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0fff90 tx=0x7f6598005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:58.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.291+0000 7f65b3000640 1 -- 172.21.15.110:0/1797348861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65ac103ff0 msgr2=0x7f65ac19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.291+0000 7f65b3000640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65ac103ff0 0x7f65ac19a630 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f659c004770 tx=0x7f659c003c10 comp rx=0 tx=0).stop 2024-09-12T02:13:58.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.291+0000 7f65b3000640 1 -- 172.21.15.110:0/1797348861 shutdown_connections 2024-09-12T02:13:58.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.291+0000 7f65b3000640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f65900a2c10 0x7f65900a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.291+0000 7f65b3000640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65ac109120 0x7f65ac19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.291+0000 7f65b3000640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65ac1049a0 0x7f65ac19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.291+0000 7f65b3000640 1 --2- 172.21.15.110:0/1797348861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65ac103ff0 0x7f65ac19a630 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.291+0000 7f65b3000640 1 -- 172.21.15.110:0/1797348861 >> 172.21.15.110:0/1797348861 conn(0x7f65ac0ffa90 msgr2=0x7f65ac100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:58.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.291+0000 7f65b3000640 1 -- 172.21.15.110:0/1797348861 shutdown_connections 2024-09-12T02:13:58.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:58.291+0000 7f65b3000640 1 -- 172.21.15.110:0/1797348861 wait complete. 2024-09-12T02:13:58.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.428+0000 7fd600e00640 1 -- 172.21.15.110:0/2017938467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5fc074510 msgr2=0x7fd5fc0748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.428+0000 7fd600e00640 1 --2- 172.21.15.110:0/2017938467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5fc074510 0x7fd5fc0748f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009900 tx=0x7fd5ec02a480 comp rx=0 tx=0).stop 2024-09-12T02:13:58.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.428+0000 7fd600e00640 1 -- 172.21.15.110:0/2017938467 shutdown_connections 2024-09-12T02:13:58.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.428+0000 7fd600e00640 1 --2- 172.21.15.110:0/2017938467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5fc10e450 0x7fd5fc110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.428+0000 7fd600e00640 1 --2- 172.21.15.110:0/2017938467 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5fc074e30 0x7fd5fc10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.428+0000 7fd600e00640 1 --2- 172.21.15.110:0/2017938467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5fc074510 0x7fd5fc0748f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.428+0000 7fd600e00640 1 -- 172.21.15.110:0/2017938467 >> 172.21.15.110:0/2017938467 conn(0x7fd5fc0fd8b0 msgr2=0x7fd5fc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:58.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.428+0000 7fd600e00640 1 -- 172.21.15.110:0/2017938467 shutdown_connections 2024-09-12T02:13:58.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.428+0000 7fd600e00640 1 -- 172.21.15.110:0/2017938467 wait complete. 2024-09-12T02:13:58.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.429+0000 7fd600e00640 1 Processor -- start 2024-09-12T02:13:58.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.429+0000 7fd600e00640 1 -- start start 2024-09-12T02:13:58.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.429+0000 7fd600e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5fc074510 0x7fd5fc19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:58.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.429+0000 7fd600e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5fc074e30 0x7fd5fc19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:58.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.429+0000 7fd600e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5fc10e450 0x7fd5fc19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:58.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd600e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc114160 con 0x7fd5fc074e30 2024-09-12T02:13:58.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd600e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc113fe0 con 0x7fd5fc074510 2024-09-12T02:13:58.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd600e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd5fc1142e0 con 0x7fd5fc10e450 2024-09-12T02:13:58.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd5f1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5fc074e30 0x7fd5fc19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:58.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd5f9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5fc074510 0x7fd5fc19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:58.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd5f9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5fc074510 0x7fd5fc19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:35064/0 (socket says 172.21.15.110:35064) 2024-09-12T02:13:58.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd5f9e00640 1 -- 172.21.15.110:0/2610541006 learned_addr learned my addr 172.21.15.110:0/2610541006 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:13:58.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd5fa800640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5fc10e450 0x7fd5fc19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd5f9e00640 1 -- 172.21.15.110:0/2610541006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5fc10e450 msgr2=0x7fd5fc19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd5f9e00640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5fc10e450 0x7fd5fc19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd5f9e00640 1 -- 172.21.15.110:0/2610541006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5fc074e30 msgr2=0x7fd5fc19ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd5f9e00640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5fc074e30 0x7fd5fc19ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd5f9e00640 1 -- 172.21.15.110:0/2610541006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5fc19f690 con 0x7fd5fc074510 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.430+0000 7fd5f9e00640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5fc074510 0x7fd5fc19a6e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec006010 tx=0x7fd5ec004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.431+0000 7fd5f3400640 1 -- 172.21.15.110:0/2610541006 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec03f030 con 0x7fd5fc074510 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.431+0000 7fd5f3400640 1 -- 172.21.15.110:0/2610541006 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5ec004440 con 0x7fd5fc074510 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.431+0000 7fd600e00640 1 -- 172.21.15.110:0/2610541006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5fc19f920 con 0x7fd5fc074510 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.431+0000 7fd5f3400640 1 -- 172.21.15.110:0/2610541006 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec035070 con 0x7fd5fc074510 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.431+0000 7fd600e00640 1 -- 172.21.15.110:0/2610541006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5fc1a7260 con 0x7fd5fc074510 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.432+0000 7fd600e00640 1 -- 172.21.15.110:0/2610541006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5fc075c50 con 0x7fd5fc074510 2024-09-12T02:13:58.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.434+0000 7fd5f3400640 1 -- 172.21.15.110:0/2610541006 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd5ec042030 con 0x7fd5fc074510 2024-09-12T02:13:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.435+0000 7fd5f3400640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd5e00a2c10 0x7fd5e00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:13:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.435+0000 7fd5f3400640 1 -- 172.21.15.110:0/2610541006 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fd5ec0efb80 con 0x7fd5fc074510 2024-09-12T02:13:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.436+0000 7fd5f1400640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd5e00a2c10 0x7fd5e00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:13:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.436+0000 7fd5f1400640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd5e00a2c10 0x7fd5e00a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40095f0 tx=0x7fd5e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:13:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.438+0000 7fd5f3400640 1 -- 172.21.15.110:0/2610541006 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd5ec0bbf30 con 0x7fd5fc074510 2024-09-12T02:13:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.639+0000 7fd600e00640 1 -- 172.21.15.110:0/2610541006 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd5fc1095d0 con 0x7fd5fc074510 2024-09-12T02:13:58.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.640+0000 7fd5f3400640 1 -- 172.21.15.110:0/2610541006 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd5ec0c0230 con 0x7fd5fc074510 2024-09-12T02:13:58.648 INFO:teuthology.orchestra.run.smithi110.stdout:219043332153 2024-09-12T02:13:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.642+0000 7fd600e00640 1 -- 172.21.15.110:0/2610541006 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd5e00a2c10 msgr2=0x7fd5e00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.642+0000 7fd600e00640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd5e00a2c10 0x7fd5e00a50d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40095f0 tx=0x7fd5e4005f90 comp rx=0 tx=0).stop 2024-09-12T02:13:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.642+0000 7fd600e00640 1 -- 172.21.15.110:0/2610541006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5fc074510 msgr2=0x7fd5fc19a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:13:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.642+0000 7fd600e00640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5fc074510 0x7fd5fc19a6e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec006010 tx=0x7fd5ec004040 comp rx=0 tx=0).stop 2024-09-12T02:13:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.643+0000 7fd600e00640 1 -- 172.21.15.110:0/2610541006 shutdown_connections 2024-09-12T02:13:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.643+0000 7fd600e00640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd5e00a2c10 0x7fd5e00a50d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.643+0000 7fd600e00640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5fc10e450 0x7fd5fc19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.643+0000 7fd600e00640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5fc074e30 0x7fd5fc19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.643+0000 7fd600e00640 1 --2- 172.21.15.110:0/2610541006 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5fc074510 0x7fd5fc19a6e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:13:58.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.643+0000 7fd600e00640 1 -- 172.21.15.110:0/2610541006 >> 172.21.15.110:0/2610541006 conn(0x7fd5fc0fd8b0 msgr2=0x7fd5fc0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:13:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.643+0000 7fd600e00640 1 -- 172.21.15.110:0/2610541006 shutdown_connections 2024-09-12T02:13:58.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:56.643+0000 7fd600e00640 1 -- 172.21.15.110:0/2610541006 wait complete. 2024-09-12T02:13:58.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:58 smithi136 ceph-mon[35814]: pgmap v363: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-12T02:13:58.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:58 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2161901523' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:13:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:13:58 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1797348861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:13:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:58 smithi110 ceph-mon[30548]: pgmap v363: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-12T02:13:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:58 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2161901523' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:13:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:13:58 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1797348861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:13:58.946 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:58 smithi115 ceph-mon[35351]: pgmap v363: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-12T02:13:58.946 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:58 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2161901523' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-12T02:13:58.946 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:13:58 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1797348861' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T02:13:59.059 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449120 got 335007449123 for osd.11 2024-09-12T02:13:59.059 DEBUG:teuthology.parallel:result is None 2024-09-12T02:13:59.774 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574933 got 55834574937 for osd.1 2024-09-12T02:13:59.774 DEBUG:teuthology.parallel:result is None 2024-09-12T02:14:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.946+0000 7f84f7e00640 1 -- 172.21.15.110:0/3523063711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84f0074f40 msgr2=0x7f84f010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.946+0000 7f84f7e00640 1 --2- 172.21.15.110:0/3523063711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84f0074f40 0x7f84f010de80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009860 tx=0x7f84dc02a3d0 comp rx=0 tx=0).stop 2024-09-12T02:14:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.946+0000 7f84f7e00640 1 -- 172.21.15.110:0/3523063711 shutdown_connections 2024-09-12T02:14:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.946+0000 7f84f7e00640 1 --2- 172.21.15.110:0/3523063711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f010e3c0 0x7f84f0110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:00.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.946+0000 7f84f7e00640 1 --2- 172.21.15.110:0/3523063711 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84f0074f40 0x7f84f010de80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:00.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.946+0000 7f84f7e00640 1 --2- 172.21.15.110:0/3523063711 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f0074620 0x7f84f0074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:00.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.946+0000 7f84f7e00640 1 -- 172.21.15.110:0/3523063711 >> 172.21.15.110:0/3523063711 conn(0x7f84f00fd8c0 msgr2=0x7f84f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:00.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.947+0000 7f84f7e00640 1 -- 172.21.15.110:0/3523063711 shutdown_connections 2024-09-12T02:14:00.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.947+0000 7f84f7e00640 1 -- 172.21.15.110:0/3523063711 wait complete. 2024-09-12T02:14:00.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.947+0000 7f84f7e00640 1 Processor -- start 2024-09-12T02:14:00.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.948+0000 7f84f7e00640 1 -- start start 2024-09-12T02:14:00.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.948+0000 7f84f7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f0074620 0x7f84f019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:00.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.948+0000 7f84f7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84f0074f40 0x7f84f019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:00.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.948+0000 7f84f7e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f010e3c0 0x7f84f019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:00.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.948+0000 7f84f7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01141b0 con 0x7f84f0074620 2024-09-12T02:14:00.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.948+0000 7f84f7e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0114030 con 0x7f84f010e3c0 2024-09-12T02:14:00.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.948+0000 7f84f7e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0114330 con 0x7f84f0074f40 2024-09-12T02:14:00.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.948+0000 7f84f5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f0074620 0x7f84f019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:00.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.948+0000 7f84f5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f0074620 0x7f84f019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58394/0 (socket says 172.21.15.110:58394) 2024-09-12T02:14:00.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.948+0000 7f84f4a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84f0074f40 0x7f84f019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:00.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.948+0000 7f84f5400640 1 -- 172.21.15.110:0/4144970921 learned_addr learned my addr 172.21.15.110:0/4144970921 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:00.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.948+0000 7f84f5e00640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f010e3c0 0x7f84f019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:00.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.949+0000 7f84f5400640 1 -- 172.21.15.110:0/4144970921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84f0074f40 msgr2=0x7f84f019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:00.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.949+0000 7f84f5400640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84f0074f40 0x7f84f019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:00.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.949+0000 7f84f5400640 1 -- 172.21.15.110:0/4144970921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f010e3c0 msgr2=0x7f84f019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:00.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.949+0000 7f84f5400640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f010e3c0 0x7f84f019efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:00.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.949+0000 7f84f5400640 1 -- 172.21.15.110:0/4144970921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f019f680 con 0x7f84f0074620 2024-09-12T02:14:00.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.949+0000 7f84f5e00640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f010e3c0 0x7f84f019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:00.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.949+0000 7f84f5400640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f0074620 0x7f84f019a6d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c420 tx=0x7f84e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:00.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.949+0000 7f84ee000640 1 -- 172.21.15.110:0/4144970921 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4004b20 con 0x7f84f0074620 2024-09-12T02:14:00.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.949+0000 7f84f7e00640 1 -- 172.21.15.110:0/4144970921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f019f970 con 0x7f84f0074620 2024-09-12T02:14:00.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.949+0000 7f84ee000640 1 -- 172.21.15.110:0/4144970921 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84e4003e50 con 0x7f84f0074620 2024-09-12T02:14:00.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.949+0000 7f84ee000640 1 -- 172.21.15.110:0/4144970921 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e400b630 con 0x7f84f0074620 2024-09-12T02:14:00.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.949+0000 7f84f7e00640 1 -- 172.21.15.110:0/4144970921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f01a7250 con 0x7f84f0074620 2024-09-12T02:14:00.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.950+0000 7f84f7e00640 1 -- 172.21.15.110:0/4144970921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f0074a00 con 0x7f84f0074620 2024-09-12T02:14:00.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.952+0000 7f84ee000640 1 -- 172.21.15.110:0/4144970921 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f84e401d020 con 0x7f84f0074620 2024-09-12T02:14:00.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.953+0000 7f84ee000640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f84d80a2c10 0x7f84d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:00.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.954+0000 7f84ee000640 1 -- 172.21.15.110:0/4144970921 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f84e40cf670 con 0x7f84f0074620 2024-09-12T02:14:00.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.954+0000 7f84f4a00640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f84d80a2c10 0x7f84d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:00.314 INFO:teuthology.orchestra.run.smithi110.stdout:163208757318 2024-09-12T02:14:00.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.954+0000 7f84f4a00640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f84d80a2c10 0x7f84d80a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f84f010f740 tx=0x7f84dc005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:00.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:13:59.957+0000 7f84ee000640 1 -- 172.21.15.110:0/4144970921 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84e409c070 con 0x7f84f0074620 2024-09-12T02:14:00.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.141+0000 7f84f7e00640 1 -- 172.21.15.110:0/4144970921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f84f0109540 con 0x7f84f0074620 2024-09-12T02:14:00.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.142+0000 7f84ee000640 1 -- 172.21.15.110:0/4144970921 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f84e409b970 con 0x7f84f0074620 2024-09-12T02:14:00.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.144+0000 7f84f7e00640 1 -- 172.21.15.110:0/4144970921 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f84d80a2c10 msgr2=0x7f84d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:00.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.144+0000 7f84f7e00640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f84d80a2c10 0x7f84d80a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f84f010f740 tx=0x7f84dc005c90 comp rx=0 tx=0).stop 2024-09-12T02:14:00.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.144+0000 7f84f7e00640 1 -- 172.21.15.110:0/4144970921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f0074620 msgr2=0x7f84f019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:00.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.144+0000 7f84f7e00640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f0074620 0x7f84f019a6d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c420 tx=0x7f84e400c8e0 comp rx=0 tx=0).stop 2024-09-12T02:14:00.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.144+0000 7f84f7e00640 1 -- 172.21.15.110:0/4144970921 shutdown_connections 2024-09-12T02:14:00.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.144+0000 7f84f7e00640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f84d80a2c10 0x7f84d80a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:00.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.144+0000 7f84f7e00640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f84f010e3c0 0x7f84f019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:00.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.144+0000 7f84f7e00640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84f0074f40 0x7f84f019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:00.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.144+0000 7f84f7e00640 1 --2- 172.21.15.110:0/4144970921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84f0074620 0x7f84f019a6d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:00.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.144+0000 7f84f7e00640 1 -- 172.21.15.110:0/4144970921 >> 172.21.15.110:0/4144970921 conn(0x7f84f00fd8c0 msgr2=0x7f84f00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:00.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.144+0000 7f84f7e00640 1 -- 172.21.15.110:0/4144970921 shutdown_connections 2024-09-12T02:14:00.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.144+0000 7f84f7e00640 1 -- 172.21.15.110:0/4144970921 wait complete. 2024-09-12T02:14:00.896 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:00 smithi110 ceph-mon[30548]: pgmap v364: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-12T02:14:00.896 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:00 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/4144970921' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:14:00.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:00 smithi136 ceph-mon[35814]: pgmap v364: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-12T02:14:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:00 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/4144970921' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:14:01.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.904+0000 7f02a7e00640 1 -- 172.21.15.110:0/2340954002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0102780 msgr2=0x7f02a01067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:01.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.904+0000 7f02a7e00640 1 --2- 172.21.15.110:0/2340954002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0102780 0x7f02a01067d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f028c009900 tx=0x7f028c02a410 comp rx=0 tx=0).stop 2024-09-12T02:14:01.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.904+0000 7f02a7e00640 1 -- 172.21.15.110:0/2340954002 shutdown_connections 2024-09-12T02:14:01.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.904+0000 7f02a7e00640 1 --2- 172.21.15.110:0/2340954002 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02a0106f00 0x7f02a010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:01.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.904+0000 7f02a7e00640 1 --2- 172.21.15.110:0/2340954002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0102780 0x7f02a01067d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:01.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.904+0000 7f02a7e00640 1 --2- 172.21.15.110:0/2340954002 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02a0101dd0 0x7f02a01021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:01.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.904+0000 7f02a7e00640 1 -- 172.21.15.110:0/2340954002 >> 172.21.15.110:0/2340954002 conn(0x7f02a00fd8b0 msgr2=0x7f02a00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:01.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.904+0000 7f02a7e00640 1 -- 172.21.15.110:0/2340954002 shutdown_connections 2024-09-12T02:14:01.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.904+0000 7f02a7e00640 1 -- 172.21.15.110:0/2340954002 wait complete. 2024-09-12T02:14:01.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.905+0000 7f02a7e00640 1 Processor -- start 2024-09-12T02:14:01.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.905+0000 7f02a7e00640 1 -- start start 2024-09-12T02:14:01.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02a0101dd0 0x7f02a0198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:01.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0102780 0x7f02a0198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:01.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a7e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02a0106f00 0x7f02a019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:01.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f02a0111ff0 con 0x7f02a0102780 2024-09-12T02:14:01.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a7e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f02a0111e70 con 0x7f02a0106f00 2024-09-12T02:14:01.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a7e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f02a0112170 con 0x7f02a0101dd0 2024-09-12T02:14:01.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a4a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0102780 0x7f02a0198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:01.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a4a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0102780 0x7f02a0198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58424/0 (socket says 172.21.15.110:58424) 2024-09-12T02:14:01.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a4a00640 1 -- 172.21.15.110:0/2353127414 learned_addr learned my addr 172.21.15.110:0/2353127414 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:01.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a5e00640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02a0106f00 0x7f02a019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:01.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a4a00640 1 -- 172.21.15.110:0/2353127414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02a0101dd0 msgr2=0x7f02a0198510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:14:01.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a4a00640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02a0101dd0 0x7f02a0198510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:01.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a4a00640 1 -- 172.21.15.110:0/2353127414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02a0106f00 msgr2=0x7f02a019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:01.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.906+0000 7f02a4a00640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02a0106f00 0x7f02a019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.907+0000 7f02a4a00640 1 -- 172.21.15.110:0/2353127414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a019d4c0 con 0x7f02a0102780 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.907+0000 7f02a5e00640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02a0106f00 0x7f02a019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.907+0000 7f02a4a00640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0102780 0x7f02a0198a50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f028c004770 tx=0x7f028c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.907+0000 7f029e000640 1 -- 172.21.15.110:0/2353127414 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c03f070 con 0x7f02a0102780 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.907+0000 7f029e000640 1 -- 172.21.15.110:0/2353127414 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f028c031ca0 con 0x7f02a0102780 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.907+0000 7f029e000640 1 -- 172.21.15.110:0/2353127414 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c035030 con 0x7f02a0102780 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.908+0000 7f02a7e00640 1 -- 172.21.15.110:0/2353127414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a019d750 con 0x7f02a0102780 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.908+0000 7f02a7e00640 1 -- 172.21.15.110:0/2353127414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a019dbe0 con 0x7f02a0102780 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.909+0000 7f02a7e00640 1 -- 172.21.15.110:0/2353127414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a01021b0 con 0x7f02a0102780 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.911+0000 7f029e000640 1 -- 172.21.15.110:0/2353127414 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f028c042070 con 0x7f02a0102780 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.913+0000 7f029e000640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f02880a2c10 0x7f02880a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.913+0000 7f029e000640 1 -- 172.21.15.110:0/2353127414 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f028c0efc70 con 0x7f02a0102780 2024-09-12T02:14:01.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.913+0000 7f02a5400640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f02880a2c10 0x7f02880a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:01.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.914+0000 7f02a5400640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f02880a2c10 0x7f02880a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0294009670 tx=0x7f0294006bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:01.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:00.917+0000 7f029e000640 1 -- 172.21.15.110:0/2353127414 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f028c0bc6d0 con 0x7f02a0102780 2024-09-12T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:00 smithi115 ceph-mon[35351]: pgmap v364: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-12T02:14:01.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:00 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/4144970921' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T02:14:01.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.096+0000 7f02a7e00640 1 -- 172.21.15.110:0/2353127414 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f02a002d7c0 con 0x7f02a0102780 2024-09-12T02:14:01.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.097+0000 7f029e000640 1 -- 172.21.15.110:0/2353127414 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f028c0bbfd0 con 0x7f02a0102780 2024-09-12T02:14:01.097 INFO:teuthology.orchestra.run.smithi110.stdout:111669149775 2024-09-12T02:14:01.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.099+0000 7f02a7e00640 1 -- 172.21.15.110:0/2353127414 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f02880a2c10 msgr2=0x7f02880a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:01.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.099+0000 7f02a7e00640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f02880a2c10 0x7f02880a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0294009670 tx=0x7f0294006bd0 comp rx=0 tx=0).stop 2024-09-12T02:14:01.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.099+0000 7f02a7e00640 1 -- 172.21.15.110:0/2353127414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0102780 msgr2=0x7f02a0198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:01.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.099+0000 7f02a7e00640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0102780 0x7f02a0198a50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f028c004770 tx=0x7f028c003c10 comp rx=0 tx=0).stop 2024-09-12T02:14:01.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.099+0000 7f02a7e00640 1 -- 172.21.15.110:0/2353127414 shutdown_connections 2024-09-12T02:14:01.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.099+0000 7f02a7e00640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f02880a2c10 0x7f02880a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:01.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.099+0000 7f02a7e00640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f02a0106f00 0x7f02a019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:01.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.099+0000 7f02a7e00640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02a0102780 0x7f02a0198a50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:01.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.099+0000 7f02a7e00640 1 --2- 172.21.15.110:0/2353127414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02a0101dd0 0x7f02a0198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:01.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.099+0000 7f02a7e00640 1 -- 172.21.15.110:0/2353127414 >> 172.21.15.110:0/2353127414 conn(0x7f02a00fd8b0 msgr2=0x7f02a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:01.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.099+0000 7f02a7e00640 1 -- 172.21.15.110:0/2353127414 shutdown_connections 2024-09-12T02:14:01.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:01.099+0000 7f02a7e00640 1 -- 172.21.15.110:0/2353127414 wait complete. 2024-09-12T02:14:01.401 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738459 got 34359738463 for osd.0 2024-09-12T02:14:01.402 DEBUG:teuthology.parallel:result is None 2024-09-12T02:14:01.623 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:01 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2353127414' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:14:01.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:01 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2353127414' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:14:01.967 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:02.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:01 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2353127414' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T02:14:02.333 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757315 got 163208757318 for osd.5 2024-09-12T02:14:02.333 DEBUG:teuthology.parallel:result is None 2024-09-12T02:14:02.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:02 smithi136 ceph-mon[35814]: pgmap v365: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:02.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:02 smithi110 ceph-mon[30548]: pgmap v365: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:03.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:02 smithi115 ceph-mon[35351]: pgmap v365: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:03.157 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332151 got 219043332153 for osd.7 2024-09-12T02:14:03.157 DEBUG:teuthology.parallel:result is None 2024-09-12T02:14:03.677 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:03.713 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149771 got 111669149775 for osd.3 2024-09-12T02:14:03.713 DEBUG:teuthology.parallel:result is None 2024-09-12T02:14:03.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.380+0000 7f8defc00640 1 -- 172.21.15.110:0/3979720235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de810e3c0 msgr2=0x7f8de8110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:03.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.380+0000 7f8defc00640 1 --2- 172.21.15.110:0/3979720235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de810e3c0 0x7f8de8110810 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009ca0 tx=0x7f8de002a950 comp rx=0 tx=0).stop 2024-09-12T02:14:03.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.380+0000 7f8defc00640 1 -- 172.21.15.110:0/3979720235 shutdown_connections 2024-09-12T02:14:03.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.380+0000 7f8defc00640 1 --2- 172.21.15.110:0/3979720235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de810e3c0 0x7f8de8110810 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:03.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.380+0000 7f8defc00640 1 --2- 172.21.15.110:0/3979720235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8074f40 0x7f8de810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:03.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.380+0000 7f8defc00640 1 --2- 172.21.15.110:0/3979720235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de8074620 0x7f8de8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.380+0000 7f8defc00640 1 -- 172.21.15.110:0/3979720235 >> 172.21.15.110:0/3979720235 conn(0x7f8de80fd8c0 msgr2=0x7f8de80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.380+0000 7f8defc00640 1 -- 172.21.15.110:0/3979720235 shutdown_connections 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.380+0000 7f8defc00640 1 -- 172.21.15.110:0/3979720235 wait complete. 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.381+0000 7f8defc00640 1 Processor -- start 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.381+0000 7f8defc00640 1 -- start start 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.382+0000 7f8defc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8074620 0x7f8de819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.382+0000 7f8defc00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de8074f40 0x7f8de819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.382+0000 7f8defc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de810e3c0 0x7f8de819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.382+0000 7f8defc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8de8114160 con 0x7f8de810e3c0 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.382+0000 7f8defc00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8de8113fe0 con 0x7f8de8074620 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.382+0000 7f8defc00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8de81142e0 con 0x7f8de8074f40 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.382+0000 7f8ded200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8074620 0x7f8de819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.382+0000 7f8ded200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8074620 0x7f8de819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:39902/0 (socket says 172.21.15.110:39902) 2024-09-12T02:14:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.382+0000 7f8ded200640 1 -- 172.21.15.110:0/4084637835 learned_addr learned my addr 172.21.15.110:0/4084637835 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.382+0000 7f8ddfe00640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de8074f40 0x7f8de819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.382+0000 7f8dedc00640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de810e3c0 0x7f8de819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.383+0000 7f8ded200640 1 -- 172.21.15.110:0/4084637835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de8074f40 msgr2=0x7f8de819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.383+0000 7f8ded200640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de8074f40 0x7f8de819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.383+0000 7f8ded200640 1 -- 172.21.15.110:0/4084637835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de810e3c0 msgr2=0x7f8de819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.383+0000 7f8ded200640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de810e3c0 0x7f8de819ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.383+0000 7f8ded200640 1 -- 172.21.15.110:0/4084637835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de819f610 con 0x7f8de8074620 2024-09-12T02:14:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.383+0000 7f8ddfe00640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de8074f40 0x7f8de819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.383+0000 7f8ded200640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8074620 0x7f8de819a660 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800e9f0 tx=0x7f8dd800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.383+0000 7f8de6000640 1 -- 172.21.15.110:0/4084637835 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800cd80 con 0x7f8de8074620 2024-09-12T02:14:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.383+0000 7f8de6000640 1 -- 172.21.15.110:0/4084637835 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dd8005500 con 0x7f8de8074620 2024-09-12T02:14:03.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.383+0000 7f8defc00640 1 -- 172.21.15.110:0/4084637835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de819f900 con 0x7f8de8074620 2024-09-12T02:14:03.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.383+0000 7f8de6000640 1 -- 172.21.15.110:0/4084637835 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8010690 con 0x7f8de8074620 2024-09-12T02:14:03.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.384+0000 7f8defc00640 1 -- 172.21.15.110:0/4084637835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de81a71e0 con 0x7f8de8074620 2024-09-12T02:14:03.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.385+0000 7f8defc00640 1 -- 172.21.15.110:0/4084637835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de8074a00 con 0x7f8de8074620 2024-09-12T02:14:03.903 INFO:teuthology.orchestra.run.smithi110.stdout:141733920844 2024-09-12T02:14:03.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.386+0000 7f8de6000640 1 -- 172.21.15.110:0/4084637835 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f8dd80046c0 con 0x7f8de8074620 2024-09-12T02:14:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.388+0000 7f8de6000640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8dcc0a2c10 0x7f8dcc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.388+0000 7f8de6000640 1 -- 172.21.15.110:0/4084637835 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f8dd80cf990 con 0x7f8de8074620 2024-09-12T02:14:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.388+0000 7f8ddfe00640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8dcc0a2c10 0x7f8dcc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.388+0000 7f8ddfe00640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8dcc0a2c10 0x7f8dcc0a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8de810f750 tx=0x7f8dd000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.390+0000 7f8de6000640 1 -- 172.21.15.110:0/4084637835 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8dd809c390 con 0x7f8de8074620 2024-09-12T02:14:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.572+0000 7f8defc00640 1 -- 172.21.15.110:0/4084637835 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8de819b9c0 con 0x7f8de8074620 2024-09-12T02:14:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.573+0000 7f8de6000640 1 -- 172.21.15.110:0/4084637835 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8de819b9c0 con 0x7f8de8074620 2024-09-12T02:14:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.575+0000 7f8defc00640 1 -- 172.21.15.110:0/4084637835 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8dcc0a2c10 msgr2=0x7f8dcc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.575+0000 7f8defc00640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8dcc0a2c10 0x7f8dcc0a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8de810f750 tx=0x7f8dd000b410 comp rx=0 tx=0).stop 2024-09-12T02:14:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.575+0000 7f8defc00640 1 -- 172.21.15.110:0/4084637835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8074620 msgr2=0x7f8de819a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.575+0000 7f8defc00640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8074620 0x7f8de819a660 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800e9f0 tx=0x7f8dd800edf0 comp rx=0 tx=0).stop 2024-09-12T02:14:03.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.575+0000 7f8defc00640 1 -- 172.21.15.110:0/4084637835 shutdown_connections 2024-09-12T02:14:03.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.575+0000 7f8defc00640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8dcc0a2c10 0x7f8dcc0a50d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:03.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.575+0000 7f8defc00640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8de810e3c0 0x7f8de819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:03.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.575+0000 7f8defc00640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8de8074f40 0x7f8de819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:03.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.575+0000 7f8defc00640 1 --2- 172.21.15.110:0/4084637835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8de8074620 0x7f8de819a660 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:03.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.575+0000 7f8defc00640 1 -- 172.21.15.110:0/4084637835 >> 172.21.15.110:0/4084637835 conn(0x7f8de80fd8c0 msgr2=0x7f8de80fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:03.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.575+0000 7f8defc00640 1 -- 172.21.15.110:0/4084637835 shutdown_connections 2024-09-12T02:14:03.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:03.575+0000 7f8defc00640 1 -- 172.21.15.110:0/4084637835 wait complete. 2024-09-12T02:14:04.543 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841578 got 283467841581 for osd.9 2024-09-12T02:14:04.543 DEBUG:teuthology.parallel:result is None 2024-09-12T02:14:04.558 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411410 got 77309411413 for osd.2 2024-09-12T02:14:04.558 DEBUG:teuthology.parallel:result is None 2024-09-12T02:14:04.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:04 smithi136 ceph-mon[35814]: pgmap v366: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-12T02:14:04.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:04 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/4084637835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:14:04.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:04 smithi110 ceph-mon[30548]: pgmap v366: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-12T02:14:04.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:04 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/4084637835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:14:05.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:04 smithi115 ceph-mon[35351]: pgmap v366: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-12T02:14:05.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:04 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/4084637835' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T02:14:05.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.554+0000 7f45d2e00640 1 -- 172.21.15.110:0/1448827504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45cc109140 msgr2=0x7f45cc110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:05.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.554+0000 7f45d2e00640 1 --2- 172.21.15.110:0/1448827504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45cc109140 0x7f45cc110cc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009ca0 tx=0x7f45c402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:14:05.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.554+0000 7f45d2e00640 1 -- 172.21.15.110:0/1448827504 shutdown_connections 2024-09-12T02:14:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.554+0000 7f45d2e00640 1 --2- 172.21.15.110:0/1448827504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45cc109140 0x7f45cc110cc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.554+0000 7f45d2e00640 1 --2- 172.21.15.110:0/1448827504 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45cc1049c0 0x7f45cc108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.554+0000 7f45d2e00640 1 --2- 172.21.15.110:0/1448827504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45cc104010 0x7f45cc1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.554+0000 7f45d2e00640 1 -- 172.21.15.110:0/1448827504 >> 172.21.15.110:0/1448827504 conn(0x7f45cc0ffa50 msgr2=0x7f45cc101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.554+0000 7f45d2e00640 1 -- 172.21.15.110:0/1448827504 shutdown_connections 2024-09-12T02:14:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.554+0000 7f45d2e00640 1 -- 172.21.15.110:0/1448827504 wait complete. 2024-09-12T02:14:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.555+0000 7f45d2e00640 1 Processor -- start 2024-09-12T02:14:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.555+0000 7f45d2e00640 1 -- start start 2024-09-12T02:14:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.555+0000 7f45d2e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45cc104010 0x7f45cc19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.555+0000 7f45d2e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45cc1049c0 0x7f45cc19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:05.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.555+0000 7f45d2e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45cc109140 0x7f45cc19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:05.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.555+0000 7f45d2e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc114170 con 0x7f45cc104010 2024-09-12T02:14:05.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.555+0000 7f45d2e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc113ff0 con 0x7f45cc1049c0 2024-09-12T02:14:05.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.555+0000 7f45d2e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc1142f0 con 0x7f45cc109140 2024-09-12T02:14:05.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.556+0000 7f45cbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45cc104010 0x7f45cc19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:05.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.556+0000 7f45cbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45cc104010 0x7f45cc19a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58456/0 (socket says 172.21.15.110:58456) 2024-09-12T02:14:05.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.556+0000 7f45cbe00640 1 -- 172.21.15.110:0/3509589937 learned_addr learned my addr 172.21.15.110:0/3509589937 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:05.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.556+0000 7f45c3e00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45cc1049c0 0x7f45cc19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:05.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.556+0000 7f45d0e00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45cc109140 0x7f45cc19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:05.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.556+0000 7f45cbe00640 1 -- 172.21.15.110:0/3509589937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45cc109140 msgr2=0x7f45cc19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:05.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.556+0000 7f45cbe00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45cc109140 0x7f45cc19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.556+0000 7f45cbe00640 1 -- 172.21.15.110:0/3509589937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45cc1049c0 msgr2=0x7f45cc19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.556+0000 7f45cbe00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45cc1049c0 0x7f45cc19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.556+0000 7f45cbe00640 1 -- 172.21.15.110:0/3509589937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45cc19f680 con 0x7f45cc104010 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.556+0000 7f45d0e00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45cc109140 0x7f45cc19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.557+0000 7f45cbe00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45cc104010 0x7f45cc19a6d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00e9f0 tx=0x7f45bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.557+0000 7f45c9600640 1 -- 172.21.15.110:0/3509589937 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00cd80 con 0x7f45cc104010 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.557+0000 7f45d2e00640 1 -- 172.21.15.110:0/3509589937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45cc19f970 con 0x7f45cc104010 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.557+0000 7f45c9600640 1 -- 172.21.15.110:0/3509589937 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45bc005500 con 0x7f45cc104010 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.557+0000 7f45c9600640 1 -- 172.21.15.110:0/3509589937 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc018630 con 0x7f45cc104010 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.557+0000 7f45d2e00640 1 -- 172.21.15.110:0/3509589937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45cc1a7250 con 0x7f45cc104010 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.558+0000 7f45d2e00640 1 -- 172.21.15.110:0/3509589937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45cc1043f0 con 0x7f45cc104010 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.560+0000 7f45c9600640 1 -- 172.21.15.110:0/3509589937 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f45bc0046c0 con 0x7f45cc104010 2024-09-12T02:14:05.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.561+0000 7f45c9600640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f45b00a2c10 0x7f45b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:05.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.561+0000 7f45c9600640 1 -- 172.21.15.110:0/3509589937 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f45bc0cfb60 con 0x7f45cc104010 2024-09-12T02:14:05.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.562+0000 7f45c3e00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f45b00a2c10 0x7f45b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:05.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.562+0000 7f45c3e00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f45b00a2c10 0x7f45b00a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0ffe70 tx=0x7f45b400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:05.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.565+0000 7f45c9600640 1 -- 172.21.15.110:0/3509589937 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45bc09c560 con 0x7f45cc104010 2024-09-12T02:14:05.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.749+0000 7f45d2e00640 1 -- 172.21.15.110:0/3509589937 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f45cc19ba30 con 0x7f45cc104010 2024-09-12T02:14:05.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.749+0000 7f45c9600640 1 -- 172.21.15.110:0/3509589937 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f45bc09be60 con 0x7f45cc104010 2024-09-12T02:14:05.750 INFO:teuthology.orchestra.run.smithi110.stdout:304942678059 2024-09-12T02:14:05.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.751+0000 7f45d2e00640 1 -- 172.21.15.110:0/3509589937 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f45b00a2c10 msgr2=0x7f45b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:05.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.752+0000 7f45d2e00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f45b00a2c10 0x7f45b00a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0ffe70 tx=0x7f45b400b410 comp rx=0 tx=0).stop 2024-09-12T02:14:05.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.752+0000 7f45d2e00640 1 -- 172.21.15.110:0/3509589937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45cc104010 msgr2=0x7f45cc19a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:05.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.752+0000 7f45d2e00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45cc104010 0x7f45cc19a6d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00e9f0 tx=0x7f45bc00edf0 comp rx=0 tx=0).stop 2024-09-12T02:14:05.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.752+0000 7f45d2e00640 1 -- 172.21.15.110:0/3509589937 shutdown_connections 2024-09-12T02:14:05.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.752+0000 7f45d2e00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f45b00a2c10 0x7f45b00a50d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:05.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.752+0000 7f45d2e00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45cc109140 0x7f45cc19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:05.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.752+0000 7f45d2e00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45cc1049c0 0x7f45cc19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:05.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.752+0000 7f45d2e00640 1 --2- 172.21.15.110:0/3509589937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45cc104010 0x7f45cc19a6d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:05.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.752+0000 7f45d2e00640 1 -- 172.21.15.110:0/3509589937 >> 172.21.15.110:0/3509589937 conn(0x7f45cc0ffa50 msgr2=0x7f45cc100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:05.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.752+0000 7f45d2e00640 1 -- 172.21.15.110:0/3509589937 shutdown_connections 2024-09-12T02:14:05.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.752+0000 7f45d2e00640 1 -- 172.21.15.110:0/3509589937 wait complete. 2024-09-12T02:14:06.244 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920840 got 141733920844 for osd.4 2024-09-12T02:14:06.245 DEBUG:teuthology.parallel:result is None 2024-09-12T02:14:06.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.908+0000 7fdedbe00640 1 -- 172.21.15.110:0/3405692750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdedc1047e0 msgr2=0x7fdedc108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:06.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.908+0000 7fdedbe00640 1 --2- 172.21.15.110:0/3405692750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdedc1047e0 0x7fdedc108830 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009900 tx=0x7fdec402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:14:06.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.908+0000 7fdedbe00640 1 -- 172.21.15.110:0/3405692750 shutdown_connections 2024-09-12T02:14:06.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.908+0000 7fdedbe00640 1 --2- 172.21.15.110:0/3405692750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc108f60 0x7fdedc110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.908+0000 7fdedbe00640 1 --2- 172.21.15.110:0/3405692750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdedc1047e0 0x7fdedc108830 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.908+0000 7fdedbe00640 1 --2- 172.21.15.110:0/3405692750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdedc103e30 0x7fdedc104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.908+0000 7fdedbe00640 1 -- 172.21.15.110:0/3405692750 >> 172.21.15.110:0/3405692750 conn(0x7fdedc0ff8d0 msgr2=0x7fdedc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.908+0000 7fdedbe00640 1 -- 172.21.15.110:0/3405692750 shutdown_connections 2024-09-12T02:14:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.908+0000 7fdedbe00640 1 -- 172.21.15.110:0/3405692750 wait complete. 2024-09-12T02:14:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.909+0000 7fdedbe00640 1 Processor -- start 2024-09-12T02:14:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.909+0000 7fdedbe00640 1 -- start start 2024-09-12T02:14:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.910+0000 7fdedbe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc103e30 0x7fdedc19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.910+0000 7fdedbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdedc1047e0 0x7fdedc19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.910+0000 7fdedbe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdedc108f60 0x7fdedc19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.910+0000 7fdedbe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc113f80 con 0x7fdedc1047e0 2024-09-12T02:14:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.910+0000 7fdedbe00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc113e00 con 0x7fdedc103e30 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.910+0000 7fdedbe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc114100 con 0x7fdedc108f60 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.910+0000 7fded2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdedc1047e0 0x7fdedc19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.910+0000 7fded2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdedc1047e0 0x7fdedc19a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:58462/0 (socket says 172.21.15.110:58462) 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.910+0000 7fded2000640 1 -- 172.21.15.110:0/1226972507 learned_addr learned my addr 172.21.15.110:0/1226972507 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.910+0000 7fdedaa00640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc103e30 0x7fdedc19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.910+0000 7fdedb400640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdedc108f60 0x7fdedc19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.911+0000 7fded2000640 1 -- 172.21.15.110:0/1226972507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdedc108f60 msgr2=0x7fdedc19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.911+0000 7fded2000640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdedc108f60 0x7fdedc19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.911+0000 7fded2000640 1 -- 172.21.15.110:0/1226972507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc103e30 msgr2=0x7fdedc19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.911+0000 7fded2000640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc103e30 0x7fdedc19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.911+0000 7fded2000640 1 -- 172.21.15.110:0/1226972507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc19f400 con 0x7fdedc1047e0 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.911+0000 7fdedaa00640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc103e30 0x7fdedc19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.911+0000 7fded2000640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdedc1047e0 0x7fdedc19a990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdec4006010 tx=0x7fdec4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.911+0000 7fdee0a00640 1 -- 172.21.15.110:0/1226972507 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec403f030 con 0x7fdedc1047e0 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.911+0000 7fdee0a00640 1 -- 172.21.15.110:0/1226972507 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdec4004440 con 0x7fdedc1047e0 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.911+0000 7fdee0a00640 1 -- 172.21.15.110:0/1226972507 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4035070 con 0x7fdedc1047e0 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.911+0000 7fdedbe00640 1 -- 172.21.15.110:0/1226972507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdedc19f690 con 0x7fdedc1047e0 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.912+0000 7fdedbe00640 1 -- 172.21.15.110:0/1226972507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdedc1a6fd0 con 0x7fdedc1047e0 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.913+0000 7fdedbe00640 1 -- 172.21.15.110:0/1226972507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdedc104210 con 0x7fdedc1047e0 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.915+0000 7fdee0a00640 1 -- 172.21.15.110:0/1226972507 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fdec4042030 con 0x7fdedc1047e0 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.916+0000 7fdee0a00640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdec00a2c10 0x7fdec00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.916+0000 7fdee0a00640 1 -- 172.21.15.110:0/1226972507 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fdec40efc30 con 0x7fdedc1047e0 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.917+0000 7fdedaa00640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdec00a2c10 0x7fdec00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.917+0000 7fdedaa00640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdec00a2c10 0x7fdec00a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009fc0 tx=0x7fdecc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:05.918+0000 7fdee0a00640 1 -- 172.21.15.110:0/1226972507 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdec40bc0a0 con 0x7fdedc1047e0 2024-09-12T02:14:06.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.097+0000 7fdedbe00640 1 -- 172.21.15.110:0/1226972507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fdedc10c170 con 0x7fdedc1047e0 2024-09-12T02:14:06.437 INFO:teuthology.orchestra.run.smithi110.stdout:197568495680 2024-09-12T02:14:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.098+0000 7fdee0a00640 1 -- 172.21.15.110:0/1226972507 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdec40c03a0 con 0x7fdedc1047e0 2024-09-12T02:14:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.100+0000 7fdedbe00640 1 -- 172.21.15.110:0/1226972507 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdec00a2c10 msgr2=0x7fdec00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.100+0000 7fdedbe00640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdec00a2c10 0x7fdec00a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009fc0 tx=0x7fdecc005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.100+0000 7fdedbe00640 1 -- 172.21.15.110:0/1226972507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdedc1047e0 msgr2=0x7fdedc19a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.100+0000 7fdedbe00640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdedc1047e0 0x7fdedc19a990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdec4006010 tx=0x7fdec4004040 comp rx=0 tx=0).stop 2024-09-12T02:14:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.100+0000 7fdedbe00640 1 -- 172.21.15.110:0/1226972507 shutdown_connections 2024-09-12T02:14:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.100+0000 7fdedbe00640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdec00a2c10 0x7fdec00a50d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.100+0000 7fdedbe00640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdedc108f60 0x7fdedc19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.100+0000 7fdedbe00640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdedc1047e0 0x7fdedc19a990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.100+0000 7fdedbe00640 1 --2- 172.21.15.110:0/1226972507 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdedc103e30 0x7fdedc19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.100+0000 7fdedbe00640 1 -- 172.21.15.110:0/1226972507 >> 172.21.15.110:0/1226972507 conn(0x7fdedc0ff8d0 msgr2=0x7fdedc100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.100+0000 7fdedbe00640 1 -- 172.21.15.110:0/1226972507 shutdown_connections 2024-09-12T02:14:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:06.100+0000 7fdedbe00640 1 -- 172.21.15.110:0/1226972507 wait complete. 2024-09-12T02:14:06.821 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:06 smithi110 ceph-mon[30548]: pgmap v367: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:06.822 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:06 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3509589937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:14:06.822 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:06 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1226972507' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:14:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:06 smithi136 ceph-mon[35814]: pgmap v367: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:06 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3509589937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:14:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:06 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1226972507' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:06 smithi115 ceph-mon[35351]: pgmap v367: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:06 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3509589937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-12T02:14:07.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:06 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1226972507' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-12T02:14:07.235 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495677 got 197568495680 for osd.6 2024-09-12T02:14:07.235 DEBUG:teuthology.parallel:result is None 2024-09-12T02:14:07.872 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678055 got 304942678059 for osd.10 2024-09-12T02:14:07.873 DEBUG:teuthology.parallel:result is None 2024-09-12T02:14:07.873 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T02:14:07.873 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:14:08.241 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:08.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:08 smithi110 ceph-mon[30548]: pgmap v368: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:08.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.856+0000 7f3dcb400640 1 -- 172.21.15.110:0/101767095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3dc4106f20 msgr2=0x7f3dc410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.856+0000 7f3dcb400640 1 --2- 172.21.15.110:0/101767095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3dc4106f20 0x7f3dc410eaa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc009ca0 tx=0x7f3dbc02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:14:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.856+0000 7f3dcb400640 1 -- 172.21.15.110:0/101767095 shutdown_connections 2024-09-12T02:14:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.856+0000 7f3dcb400640 1 --2- 172.21.15.110:0/101767095 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3dc4106f20 0x7f3dc410eaa0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.856+0000 7f3dcb400640 1 --2- 172.21.15.110:0/101767095 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc41027a0 0x7f3dc41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.856+0000 7f3dcb400640 1 --2- 172.21.15.110:0/101767095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dc4101df0 0x7f3dc41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.856+0000 7f3dcb400640 1 -- 172.21.15.110:0/101767095 >> 172.21.15.110:0/101767095 conn(0x7f3dc40fd8b0 msgr2=0x7f3dc40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.856+0000 7f3dcb400640 1 -- 172.21.15.110:0/101767095 shutdown_connections 2024-09-12T02:14:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.856+0000 7f3dcb400640 1 -- 172.21.15.110:0/101767095 wait complete. 2024-09-12T02:14:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.857+0000 7f3dcb400640 1 Processor -- start 2024-09-12T02:14:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.857+0000 7f3dcb400640 1 -- start start 2024-09-12T02:14:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.857+0000 7f3dcb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3dc4101df0 0x7f3dc419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.857+0000 7f3dcb400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc41027a0 0x7f3dc419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.857+0000 7f3dcb400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dc4106f20 0x7f3dc419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.857+0000 7f3dcb400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc4111f80 con 0x7f3dc4101df0 2024-09-12T02:14:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.857+0000 7f3dcb400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc4111e00 con 0x7f3dc41027a0 2024-09-12T02:14:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.857+0000 7f3dcb400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc4112100 con 0x7f3dc4106f20 2024-09-12T02:14:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc8a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3dc4101df0 0x7f3dc419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc3e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc41027a0 0x7f3dc419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc3e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc41027a0 0x7f3dc419ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:34200/0 (socket says 172.21.15.110:34200) 2024-09-12T02:14:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc8a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3dc4101df0 0x7f3dc419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57740/0 (socket says 172.21.15.110:57740) 2024-09-12T02:14:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc3e00640 1 -- 172.21.15.110:0/2255446963 learned_addr learned my addr 172.21.15.110:0/2255446963 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc9400640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dc4106f20 0x7f3dc419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc3e00640 1 -- 172.21.15.110:0/2255446963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dc4106f20 msgr2=0x7f3dc419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc3e00640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dc4106f20 0x7f3dc419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc3e00640 1 -- 172.21.15.110:0/2255446963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3dc4101df0 msgr2=0x7f3dc419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc3e00640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3dc4101df0 0x7f3dc419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc3e00640 1 -- 172.21.15.110:0/2255446963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc419f570 con 0x7f3dc41027a0 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc3e00640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc41027a0 0x7f3dc419ab00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3db000ea60 tx=0x7f3db000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.858+0000 7f3dc1600640 1 -- 172.21.15.110:0/2255446963 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db000cde0 con 0x7f3dc41027a0 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.859+0000 7f3dc1600640 1 -- 172.21.15.110:0/2255446963 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3db00035f0 con 0x7f3dc41027a0 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.859+0000 7f3dcb400640 1 -- 172.21.15.110:0/2255446963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dc419f860 con 0x7f3dc41027a0 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.859+0000 7f3dc1600640 1 -- 172.21.15.110:0/2255446963 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0010670 con 0x7f3dc41027a0 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.859+0000 7f3dcb400640 1 -- 172.21.15.110:0/2255446963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dc41a7140 con 0x7f3dc41027a0 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.860+0000 7f3dcb400640 1 -- 172.21.15.110:0/2255446963 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc41021d0 con 0x7f3dc41027a0 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.862+0000 7f3dc1600640 1 -- 172.21.15.110:0/2255446963 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3db00037a0 con 0x7f3dc41027a0 2024-09-12T02:14:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.863+0000 7f3dc1600640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f3dac0a2c10 0x7f3dac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:08.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.864+0000 7f3dc1600640 1 -- 172.21.15.110:0/2255446963 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f3db00cf820 con 0x7f3dc41027a0 2024-09-12T02:14:08.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.864+0000 7f3dc8a00640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f3dac0a2c10 0x7f3dac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:08.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.864+0000 7f3dc8a00640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f3dac0a2c10 0x7f3dac0a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3db80095f0 tx=0x7f3db8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:08.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:08.865+0000 7f3dc1600640 1 -- 172.21.15.110:0/2255446963 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3db009c220 con 0x7f3dc41027a0 2024-09-12T02:14:08.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:08 smithi136 ceph-mon[35814]: pgmap v368: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:09.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.044+0000 7f3dcb400640 1 -- 172.21.15.110:0/2255446963 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3dc410de70 con 0x7f3dac0a2c10 2024-09-12T02:14:09.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:08 smithi115 ceph-mon[35351]: pgmap v368: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:09.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.052+0000 7f3dc1600640 1 -- 172.21.15.110:0/2255446963 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340368 (secure 0 0 0) 0x7f3dc410de70 con 0x7f3dac0a2c10 2024-09-12T02:14:09.058 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:09.060 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-09-12T02:14:09.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.058+0000 7f3dcb400640 1 -- 172.21.15.110:0/2255446963 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f3dac0a2c10 msgr2=0x7f3dac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:09.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.058+0000 7f3dcb400640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f3dac0a2c10 0x7f3dac0a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3db80095f0 tx=0x7f3db8005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:09.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.058+0000 7f3dcb400640 1 -- 172.21.15.110:0/2255446963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc41027a0 msgr2=0x7f3dc419ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:09.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.058+0000 7f3dcb400640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc41027a0 0x7f3dc419ab00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3db000ea60 tx=0x7f3db000ef20 comp rx=0 tx=0).stop 2024-09-12T02:14:09.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.058+0000 7f3dcb400640 1 -- 172.21.15.110:0/2255446963 shutdown_connections 2024-09-12T02:14:09.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.058+0000 7f3dcb400640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f3dac0a2c10 0x7f3dac0a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:09.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.058+0000 7f3dcb400640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3dc4106f20 0x7f3dc419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:09.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.058+0000 7f3dcb400640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3dc41027a0 0x7f3dc419ab00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:09.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.058+0000 7f3dcb400640 1 --2- 172.21.15.110:0/2255446963 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3dc4101df0 0x7f3dc419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:09.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.058+0000 7f3dcb400640 1 -- 172.21.15.110:0/2255446963 >> 172.21.15.110:0/2255446963 conn(0x7f3dc40fd8b0 msgr2=0x7f3dc40fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:09.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.059+0000 7f3dcb400640 1 -- 172.21.15.110:0/2255446963 shutdown_connections 2024-09-12T02:14:09.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:09.059+0000 7f3dcb400640 1 -- 172.21.15.110:0/2255446963 wait complete. 2024-09-12T02:14:09.898 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-09-12T02:14:07.477161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658745,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":529,"num_read_kb":384,"num_write":351,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":282,"ondisk_log_size":282,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":393592,"kb_used_data":15152,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124548232,"statfs":{"total":1151940427776,"available":1151537389568,"internally_reserved":0,"allocated":15515648,"data_stored":8638097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003134"},"pg_stats":[{"pgid":"2.1f","version":"95'9","reported_seq":54,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690330+0000","last_change":"2024-09-12T02:12:09.666492+0000","last_active":"2024-09-12T02:13:46.690330+0000","last_peered":"2024-09-12T02:13:46.690330+0000","last_clean":"2024-09-12T02:13:46.690330+0000","last_became_active":"2024-09-12T02:12:09.666198+0000","last_became_peered":"2024-09-12T02:12:09.666198+0000","last_unstale":"2024-09-12T02:13:46.690330+0000","last_undegraded":"2024-09-12T02:13:46.690330+0000","last_fullsized":"2024-09-12T02:13:46.690330+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:01.779452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851931+0000","last_change":"2024-09-12T02:12:12.695888+0000","last_active":"2024-09-12T02:13:46.851931+0000","last_peered":"2024-09-12T02:13:46.851931+0000","last_clean":"2024-09-12T02:13:46.851931+0000","last_became_active":"2024-09-12T02:12:12.695065+0000","last_became_peered":"2024-09-12T02:12:12.695065+0000","last_unstale":"2024-09-12T02:13:46.851931+0000","last_undegraded":"2024-09-12T02:13:46.851931+0000","last_fullsized":"2024-09-12T02:13:46.851931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:09.799039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690478+0000","last_change":"2024-09-12T02:12:22.738585+0000","last_active":"2024-09-12T02:13:46.690478+0000","last_peered":"2024-09-12T02:13:46.690478+0000","last_clean":"2024-09-12T02:13:46.690478+0000","last_became_active":"2024-09-12T02:12:22.738174+0000","last_became_peered":"2024-09-12T02:12:22.738174+0000","last_unstale":"2024-09-12T02:13:46.690478+0000","last_undegraded":"2024-09-12T02:13:46.690478+0000","last_fullsized":"2024-09-12T02:13:46.690478+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:00.875256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"95'2","reported_seq":45,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852143+0000","last_change":"2024-09-12T02:12:09.735005+0000","last_active":"2024-09-12T02:13:46.852143+0000","last_peered":"2024-09-12T02:13:46.852143+0000","last_clean":"2024-09-12T02:13:46.852143+0000","last_became_active":"2024-09-12T02:12:09.734590+0000","last_became_peered":"2024-09-12T02:12:09.734590+0000","last_unstale":"2024-09-12T02:13:46.852143+0000","last_undegraded":"2024-09-12T02:13:46.852143+0000","last_fullsized":"2024-09-12T02:13:46.852143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:17.079183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852572+0000","last_change":"2024-09-12T02:12:12.692688+0000","last_active":"2024-09-12T02:13:46.852572+0000","last_peered":"2024-09-12T02:13:46.852572+0000","last_clean":"2024-09-12T02:13:46.852572+0000","last_became_active":"2024-09-12T02:12:12.692252+0000","last_became_peered":"2024-09-12T02:12:12.692252+0000","last_unstale":"2024-09-12T02:13:46.852572+0000","last_undegraded":"2024-09-12T02:13:46.852572+0000","last_fullsized":"2024-09-12T02:13:46.852572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:40.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690131+0000","last_change":"2024-09-12T02:12:22.738074+0000","last_active":"2024-09-12T02:13:46.690131+0000","last_peered":"2024-09-12T02:13:46.690131+0000","last_clean":"2024-09-12T02:13:46.690131+0000","last_became_active":"2024-09-12T02:12:22.737692+0000","last_became_peered":"2024-09-12T02:12:22.737692+0000","last_unstale":"2024-09-12T02:13:46.690131+0000","last_undegraded":"2024-09-12T02:13:46.690131+0000","last_fullsized":"2024-09-12T02:13:46.690131+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:04.003426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"95'4","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852823+0000","last_change":"2024-09-12T02:12:09.670228+0000","last_active":"2024-09-12T02:13:46.852823+0000","last_peered":"2024-09-12T02:13:46.852823+0000","last_clean":"2024-09-12T02:13:46.852823+0000","last_became_active":"2024-09-12T02:12:09.669517+0000","last_became_peered":"2024-09-12T02:12:09.669517+0000","last_unstale":"2024-09-12T02:13:46.852823+0000","last_undegraded":"2024-09-12T02:13:46.852823+0000","last_fullsized":"2024-09-12T02:13:46.852823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:49.547787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693430+0000","last_change":"2024-09-12T02:12:12.693797+0000","last_active":"2024-09-12T02:13:46.693430+0000","last_peered":"2024-09-12T02:13:46.693430+0000","last_clean":"2024-09-12T02:13:46.693430+0000","last_became_active":"2024-09-12T02:12:12.692757+0000","last_became_peered":"2024-09-12T02:12:12.692757+0000","last_unstale":"2024-09-12T02:13:46.693430+0000","last_undegraded":"2024-09-12T02:13:46.693430+0000","last_fullsized":"2024-09-12T02:13:46.693430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:04.738832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690440+0000","last_change":"2024-09-12T02:12:22.742804+0000","last_active":"2024-09-12T02:13:46.690440+0000","last_peered":"2024-09-12T02:13:46.690440+0000","last_clean":"2024-09-12T02:13:46.690440+0000","last_became_active":"2024-09-12T02:12:22.742478+0000","last_became_peered":"2024-09-12T02:12:22.742478+0000","last_unstale":"2024-09-12T02:13:46.690440+0000","last_undegraded":"2024-09-12T02:13:46.690440+0000","last_fullsized":"2024-09-12T02:13:46.690440+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:25.406069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'2","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852426+0000","last_change":"2024-09-12T02:12:09.669360+0000","last_active":"2024-09-12T02:13:46.852426+0000","last_peered":"2024-09-12T02:13:46.852426+0000","last_clean":"2024-09-12T02:13:46.852426+0000","last_became_active":"2024-09-12T02:12:09.668908+0000","last_became_peered":"2024-09-12T02:12:09.668908+0000","last_unstale":"2024-09-12T02:13:46.852426+0000","last_undegraded":"2024-09-12T02:13:46.852426+0000","last_fullsized":"2024-09-12T02:13:46.852426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:48.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853791+0000","last_change":"2024-09-12T02:12:46.542028+0000","last_active":"2024-09-12T02:13:46.853791+0000","last_peered":"2024-09-12T02:13:46.853791+0000","last_clean":"2024-09-12T02:13:46.853791+0000","last_became_active":"2024-09-12T02:12:46.541630+0000","last_became_peered":"2024-09-12T02:12:46.541630+0000","last_unstale":"2024-09-12T02:13:46.853791+0000","last_undegraded":"2024-09-12T02:13:46.853791+0000","last_fullsized":"2024-09-12T02:13:46.853791+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:08.641424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690257+0000","last_change":"2024-09-12T02:12:22.738663+0000","last_active":"2024-09-12T02:13:46.690257+0000","last_peered":"2024-09-12T02:13:46.690257+0000","last_clean":"2024-09-12T02:13:46.690257+0000","last_became_active":"2024-09-12T02:12:22.738280+0000","last_became_peered":"2024-09-12T02:12:22.738280+0000","last_unstale":"2024-09-12T02:13:46.690257+0000","last_undegraded":"2024-09-12T02:13:46.690257+0000","last_fullsized":"2024-09-12T02:13:46.690257+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:44.271539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851669+0000","last_change":"2024-09-12T02:12:12.687131+0000","last_active":"2024-09-12T02:13:46.851669+0000","last_peered":"2024-09-12T02:13:46.851669+0000","last_clean":"2024-09-12T02:13:46.851669+0000","last_became_active":"2024-09-12T02:12:12.686793+0000","last_became_peered":"2024-09-12T02:12:12.686793+0000","last_unstale":"2024-09-12T02:13:46.851669+0000","last_undegraded":"2024-09-12T02:13:46.851669+0000","last_fullsized":"2024-09-12T02:13:46.851669+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:58.370130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"95'4","reported_seq":23,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852119+0000","last_change":"2024-09-12T02:12:46.550259+0000","last_active":"2024-09-12T02:13:46.852119+0000","last_peered":"2024-09-12T02:13:46.852119+0000","last_clean":"2024-09-12T02:13:46.852119+0000","last_became_active":"2024-09-12T02:12:46.543047+0000","last_became_peered":"2024-09-12T02:12:46.543047+0000","last_unstale":"2024-09-12T02:13:46.852119+0000","last_undegraded":"2024-09-12T02:13:46.852119+0000","last_fullsized":"2024-09-12T02:13:46.852119+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.359689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690623+0000","last_change":"2024-09-12T02:12:23.023792+0000","last_active":"2024-09-12T02:13:46.690623+0000","last_peered":"2024-09-12T02:13:46.690623+0000","last_clean":"2024-09-12T02:13:46.690623+0000","last_became_active":"2024-09-12T02:12:23.023337+0000","last_became_peered":"2024-09-12T02:12:23.023337+0000","last_unstale":"2024-09-12T02:13:46.690623+0000","last_undegraded":"2024-09-12T02:13:46.690623+0000","last_fullsized":"2024-09-12T02:13:46.690623+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:01.859092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851789+0000","last_change":"2024-09-12T02:12:12.683615+0000","last_active":"2024-09-12T02:13:46.851789+0000","last_peered":"2024-09-12T02:13:46.851789+0000","last_clean":"2024-09-12T02:13:46.851789+0000","last_became_active":"2024-09-12T02:12:12.683279+0000","last_became_peered":"2024-09-12T02:12:12.683279+0000","last_unstale":"2024-09-12T02:13:46.851789+0000","last_undegraded":"2024-09-12T02:13:46.851789+0000","last_fullsized":"2024-09-12T02:13:46.851789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:10.819995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"95'1","reported_seq":45,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690664+0000","last_change":"2024-09-12T02:12:09.667600+0000","last_active":"2024-09-12T02:13:46.690664+0000","last_peered":"2024-09-12T02:13:46.690664+0000","last_clean":"2024-09-12T02:13:46.690664+0000","last_became_active":"2024-09-12T02:12:09.666053+0000","last_became_peered":"2024-09-12T02:12:09.666053+0000","last_unstale":"2024-09-12T02:13:46.690664+0000","last_undegraded":"2024-09-12T02:13:46.690664+0000","last_fullsized":"2024-09-12T02:13:46.690664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:01.597906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"95'1","reported_seq":29,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690729+0000","last_change":"2024-09-12T02:12:22.748946+0000","last_active":"2024-09-12T02:13:46.690729+0000","last_peered":"2024-09-12T02:13:46.690729+0000","last_clean":"2024-09-12T02:13:46.690729+0000","last_became_active":"2024-09-12T02:12:22.748163+0000","last_became_peered":"2024-09-12T02:12:22.748163+0000","last_unstale":"2024-09-12T02:13:46.690729+0000","last_undegraded":"2024-09-12T02:13:46.690729+0000","last_fullsized":"2024-09-12T02:13:46.690729+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:49.560905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851904+0000","last_change":"2024-09-12T02:12:12.692275+0000","last_active":"2024-09-12T02:13:46.851904+0000","last_peered":"2024-09-12T02:13:46.851904+0000","last_clean":"2024-09-12T02:13:46.851904+0000","last_became_active":"2024-09-12T02:12:12.691932+0000","last_became_peered":"2024-09-12T02:12:12.691932+0000","last_unstale":"2024-09-12T02:13:46.851904+0000","last_undegraded":"2024-09-12T02:13:46.851904+0000","last_fullsized":"2024-09-12T02:13:46.851904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:01.922677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"95'3","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852215+0000","last_change":"2024-09-12T02:12:09.665190+0000","last_active":"2024-09-12T02:13:46.852215+0000","last_peered":"2024-09-12T02:13:46.852215+0000","last_clean":"2024-09-12T02:13:46.852215+0000","last_became_active":"2024-09-12T02:12:09.664805+0000","last_became_peered":"2024-09-12T02:12:09.664805+0000","last_unstale":"2024-09-12T02:13:46.852215+0000","last_undegraded":"2024-09-12T02:13:46.852215+0000","last_fullsized":"2024-09-12T02:13:46.852215+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:41.770072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690043+0000","last_change":"2024-09-12T02:12:22.744555+0000","last_active":"2024-09-12T02:13:46.690043+0000","last_peered":"2024-09-12T02:13:46.690043+0000","last_clean":"2024-09-12T02:13:46.690043+0000","last_became_active":"2024-09-12T02:12:22.742530+0000","last_became_peered":"2024-09-12T02:12:22.742530+0000","last_unstale":"2024-09-12T02:13:46.690043+0000","last_undegraded":"2024-09-12T02:13:46.690043+0000","last_fullsized":"2024-09-12T02:13:46.690043+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:45.737376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852140+0000","last_change":"2024-09-12T02:12:12.681891+0000","last_active":"2024-09-12T02:13:46.852140+0000","last_peered":"2024-09-12T02:13:46.852140+0000","last_clean":"2024-09-12T02:13:46.852140+0000","last_became_active":"2024-09-12T02:12:12.681522+0000","last_became_peered":"2024-09-12T02:12:12.681522+0000","last_unstale":"2024-09-12T02:13:46.852140+0000","last_undegraded":"2024-09-12T02:13:46.852140+0000","last_fullsized":"2024-09-12T02:13:46.852140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.363251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"95'2","reported_seq":45,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693272+0000","last_change":"2024-09-12T02:12:09.735407+0000","last_active":"2024-09-12T02:13:46.693272+0000","last_peered":"2024-09-12T02:13:46.693272+0000","last_clean":"2024-09-12T02:13:46.693272+0000","last_became_active":"2024-09-12T02:12:09.735010+0000","last_became_peered":"2024-09-12T02:12:09.735010+0000","last_unstale":"2024-09-12T02:13:46.693272+0000","last_undegraded":"2024-09-12T02:13:46.693272+0000","last_fullsized":"2024-09-12T02:13:46.693272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:19.457664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690692+0000","last_change":"2024-09-12T02:12:46.948014+0000","last_active":"2024-09-12T02:13:46.690692+0000","last_peered":"2024-09-12T02:13:46.690692+0000","last_clean":"2024-09-12T02:13:46.690692+0000","last_became_active":"2024-09-12T02:12:46.947557+0000","last_became_peered":"2024-09-12T02:12:46.947557+0000","last_unstale":"2024-09-12T02:13:46.690692+0000","last_undegraded":"2024-09-12T02:13:46.690692+0000","last_fullsized":"2024-09-12T02:13:46.690692+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:25.012171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853136+0000","last_change":"2024-09-12T02:12:12.691186+0000","last_active":"2024-09-12T02:13:46.853136+0000","last_peered":"2024-09-12T02:13:46.853136+0000","last_clean":"2024-09-12T02:13:46.853136+0000","last_became_active":"2024-09-12T02:12:12.690861+0000","last_became_peered":"2024-09-12T02:12:12.690861+0000","last_unstale":"2024-09-12T02:13:46.853136+0000","last_undegraded":"2024-09-12T02:13:46.853136+0000","last_fullsized":"2024-09-12T02:13:46.853136+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:07.126197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"95'4","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.691040+0000","last_change":"2024-09-12T02:12:09.665891+0000","last_active":"2024-09-12T02:13:46.691040+0000","last_peered":"2024-09-12T02:13:46.691040+0000","last_clean":"2024-09-12T02:13:46.691040+0000","last_became_active":"2024-09-12T02:12:09.665474+0000","last_became_peered":"2024-09-12T02:12:09.665474+0000","last_unstale":"2024-09-12T02:13:46.691040+0000","last_undegraded":"2024-09-12T02:13:46.691040+0000","last_fullsized":"2024-09-12T02:13:46.691040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:48.118918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690733+0000","last_change":"2024-09-12T02:12:22.732360+0000","last_active":"2024-09-12T02:13:46.690733+0000","last_peered":"2024-09-12T02:13:46.690733+0000","last_clean":"2024-09-12T02:13:46.690733+0000","last_became_active":"2024-09-12T02:12:22.731908+0000","last_became_peered":"2024-09-12T02:12:22.731908+0000","last_unstale":"2024-09-12T02:13:46.690733+0000","last_undegraded":"2024-09-12T02:13:46.690733+0000","last_fullsized":"2024-09-12T02:13:46.690733+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:25.918921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852641+0000","last_change":"2024-09-12T02:12:12.683478+0000","last_active":"2024-09-12T02:13:46.852641+0000","last_peered":"2024-09-12T02:13:46.852641+0000","last_clean":"2024-09-12T02:13:46.852641+0000","last_became_active":"2024-09-12T02:12:12.683112+0000","last_became_peered":"2024-09-12T02:12:12.683112+0000","last_unstale":"2024-09-12T02:13:46.852641+0000","last_undegraded":"2024-09-12T02:13:46.852641+0000","last_fullsized":"2024-09-12T02:13:46.852641+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:54.092216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'11","reported_seq":55,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.689973+0000","last_change":"2024-09-12T02:12:09.665209+0000","last_active":"2024-09-12T02:13:46.689973+0000","last_peered":"2024-09-12T02:13:46.689973+0000","last_clean":"2024-09-12T02:13:46.689973+0000","last_became_active":"2024-09-12T02:12:09.664849+0000","last_became_peered":"2024-09-12T02:12:09.664849+0000","last_unstale":"2024-09-12T02:13:46.689973+0000","last_undegraded":"2024-09-12T02:13:46.689973+0000","last_fullsized":"2024-09-12T02:13:46.689973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:31.415245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852420+0000","last_change":"2024-09-12T02:12:23.024293+0000","last_active":"2024-09-12T02:13:46.852420+0000","last_peered":"2024-09-12T02:13:46.852420+0000","last_clean":"2024-09-12T02:13:46.852420+0000","last_became_active":"2024-09-12T02:12:23.022939+0000","last_became_peered":"2024-09-12T02:12:23.022939+0000","last_unstale":"2024-09-12T02:13:46.852420+0000","last_undegraded":"2024-09-12T02:13:46.852420+0000","last_fullsized":"2024-09-12T02:13:46.852420+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:17.425084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693155+0000","last_change":"2024-09-12T02:12:12.696102+0000","last_active":"2024-09-12T02:13:46.693155+0000","last_peered":"2024-09-12T02:13:46.693155+0000","last_clean":"2024-09-12T02:13:46.693155+0000","last_became_active":"2024-09-12T02:12:12.695789+0000","last_became_peered":"2024-09-12T02:12:12.695789+0000","last_unstale":"2024-09-12T02:13:46.693155+0000","last_undegraded":"2024-09-12T02:13:46.693155+0000","last_fullsized":"2024-09-12T02:13:46.693155+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.674070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"95'1","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852818+0000","last_change":"2024-09-12T02:12:09.736807+0000","last_active":"2024-09-12T02:13:46.852818+0000","last_peered":"2024-09-12T02:13:46.852818+0000","last_clean":"2024-09-12T02:13:46.852818+0000","last_became_active":"2024-09-12T02:12:09.736351+0000","last_became_peered":"2024-09-12T02:12:09.736351+0000","last_unstale":"2024-09-12T02:13:46.852818+0000","last_undegraded":"2024-09-12T02:13:46.852818+0000","last_fullsized":"2024-09-12T02:13:46.852818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:14.228251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852192+0000","last_change":"2024-09-12T02:12:22.738679+0000","last_active":"2024-09-12T02:13:46.852192+0000","last_peered":"2024-09-12T02:13:46.852192+0000","last_clean":"2024-09-12T02:13:46.852192+0000","last_became_active":"2024-09-12T02:12:22.738221+0000","last_became_peered":"2024-09-12T02:12:22.738221+0000","last_unstale":"2024-09-12T02:13:46.852192+0000","last_undegraded":"2024-09-12T02:13:46.852192+0000","last_fullsized":"2024-09-12T02:13:46.852192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:41.143026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851711+0000","last_change":"2024-09-12T02:12:12.685853+0000","last_active":"2024-09-12T02:13:46.851711+0000","last_peered":"2024-09-12T02:13:46.851711+0000","last_clean":"2024-09-12T02:13:46.851711+0000","last_became_active":"2024-09-12T02:12:12.685537+0000","last_became_peered":"2024-09-12T02:12:12.685537+0000","last_unstale":"2024-09-12T02:13:46.851711+0000","last_undegraded":"2024-09-12T02:13:46.851711+0000","last_fullsized":"2024-09-12T02:13:46.851711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:01.159056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.689902+0000","last_change":"2024-09-12T02:12:09.736953+0000","last_active":"2024-09-12T02:13:46.689902+0000","last_peered":"2024-09-12T02:13:46.689902+0000","last_clean":"2024-09-12T02:13:46.689902+0000","last_became_active":"2024-09-12T02:12:09.736584+0000","last_became_peered":"2024-09-12T02:12:09.736584+0000","last_unstale":"2024-09-12T02:13:46.689902+0000","last_undegraded":"2024-09-12T02:13:46.689902+0000","last_fullsized":"2024-09-12T02:13:46.689902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:26.923372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852320+0000","last_change":"2024-09-12T02:12:23.023892+0000","last_active":"2024-09-12T02:13:46.852320+0000","last_peered":"2024-09-12T02:13:46.852320+0000","last_clean":"2024-09-12T02:13:46.852320+0000","last_became_active":"2024-09-12T02:12:23.023377+0000","last_became_peered":"2024-09-12T02:12:23.023377+0000","last_unstale":"2024-09-12T02:13:46.852320+0000","last_undegraded":"2024-09-12T02:13:46.852320+0000","last_fullsized":"2024-09-12T02:13:46.852320+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:06.944269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851485+0000","last_change":"2024-09-12T02:12:12.680026+0000","last_active":"2024-09-12T02:13:46.851485+0000","last_peered":"2024-09-12T02:13:46.851485+0000","last_clean":"2024-09-12T02:13:46.851485+0000","last_became_active":"2024-09-12T02:12:12.679683+0000","last_became_peered":"2024-09-12T02:12:12.679683+0000","last_unstale":"2024-09-12T02:13:46.851485+0000","last_undegraded":"2024-09-12T02:13:46.851485+0000","last_fullsized":"2024-09-12T02:13:46.851485+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:10.911026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"95'1","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851851+0000","last_change":"2024-09-12T02:12:09.666246+0000","last_active":"2024-09-12T02:13:46.851851+0000","last_peered":"2024-09-12T02:13:46.851851+0000","last_clean":"2024-09-12T02:13:46.851851+0000","last_became_active":"2024-09-12T02:12:09.665095+0000","last_became_peered":"2024-09-12T02:12:09.665095+0000","last_unstale":"2024-09-12T02:13:46.851851+0000","last_undegraded":"2024-09-12T02:13:46.851851+0000","last_fullsized":"2024-09-12T02:13:46.851851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:40.468381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693049+0000","last_change":"2024-09-12T02:12:22.739778+0000","last_active":"2024-09-12T02:13:46.693049+0000","last_peered":"2024-09-12T02:13:46.693049+0000","last_clean":"2024-09-12T02:13:46.693049+0000","last_became_active":"2024-09-12T02:12:22.739402+0000","last_became_peered":"2024-09-12T02:12:22.739402+0000","last_unstale":"2024-09-12T02:13:46.693049+0000","last_undegraded":"2024-09-12T02:13:46.693049+0000","last_fullsized":"2024-09-12T02:13:46.693049+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:10.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853258+0000","last_change":"2024-09-12T02:12:12.686121+0000","last_active":"2024-09-12T02:13:46.853258+0000","last_peered":"2024-09-12T02:13:46.853258+0000","last_clean":"2024-09-12T02:13:46.853258+0000","last_became_active":"2024-09-12T02:12:12.682209+0000","last_became_peered":"2024-09-12T02:12:12.682209+0000","last_unstale":"2024-09-12T02:13:46.853258+0000","last_undegraded":"2024-09-12T02:13:46.853258+0000","last_fullsized":"2024-09-12T02:13:46.853258+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:28.068552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"95'4","reported_seq":108,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:14:00.694181+0000","last_change":"2024-09-12T02:12:09.736820+0000","last_active":"2024-09-12T02:14:00.694181+0000","last_peered":"2024-09-12T02:14:00.694181+0000","last_clean":"2024-09-12T02:14:00.694181+0000","last_became_active":"2024-09-12T02:12:09.736472+0000","last_became_peered":"2024-09-12T02:12:09.736472+0000","last_unstale":"2024-09-12T02:14:00.694181+0000","last_undegraded":"2024-09-12T02:14:00.694181+0000","last_fullsized":"2024-09-12T02:14:00.694181+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:37.753089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692828+0000","last_change":"2024-09-12T02:12:23.024329+0000","last_active":"2024-09-12T02:13:46.692828+0000","last_peered":"2024-09-12T02:13:46.692828+0000","last_clean":"2024-09-12T02:13:46.692828+0000","last_became_active":"2024-09-12T02:12:23.023494+0000","last_became_peered":"2024-09-12T02:12:23.023494+0000","last_unstale":"2024-09-12T02:13:46.692828+0000","last_undegraded":"2024-09-12T02:13:46.692828+0000","last_fullsized":"2024-09-12T02:13:46.692828+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:56.650693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692472+0000","last_change":"2024-09-12T02:12:12.687520+0000","last_active":"2024-09-12T02:13:46.692472+0000","last_peered":"2024-09-12T02:13:46.692472+0000","last_clean":"2024-09-12T02:13:46.692472+0000","last_became_active":"2024-09-12T02:12:12.687147+0000","last_became_peered":"2024-09-12T02:12:12.687147+0000","last_unstale":"2024-09-12T02:13:46.692472+0000","last_undegraded":"2024-09-12T02:13:46.692472+0000","last_fullsized":"2024-09-12T02:13:46.692472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:40.391396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"95'3","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851320+0000","last_change":"2024-09-12T02:12:09.668841+0000","last_active":"2024-09-12T02:13:46.851320+0000","last_peered":"2024-09-12T02:13:46.851320+0000","last_clean":"2024-09-12T02:13:46.851320+0000","last_became_active":"2024-09-12T02:12:09.668488+0000","last_became_peered":"2024-09-12T02:12:09.668488+0000","last_unstale":"2024-09-12T02:13:46.851320+0000","last_undegraded":"2024-09-12T02:13:46.851320+0000","last_fullsized":"2024-09-12T02:13:46.851320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:28.259068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853333+0000","last_change":"2024-09-12T02:12:23.023804+0000","last_active":"2024-09-12T02:13:46.853333+0000","last_peered":"2024-09-12T02:13:46.853333+0000","last_clean":"2024-09-12T02:13:46.853333+0000","last_became_active":"2024-09-12T02:12:23.023331+0000","last_became_peered":"2024-09-12T02:12:23.023331+0000","last_unstale":"2024-09-12T02:13:46.853333+0000","last_undegraded":"2024-09-12T02:13:46.853333+0000","last_fullsized":"2024-09-12T02:13:46.853333+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:50.133965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852420+0000","last_change":"2024-09-12T02:12:12.695881+0000","last_active":"2024-09-12T02:13:46.852420+0000","last_peered":"2024-09-12T02:13:46.852420+0000","last_clean":"2024-09-12T02:13:46.852420+0000","last_became_active":"2024-09-12T02:12:12.695321+0000","last_became_peered":"2024-09-12T02:12:12.695321+0000","last_unstale":"2024-09-12T02:13:46.852420+0000","last_undegraded":"2024-09-12T02:13:46.852420+0000","last_fullsized":"2024-09-12T02:13:46.852420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:24.938014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"95'3","reported_seq":49,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690846+0000","last_change":"2024-09-12T02:12:09.667252+0000","last_active":"2024-09-12T02:13:46.690846+0000","last_peered":"2024-09-12T02:13:46.690846+0000","last_clean":"2024-09-12T02:13:46.690846+0000","last_became_active":"2024-09-12T02:12:09.666892+0000","last_became_peered":"2024-09-12T02:12:09.666892+0000","last_unstale":"2024-09-12T02:13:46.690846+0000","last_undegraded":"2024-09-12T02:13:46.690846+0000","last_fullsized":"2024-09-12T02:13:46.690846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:52.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":369,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851492+0000","last_change":"2024-09-12T02:10:50.611240+0000","last_active":"2024-09-12T02:13:46.851492+0000","last_peered":"2024-09-12T02:13:46.851492+0000","last_clean":"2024-09-12T02:13:46.851492+0000","last_became_active":"2024-09-12T02:10:50.610769+0000","last_became_peered":"2024-09-12T02:10:50.610769+0000","last_unstale":"2024-09-12T02:13:46.851492+0000","last_undegraded":"2024-09-12T02:13:46.851492+0000","last_fullsized":"2024-09-12T02:13:46.851492+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:07.996202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:07.996202+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.996202+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.113749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"95'1","reported_seq":29,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851563+0000","last_change":"2024-09-12T02:12:22.734156+0000","last_active":"2024-09-12T02:13:46.851563+0000","last_peered":"2024-09-12T02:13:46.851563+0000","last_clean":"2024-09-12T02:13:46.851563+0000","last_became_active":"2024-09-12T02:12:22.733679+0000","last_became_peered":"2024-09-12T02:12:22.733679+0000","last_unstale":"2024-09-12T02:13:46.851563+0000","last_undegraded":"2024-09-12T02:13:46.851563+0000","last_fullsized":"2024-09-12T02:13:46.851563+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:38.764902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851830+0000","last_change":"2024-09-12T02:12:12.686957+0000","last_active":"2024-09-12T02:13:46.851830+0000","last_peered":"2024-09-12T02:13:46.851830+0000","last_clean":"2024-09-12T02:13:46.851830+0000","last_became_active":"2024-09-12T02:12:12.686160+0000","last_became_peered":"2024-09-12T02:12:12.686160+0000","last_unstale":"2024-09-12T02:13:46.851830+0000","last_undegraded":"2024-09-12T02:13:46.851830+0000","last_fullsized":"2024-09-12T02:13:46.851830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:29.390487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"95'3","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.691174+0000","last_change":"2024-09-12T02:12:09.737061+0000","last_active":"2024-09-12T02:13:46.691174+0000","last_peered":"2024-09-12T02:13:46.691174+0000","last_clean":"2024-09-12T02:13:46.691174+0000","last_became_active":"2024-09-12T02:12:09.736550+0000","last_became_peered":"2024-09-12T02:12:09.736550+0000","last_unstale":"2024-09-12T02:13:46.691174+0000","last_undegraded":"2024-09-12T02:13:46.691174+0000","last_fullsized":"2024-09-12T02:13:46.691174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:27.859724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693166+0000","last_change":"2024-09-12T02:12:22.734200+0000","last_active":"2024-09-12T02:13:46.693166+0000","last_peered":"2024-09-12T02:13:46.693166+0000","last_clean":"2024-09-12T02:13:46.693166+0000","last_became_active":"2024-09-12T02:12:22.733679+0000","last_became_peered":"2024-09-12T02:12:22.733679+0000","last_unstale":"2024-09-12T02:13:46.693166+0000","last_undegraded":"2024-09-12T02:13:46.693166+0000","last_fullsized":"2024-09-12T02:13:46.693166+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:33.308512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852161+0000","last_change":"2024-09-12T02:12:12.691852+0000","last_active":"2024-09-12T02:13:46.852161+0000","last_peered":"2024-09-12T02:13:46.852161+0000","last_clean":"2024-09-12T02:13:46.852161+0000","last_became_active":"2024-09-12T02:12:12.691461+0000","last_became_peered":"2024-09-12T02:12:12.691461+0000","last_unstale":"2024-09-12T02:13:46.852161+0000","last_undegraded":"2024-09-12T02:13:46.852161+0000","last_fullsized":"2024-09-12T02:13:46.852161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:28.587845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'1","reported_seq":45,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.854117+0000","last_change":"2024-09-12T02:12:09.668230+0000","last_active":"2024-09-12T02:13:46.854117+0000","last_peered":"2024-09-12T02:13:46.854117+0000","last_clean":"2024-09-12T02:13:46.854117+0000","last_became_active":"2024-09-12T02:12:09.667802+0000","last_became_peered":"2024-09-12T02:12:09.667802+0000","last_unstale":"2024-09-12T02:13:46.854117+0000","last_undegraded":"2024-09-12T02:13:46.854117+0000","last_fullsized":"2024-09-12T02:13:46.854117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:58.505854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852653+0000","last_change":"2024-09-12T02:12:22.743207+0000","last_active":"2024-09-12T02:13:46.852653+0000","last_peered":"2024-09-12T02:13:46.852653+0000","last_clean":"2024-09-12T02:13:46.852653+0000","last_became_active":"2024-09-12T02:12:22.742820+0000","last_became_peered":"2024-09-12T02:12:22.742820+0000","last_unstale":"2024-09-12T02:13:46.852653+0000","last_undegraded":"2024-09-12T02:13:46.852653+0000","last_fullsized":"2024-09-12T02:13:46.852653+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:09.469987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852162+0000","last_change":"2024-09-12T02:12:12.681966+0000","last_active":"2024-09-12T02:13:46.852162+0000","last_peered":"2024-09-12T02:13:46.852162+0000","last_clean":"2024-09-12T02:13:46.852162+0000","last_became_active":"2024-09-12T02:12:12.681603+0000","last_became_peered":"2024-09-12T02:12:12.681603+0000","last_unstale":"2024-09-12T02:13:46.852162+0000","last_undegraded":"2024-09-12T02:13:46.852162+0000","last_fullsized":"2024-09-12T02:13:46.852162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:00.236008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'2","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692986+0000","last_change":"2024-09-12T02:12:09.665620+0000","last_active":"2024-09-12T02:13:46.692986+0000","last_peered":"2024-09-12T02:13:46.692986+0000","last_clean":"2024-09-12T02:13:46.692986+0000","last_became_active":"2024-09-12T02:12:09.665306+0000","last_became_peered":"2024-09-12T02:12:09.665306+0000","last_unstale":"2024-09-12T02:13:46.692986+0000","last_undegraded":"2024-09-12T02:13:46.692986+0000","last_fullsized":"2024-09-12T02:13:46.692986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.910141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853094+0000","last_change":"2024-09-12T02:12:22.732559+0000","last_active":"2024-09-12T02:13:46.853094+0000","last_peered":"2024-09-12T02:13:46.853094+0000","last_clean":"2024-09-12T02:13:46.853094+0000","last_became_active":"2024-09-12T02:12:22.732005+0000","last_became_peered":"2024-09-12T02:12:22.732005+0000","last_unstale":"2024-09-12T02:13:46.853094+0000","last_undegraded":"2024-09-12T02:13:46.853094+0000","last_fullsized":"2024-09-12T02:13:46.853094+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:14.101574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852593+0000","last_change":"2024-09-12T02:12:12.689448+0000","last_active":"2024-09-12T02:13:46.852593+0000","last_peered":"2024-09-12T02:13:46.852593+0000","last_clean":"2024-09-12T02:13:46.852593+0000","last_became_active":"2024-09-12T02:12:12.689112+0000","last_became_peered":"2024-09-12T02:12:12.689112+0000","last_unstale":"2024-09-12T02:13:46.852593+0000","last_undegraded":"2024-09-12T02:13:46.852593+0000","last_fullsized":"2024-09-12T02:13:46.852593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.802911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"95'2","reported_seq":47,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852953+0000","last_change":"2024-09-12T02:12:09.666062+0000","last_active":"2024-09-12T02:13:46.852953+0000","last_peered":"2024-09-12T02:13:46.852953+0000","last_clean":"2024-09-12T02:13:46.852953+0000","last_became_active":"2024-09-12T02:12:09.665632+0000","last_became_peered":"2024-09-12T02:12:09.665632+0000","last_unstale":"2024-09-12T02:13:46.852953+0000","last_undegraded":"2024-09-12T02:13:46.852953+0000","last_fullsized":"2024-09-12T02:13:46.852953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:23.794505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853254+0000","last_change":"2024-09-12T02:12:22.733650+0000","last_active":"2024-09-12T02:13:46.853254+0000","last_peered":"2024-09-12T02:13:46.853254+0000","last_clean":"2024-09-12T02:13:46.853254+0000","last_became_active":"2024-09-12T02:12:22.733258+0000","last_became_peered":"2024-09-12T02:12:22.733258+0000","last_unstale":"2024-09-12T02:13:46.853254+0000","last_undegraded":"2024-09-12T02:13:46.853254+0000","last_fullsized":"2024-09-12T02:13:46.853254+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:56.885431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853605+0000","last_change":"2024-09-12T02:12:12.687166+0000","last_active":"2024-09-12T02:13:46.853605+0000","last_peered":"2024-09-12T02:13:46.853605+0000","last_clean":"2024-09-12T02:13:46.853605+0000","last_became_active":"2024-09-12T02:12:12.686646+0000","last_became_peered":"2024-09-12T02:12:12.686646+0000","last_unstale":"2024-09-12T02:13:46.853605+0000","last_undegraded":"2024-09-12T02:13:46.853605+0000","last_fullsized":"2024-09-12T02:13:46.853605+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.038063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"95'15","reported_seq":33,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851763+0000","last_change":"2024-09-12T02:12:46.547259+0000","last_active":"2024-09-12T02:13:46.851763+0000","last_peered":"2024-09-12T02:13:46.851763+0000","last_clean":"2024-09-12T02:13:46.851763+0000","last_became_active":"2024-09-12T02:12:46.540288+0000","last_became_peered":"2024-09-12T02:12:46.540288+0000","last_unstale":"2024-09-12T02:13:46.851763+0000","last_undegraded":"2024-09-12T02:13:46.851763+0000","last_fullsized":"2024-09-12T02:13:46.851763+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:10.251191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692936+0000","last_change":"2024-09-12T02:12:22.745382+0000","last_active":"2024-09-12T02:13:46.692936+0000","last_peered":"2024-09-12T02:13:46.692936+0000","last_clean":"2024-09-12T02:13:46.692936+0000","last_became_active":"2024-09-12T02:12:22.740850+0000","last_became_peered":"2024-09-12T02:12:22.740850+0000","last_unstale":"2024-09-12T02:13:46.692936+0000","last_undegraded":"2024-09-12T02:13:46.692936+0000","last_fullsized":"2024-09-12T02:13:46.692936+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:40.207459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851196+0000","last_change":"2024-09-12T02:12:12.692745+0000","last_active":"2024-09-12T02:13:46.851196+0000","last_peered":"2024-09-12T02:13:46.851196+0000","last_clean":"2024-09-12T02:13:46.851196+0000","last_became_active":"2024-09-12T02:12:12.692213+0000","last_became_peered":"2024-09-12T02:12:12.692213+0000","last_unstale":"2024-09-12T02:13:46.851196+0000","last_undegraded":"2024-09-12T02:13:46.851196+0000","last_fullsized":"2024-09-12T02:13:46.851196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:11.869094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"95'3","reported_seq":113,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:14:04.701534+0000","last_change":"2024-09-12T02:12:09.668239+0000","last_active":"2024-09-12T02:14:04.701534+0000","last_peered":"2024-09-12T02:14:04.701534+0000","last_clean":"2024-09-12T02:14:04.701534+0000","last_became_active":"2024-09-12T02:12:09.667870+0000","last_became_peered":"2024-09-12T02:12:09.667870+0000","last_unstale":"2024-09-12T02:14:04.701534+0000","last_undegraded":"2024-09-12T02:14:04.701534+0000","last_fullsized":"2024-09-12T02:14:04.701534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:55.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690150+0000","last_change":"2024-09-12T02:12:22.743248+0000","last_active":"2024-09-12T02:13:46.690150+0000","last_peered":"2024-09-12T02:13:46.690150+0000","last_clean":"2024-09-12T02:13:46.690150+0000","last_became_active":"2024-09-12T02:12:22.742861+0000","last_became_peered":"2024-09-12T02:12:22.742861+0000","last_unstale":"2024-09-12T02:13:46.690150+0000","last_undegraded":"2024-09-12T02:13:46.690150+0000","last_fullsized":"2024-09-12T02:13:46.690150+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:07.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851868+0000","last_change":"2024-09-12T02:12:12.687994+0000","last_active":"2024-09-12T02:13:46.851868+0000","last_peered":"2024-09-12T02:13:46.851868+0000","last_clean":"2024-09-12T02:13:46.851868+0000","last_became_active":"2024-09-12T02:12:12.687652+0000","last_became_peered":"2024-09-12T02:12:12.687652+0000","last_unstale":"2024-09-12T02:13:46.851868+0000","last_undegraded":"2024-09-12T02:13:46.851868+0000","last_fullsized":"2024-09-12T02:13:46.851868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:16.168879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"95'3","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.854060+0000","last_change":"2024-09-12T02:12:09.670281+0000","last_active":"2024-09-12T02:13:46.854060+0000","last_peered":"2024-09-12T02:13:46.854060+0000","last_clean":"2024-09-12T02:13:46.854060+0000","last_became_active":"2024-09-12T02:12:09.669953+0000","last_became_peered":"2024-09-12T02:12:09.669953+0000","last_unstale":"2024-09-12T02:13:46.854060+0000","last_undegraded":"2024-09-12T02:13:46.854060+0000","last_fullsized":"2024-09-12T02:13:46.854060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.189591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852321+0000","last_change":"2024-09-12T02:12:22.747973+0000","last_active":"2024-09-12T02:13:46.852321+0000","last_peered":"2024-09-12T02:13:46.852321+0000","last_clean":"2024-09-12T02:13:46.852321+0000","last_became_active":"2024-09-12T02:12:22.747635+0000","last_became_peered":"2024-09-12T02:12:22.747635+0000","last_unstale":"2024-09-12T02:13:46.852321+0000","last_undegraded":"2024-09-12T02:13:46.852321+0000","last_fullsized":"2024-09-12T02:13:46.852321+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:11.310108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692646+0000","last_change":"2024-09-12T02:12:12.697466+0000","last_active":"2024-09-12T02:13:46.692646+0000","last_peered":"2024-09-12T02:13:46.692646+0000","last_clean":"2024-09-12T02:13:46.692646+0000","last_became_active":"2024-09-12T02:12:12.697119+0000","last_became_peered":"2024-09-12T02:12:12.697119+0000","last_unstale":"2024-09-12T02:13:46.692646+0000","last_undegraded":"2024-09-12T02:13:46.692646+0000","last_fullsized":"2024-09-12T02:13:46.692646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:37.396793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"95'6","reported_seq":51,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690878+0000","last_change":"2024-09-12T02:12:09.670895+0000","last_active":"2024-09-12T02:13:46.690878+0000","last_peered":"2024-09-12T02:13:46.690878+0000","last_clean":"2024-09-12T02:13:46.690878+0000","last_became_active":"2024-09-12T02:12:09.670301+0000","last_became_peered":"2024-09-12T02:12:09.670301+0000","last_unstale":"2024-09-12T02:13:46.690878+0000","last_undegraded":"2024-09-12T02:13:46.690878+0000","last_fullsized":"2024-09-12T02:13:46.690878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:06.693381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853611+0000","last_change":"2024-09-12T02:12:22.740419+0000","last_active":"2024-09-12T02:13:46.853611+0000","last_peered":"2024-09-12T02:13:46.853611+0000","last_clean":"2024-09-12T02:13:46.853611+0000","last_became_active":"2024-09-12T02:12:22.739966+0000","last_became_peered":"2024-09-12T02:12:22.739966+0000","last_unstale":"2024-09-12T02:13:46.853611+0000","last_undegraded":"2024-09-12T02:13:46.853611+0000","last_fullsized":"2024-09-12T02:13:46.853611+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.556038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852682+0000","last_change":"2024-09-12T02:12:12.681814+0000","last_active":"2024-09-12T02:13:46.852682+0000","last_peered":"2024-09-12T02:13:46.852682+0000","last_clean":"2024-09-12T02:13:46.852682+0000","last_became_active":"2024-09-12T02:12:12.681468+0000","last_became_peered":"2024-09-12T02:12:12.681468+0000","last_unstale":"2024-09-12T02:13:46.852682+0000","last_undegraded":"2024-09-12T02:13:46.852682+0000","last_fullsized":"2024-09-12T02:13:46.852682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:31.964646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'33","reported_seq":205,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:14:01.686637+0000","last_change":"2024-09-12T02:12:09.664324+0000","last_active":"2024-09-12T02:14:01.686637+0000","last_peered":"2024-09-12T02:14:01.686637+0000","last_clean":"2024-09-12T02:14:01.686637+0000","last_became_active":"2024-09-12T02:12:09.663970+0000","last_became_peered":"2024-09-12T02:12:09.663970+0000","last_unstale":"2024-09-12T02:14:01.686637+0000","last_undegraded":"2024-09-12T02:14:01.686637+0000","last_fullsized":"2024-09-12T02:14:01.686637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:03.408761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64140,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":34,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851238+0000","last_change":"2024-09-12T02:12:46.538194+0000","last_active":"2024-09-12T02:13:46.851238+0000","last_peered":"2024-09-12T02:13:46.851238+0000","last_clean":"2024-09-12T02:13:46.851238+0000","last_became_active":"2024-09-12T02:12:46.537669+0000","last_became_peered":"2024-09-12T02:12:46.537669+0000","last_unstale":"2024-09-12T02:13:46.851238+0000","last_undegraded":"2024-09-12T02:13:46.851238+0000","last_fullsized":"2024-09-12T02:13:46.851238+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:05.394149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693525+0000","last_change":"2024-09-12T02:12:12.690126+0000","last_active":"2024-09-12T02:13:46.693525+0000","last_peered":"2024-09-12T02:13:46.693525+0000","last_clean":"2024-09-12T02:13:46.693525+0000","last_became_active":"2024-09-12T02:12:12.689821+0000","last_became_peered":"2024-09-12T02:12:12.689821+0000","last_unstale":"2024-09-12T02:13:46.693525+0000","last_undegraded":"2024-09-12T02:13:46.693525+0000","last_fullsized":"2024-09-12T02:13:46.693525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:39.503772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"95'4","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.854011+0000","last_change":"2024-09-12T02:12:09.735571+0000","last_active":"2024-09-12T02:13:46.854011+0000","last_peered":"2024-09-12T02:13:46.854011+0000","last_clean":"2024-09-12T02:13:46.854011+0000","last_became_active":"2024-09-12T02:12:09.735150+0000","last_became_peered":"2024-09-12T02:12:09.735150+0000","last_unstale":"2024-09-12T02:13:46.854011+0000","last_undegraded":"2024-09-12T02:13:46.854011+0000","last_fullsized":"2024-09-12T02:13:46.854011+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:44.840395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690565+0000","last_change":"2024-09-12T02:12:46.543628+0000","last_active":"2024-09-12T02:13:46.690565+0000","last_peered":"2024-09-12T02:13:46.690565+0000","last_clean":"2024-09-12T02:13:46.690565+0000","last_became_active":"2024-09-12T02:12:46.543158+0000","last_became_peered":"2024-09-12T02:12:46.543158+0000","last_unstale":"2024-09-12T02:13:46.690565+0000","last_undegraded":"2024-09-12T02:13:46.690565+0000","last_fullsized":"2024-09-12T02:13:46.690565+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:05.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852895+0000","last_change":"2024-09-12T02:12:12.683253+0000","last_active":"2024-09-12T02:13:46.852895+0000","last_peered":"2024-09-12T02:13:46.852895+0000","last_clean":"2024-09-12T02:13:46.852895+0000","last_became_active":"2024-09-12T02:12:12.682761+0000","last_became_peered":"2024-09-12T02:12:12.682761+0000","last_unstale":"2024-09-12T02:13:46.852895+0000","last_undegraded":"2024-09-12T02:13:46.852895+0000","last_fullsized":"2024-09-12T02:13:46.852895+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:56.321662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"95'2","reported_seq":51,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852047+0000","last_change":"2024-09-12T02:12:46.542190+0000","last_active":"2024-09-12T02:13:46.852047+0000","last_peered":"2024-09-12T02:13:46.852047+0000","last_clean":"2024-09-12T02:13:46.852047+0000","last_became_active":"2024-09-12T02:12:46.541755+0000","last_became_peered":"2024-09-12T02:12:46.541755+0000","last_unstale":"2024-09-12T02:13:46.852047+0000","last_undegraded":"2024-09-12T02:13:46.852047+0000","last_fullsized":"2024-09-12T02:13:46.852047+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:53.224512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852019+0000","last_change":"2024-09-12T02:12:46.540620+0000","last_active":"2024-09-12T02:13:46.852019+0000","last_peered":"2024-09-12T02:13:46.852019+0000","last_clean":"2024-09-12T02:13:46.852019+0000","last_became_active":"2024-09-12T02:12:46.540177+0000","last_became_peered":"2024-09-12T02:12:46.540177+0000","last_unstale":"2024-09-12T02:13:46.852019+0000","last_undegraded":"2024-09-12T02:13:46.852019+0000","last_fullsized":"2024-09-12T02:13:46.852019+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:30.701052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693712+0000","last_change":"2024-09-12T02:12:12.686728+0000","last_active":"2024-09-12T02:13:46.693712+0000","last_peered":"2024-09-12T02:13:46.693712+0000","last_clean":"2024-09-12T02:13:46.693712+0000","last_became_active":"2024-09-12T02:12:12.686159+0000","last_became_peered":"2024-09-12T02:12:12.686159+0000","last_unstale":"2024-09-12T02:13:46.693712+0000","last_undegraded":"2024-09-12T02:13:46.693712+0000","last_fullsized":"2024-09-12T02:13:46.693712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:51.567343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'3","reported_seq":106,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:14:00.685177+0000","last_change":"2024-09-12T02:12:09.665179+0000","last_active":"2024-09-12T02:14:00.685177+0000","last_peered":"2024-09-12T02:14:00.685177+0000","last_clean":"2024-09-12T02:14:00.685177+0000","last_became_active":"2024-09-12T02:12:09.664794+0000","last_became_peered":"2024-09-12T02:12:09.664794+0000","last_unstale":"2024-09-12T02:14:00.685177+0000","last_undegraded":"2024-09-12T02:14:00.685177+0000","last_fullsized":"2024-09-12T02:14:00.685177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:36.646536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851790+0000","last_change":"2024-09-12T02:12:22.735715+0000","last_active":"2024-09-12T02:13:46.851790+0000","last_peered":"2024-09-12T02:13:46.851790+0000","last_clean":"2024-09-12T02:13:46.851790+0000","last_became_active":"2024-09-12T02:12:22.735341+0000","last_became_peered":"2024-09-12T02:12:22.735341+0000","last_unstale":"2024-09-12T02:13:46.851790+0000","last_undegraded":"2024-09-12T02:13:46.851790+0000","last_fullsized":"2024-09-12T02:13:46.851790+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:36.141512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852856+0000","last_change":"2024-09-12T02:12:22.743286+0000","last_active":"2024-09-12T02:13:46.852856+0000","last_peered":"2024-09-12T02:13:46.852856+0000","last_clean":"2024-09-12T02:13:46.852856+0000","last_became_active":"2024-09-12T02:12:22.742804+0000","last_became_peered":"2024-09-12T02:12:22.742804+0000","last_unstale":"2024-09-12T02:13:46.852856+0000","last_undegraded":"2024-09-12T02:13:46.852856+0000","last_fullsized":"2024-09-12T02:13:46.852856+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:26.133009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.689604+0000","last_change":"2024-09-12T02:12:12.682970+0000","last_active":"2024-09-12T02:13:46.689604+0000","last_peered":"2024-09-12T02:13:46.689604+0000","last_clean":"2024-09-12T02:13:46.689604+0000","last_became_active":"2024-09-12T02:12:12.682625+0000","last_became_peered":"2024-09-12T02:12:12.682625+0000","last_unstale":"2024-09-12T02:13:46.689604+0000","last_undegraded":"2024-09-12T02:13:46.689604+0000","last_fullsized":"2024-09-12T02:13:46.689604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:44.585654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"95'1","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853560+0000","last_change":"2024-09-12T02:12:09.669380+0000","last_active":"2024-09-12T02:13:46.853560+0000","last_peered":"2024-09-12T02:13:46.853560+0000","last_clean":"2024-09-12T02:13:46.853560+0000","last_became_active":"2024-09-12T02:12:09.669052+0000","last_became_peered":"2024-09-12T02:12:09.669052+0000","last_unstale":"2024-09-12T02:13:46.853560+0000","last_undegraded":"2024-09-12T02:13:46.853560+0000","last_fullsized":"2024-09-12T02:13:46.853560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:35.828558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852610+0000","last_change":"2024-09-12T02:12:22.745871+0000","last_active":"2024-09-12T02:13:46.852610+0000","last_peered":"2024-09-12T02:13:46.852610+0000","last_clean":"2024-09-12T02:13:46.852610+0000","last_became_active":"2024-09-12T02:12:22.745370+0000","last_became_peered":"2024-09-12T02:12:22.745370+0000","last_unstale":"2024-09-12T02:13:46.852610+0000","last_undegraded":"2024-09-12T02:13:46.852610+0000","last_fullsized":"2024-09-12T02:13:46.852610+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:20.579806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851748+0000","last_change":"2024-09-12T02:12:12.684996+0000","last_active":"2024-09-12T02:13:46.851748+0000","last_peered":"2024-09-12T02:13:46.851748+0000","last_clean":"2024-09-12T02:13:46.851748+0000","last_became_active":"2024-09-12T02:12:12.684663+0000","last_became_peered":"2024-09-12T02:12:12.684663+0000","last_unstale":"2024-09-12T02:13:46.851748+0000","last_undegraded":"2024-09-12T02:13:46.851748+0000","last_fullsized":"2024-09-12T02:13:46.851748+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:35.054435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"95'2","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692472+0000","last_change":"2024-09-12T02:12:09.668939+0000","last_active":"2024-09-12T02:13:46.692472+0000","last_peered":"2024-09-12T02:13:46.692472+0000","last_clean":"2024-09-12T02:13:46.692472+0000","last_became_active":"2024-09-12T02:12:09.665857+0000","last_became_peered":"2024-09-12T02:12:09.665857+0000","last_unstale":"2024-09-12T02:13:46.692472+0000","last_undegraded":"2024-09-12T02:13:46.692472+0000","last_fullsized":"2024-09-12T02:13:46.692472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:42.311387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"95'3","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851371+0000","last_change":"2024-09-12T02:12:09.666892+0000","last_active":"2024-09-12T02:13:46.851371+0000","last_peered":"2024-09-12T02:13:46.851371+0000","last_clean":"2024-09-12T02:13:46.851371+0000","last_became_active":"2024-09-12T02:12:09.666503+0000","last_became_peered":"2024-09-12T02:12:09.666503+0000","last_unstale":"2024-09-12T02:13:46.851371+0000","last_undegraded":"2024-09-12T02:13:46.851371+0000","last_fullsized":"2024-09-12T02:13:46.851371+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:16.010778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853678+0000","last_change":"2024-09-12T02:12:12.683323+0000","last_active":"2024-09-12T02:13:46.853678+0000","last_peered":"2024-09-12T02:13:46.853678+0000","last_clean":"2024-09-12T02:13:46.853678+0000","last_became_active":"2024-09-12T02:12:12.683017+0000","last_became_peered":"2024-09-12T02:12:12.683017+0000","last_unstale":"2024-09-12T02:13:46.853678+0000","last_undegraded":"2024-09-12T02:13:46.853678+0000","last_fullsized":"2024-09-12T02:13:46.853678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:00.287600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690892+0000","last_change":"2024-09-12T02:12:22.743509+0000","last_active":"2024-09-12T02:13:46.690892+0000","last_peered":"2024-09-12T02:13:46.690892+0000","last_clean":"2024-09-12T02:13:46.690892+0000","last_became_active":"2024-09-12T02:12:22.743185+0000","last_became_peered":"2024-09-12T02:12:22.743185+0000","last_unstale":"2024-09-12T02:13:46.690892+0000","last_undegraded":"2024-09-12T02:13:46.690892+0000","last_fullsized":"2024-09-12T02:13:46.690892+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:44.990530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'6","reported_seq":113,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:14:01.687185+0000","last_change":"2024-09-12T02:12:09.672316+0000","last_active":"2024-09-12T02:14:01.687185+0000","last_peered":"2024-09-12T02:14:01.687185+0000","last_clean":"2024-09-12T02:14:01.687185+0000","last_became_active":"2024-09-12T02:12:09.671947+0000","last_became_peered":"2024-09-12T02:12:09.671947+0000","last_unstale":"2024-09-12T02:14:01.687185+0000","last_undegraded":"2024-09-12T02:14:01.687185+0000","last_fullsized":"2024-09-12T02:14:01.687185+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:00.632297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852492+0000","last_change":"2024-09-12T02:12:12.689437+0000","last_active":"2024-09-12T02:13:46.852492+0000","last_peered":"2024-09-12T02:13:46.852492+0000","last_clean":"2024-09-12T02:13:46.852492+0000","last_became_active":"2024-09-12T02:12:12.689123+0000","last_became_peered":"2024-09-12T02:12:12.689123+0000","last_unstale":"2024-09-12T02:13:46.852492+0000","last_undegraded":"2024-09-12T02:13:46.852492+0000","last_fullsized":"2024-09-12T02:13:46.852492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:07.635955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.691100+0000","last_change":"2024-09-12T02:12:22.733472+0000","last_active":"2024-09-12T02:13:46.691100+0000","last_peered":"2024-09-12T02:13:46.691100+0000","last_clean":"2024-09-12T02:13:46.691100+0000","last_became_active":"2024-09-12T02:12:22.733040+0000","last_became_peered":"2024-09-12T02:12:22.733040+0000","last_unstale":"2024-09-12T02:13:46.691100+0000","last_undegraded":"2024-09-12T02:13:46.691100+0000","last_fullsized":"2024-09-12T02:13:46.691100+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:15.556414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851861+0000","last_change":"2024-09-12T02:12:12.684758+0000","last_active":"2024-09-12T02:13:46.851861+0000","last_peered":"2024-09-12T02:13:46.851861+0000","last_clean":"2024-09-12T02:13:46.851861+0000","last_became_active":"2024-09-12T02:12:12.684430+0000","last_became_peered":"2024-09-12T02:12:12.684430+0000","last_unstale":"2024-09-12T02:13:46.851861+0000","last_undegraded":"2024-09-12T02:13:46.851861+0000","last_fullsized":"2024-09-12T02:13:46.851861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:26.209634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690802+0000","last_change":"2024-09-12T02:12:12.688350+0000","last_active":"2024-09-12T02:13:46.690802+0000","last_peered":"2024-09-12T02:13:46.690802+0000","last_clean":"2024-09-12T02:13:46.690802+0000","last_became_active":"2024-09-12T02:12:12.688037+0000","last_became_peered":"2024-09-12T02:12:12.688037+0000","last_unstale":"2024-09-12T02:13:46.690802+0000","last_undegraded":"2024-09-12T02:13:46.690802+0000","last_fullsized":"2024-09-12T02:13:46.690802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:02.133024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690600+0000","last_change":"2024-09-12T02:12:12.686031+0000","last_active":"2024-09-12T02:13:46.690600+0000","last_peered":"2024-09-12T02:13:46.690600+0000","last_clean":"2024-09-12T02:13:46.690600+0000","last_became_active":"2024-09-12T02:12:12.685690+0000","last_became_peered":"2024-09-12T02:12:12.685690+0000","last_unstale":"2024-09-12T02:13:46.690600+0000","last_undegraded":"2024-09-12T02:13:46.690600+0000","last_fullsized":"2024-09-12T02:13:46.690600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:43.406506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852653+0000","last_change":"2024-09-12T02:12:12.695698+0000","last_active":"2024-09-12T02:13:46.852653+0000","last_peered":"2024-09-12T02:13:46.852653+0000","last_clean":"2024-09-12T02:13:46.852653+0000","last_became_active":"2024-09-12T02:12:12.694277+0000","last_became_peered":"2024-09-12T02:12:12.694277+0000","last_unstale":"2024-09-12T02:13:46.852653+0000","last_undegraded":"2024-09-12T02:13:46.852653+0000","last_fullsized":"2024-09-12T02:13:46.852653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:55.013973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.854017+0000","last_change":"2024-09-12T02:13:46.854017+0000","last_active":"2024-09-12T02:13:46.854017+0000","last_peered":"2024-09-12T02:13:46.854017+0000","last_clean":"2024-09-12T02:13:46.854017+0000","last_became_active":"2024-09-12T02:13:46.853633+0000","last_became_peered":"2024-09-12T02:13:46.853633+0000","last_unstale":"2024-09-12T02:13:46.854017+0000","last_undegraded":"2024-09-12T02:13:46.854017+0000","last_fullsized":"2024-09-12T02:13:46.854017+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:42.852113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852778+0000","last_change":"2024-09-12T02:12:12.683057+0000","last_active":"2024-09-12T02:13:46.852778+0000","last_peered":"2024-09-12T02:13:46.852778+0000","last_clean":"2024-09-12T02:13:46.852778+0000","last_became_active":"2024-09-12T02:12:12.682751+0000","last_became_peered":"2024-09-12T02:12:12.682751+0000","last_unstale":"2024-09-12T02:13:46.852778+0000","last_undegraded":"2024-09-12T02:13:46.852778+0000","last_fullsized":"2024-09-12T02:13:46.852778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:58.642560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.691313+0000","last_change":"2024-09-12T02:12:12.682975+0000","last_active":"2024-09-12T02:13:46.691313+0000","last_peered":"2024-09-12T02:13:46.691313+0000","last_clean":"2024-09-12T02:13:46.691313+0000","last_became_active":"2024-09-12T02:12:12.682643+0000","last_became_peered":"2024-09-12T02:12:12.682643+0000","last_unstale":"2024-09-12T02:13:46.691313+0000","last_undegraded":"2024-09-12T02:13:46.691313+0000","last_fullsized":"2024-09-12T02:13:46.691313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:49.859554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692735+0000","last_change":"2024-09-12T02:13:46.692044+0000","last_active":"2024-09-12T02:13:46.692735+0000","last_peered":"2024-09-12T02:13:46.692735+0000","last_clean":"2024-09-12T02:13:46.692735+0000","last_became_active":"2024-09-12T02:13:46.691640+0000","last_became_peered":"2024-09-12T02:13:46.691640+0000","last_unstale":"2024-09-12T02:13:46.692735+0000","last_undegraded":"2024-09-12T02:13:46.692735+0000","last_fullsized":"2024-09-12T02:13:46.692735+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:46.331316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853230+0000","last_change":"2024-09-12T02:12:12.687454+0000","last_active":"2024-09-12T02:13:46.853230+0000","last_peered":"2024-09-12T02:13:46.853230+0000","last_clean":"2024-09-12T02:13:46.853230+0000","last_became_active":"2024-09-12T02:12:12.686203+0000","last_became_peered":"2024-09-12T02:12:12.686203+0000","last_unstale":"2024-09-12T02:13:46.853230+0000","last_undegraded":"2024-09-12T02:13:46.853230+0000","last_fullsized":"2024-09-12T02:13:46.853230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:25.029872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852052+0000","last_change":"2024-09-12T02:12:12.683777+0000","last_active":"2024-09-12T02:13:46.852052+0000","last_peered":"2024-09-12T02:13:46.852052+0000","last_clean":"2024-09-12T02:13:46.852052+0000","last_became_active":"2024-09-12T02:12:12.682096+0000","last_became_peered":"2024-09-12T02:12:12.682096+0000","last_unstale":"2024-09-12T02:13:46.852052+0000","last_undegraded":"2024-09-12T02:13:46.852052+0000","last_fullsized":"2024-09-12T02:13:46.852052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:18.624449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693473+0000","last_change":"2024-09-12T02:12:12.689690+0000","last_active":"2024-09-12T02:13:46.693473+0000","last_peered":"2024-09-12T02:13:46.693473+0000","last_clean":"2024-09-12T02:13:46.693473+0000","last_became_active":"2024-09-12T02:12:12.689339+0000","last_became_peered":"2024-09-12T02:12:12.689339+0000","last_unstale":"2024-09-12T02:13:46.693473+0000","last_undegraded":"2024-09-12T02:13:46.693473+0000","last_fullsized":"2024-09-12T02:13:46.693473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:06.517136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692821+0000","last_change":"2024-09-12T02:12:12.696480+0000","last_active":"2024-09-12T02:13:46.692821+0000","last_peered":"2024-09-12T02:13:46.692821+0000","last_clean":"2024-09-12T02:13:46.692821+0000","last_became_active":"2024-09-12T02:12:12.696163+0000","last_became_peered":"2024-09-12T02:12:12.696163+0000","last_unstale":"2024-09-12T02:13:46.692821+0000","last_undegraded":"2024-09-12T02:13:46.692821+0000","last_fullsized":"2024-09-12T02:13:46.692821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:12.381644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852425+0000","last_change":"2024-09-12T02:12:46.947998+0000","last_active":"2024-09-12T02:13:46.852425+0000","last_peered":"2024-09-12T02:13:46.852425+0000","last_clean":"2024-09-12T02:13:46.852425+0000","last_became_active":"2024-09-12T02:12:46.947602+0000","last_became_peered":"2024-09-12T02:12:46.947602+0000","last_unstale":"2024-09-12T02:13:46.852425+0000","last_undegraded":"2024-09-12T02:13:46.852425+0000","last_fullsized":"2024-09-12T02:13:46.852425+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:50.123283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.691257+0000","last_change":"2024-09-12T02:12:12.689152+0000","last_active":"2024-09-12T02:13:46.691257+0000","last_peered":"2024-09-12T02:13:46.691257+0000","last_clean":"2024-09-12T02:13:46.691257+0000","last_became_active":"2024-09-12T02:12:12.688830+0000","last_became_peered":"2024-09-12T02:12:12.688830+0000","last_unstale":"2024-09-12T02:13:46.691257+0000","last_undegraded":"2024-09-12T02:13:46.691257+0000","last_fullsized":"2024-09-12T02:13:46.691257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:24.057884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.689919+0000","last_change":"2024-09-12T02:12:12.683089+0000","last_active":"2024-09-12T02:13:46.689919+0000","last_peered":"2024-09-12T02:13:46.689919+0000","last_clean":"2024-09-12T02:13:46.689919+0000","last_became_active":"2024-09-12T02:12:12.682783+0000","last_became_peered":"2024-09-12T02:12:12.682783+0000","last_unstale":"2024-09-12T02:13:46.689919+0000","last_undegraded":"2024-09-12T02:13:46.689919+0000","last_fullsized":"2024-09-12T02:13:46.689919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:07.182958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852948+0000","last_change":"2024-09-12T02:12:12.698373+0000","last_active":"2024-09-12T02:13:46.852948+0000","last_peered":"2024-09-12T02:13:46.852948+0000","last_clean":"2024-09-12T02:13:46.852948+0000","last_became_active":"2024-09-12T02:12:12.698103+0000","last_became_peered":"2024-09-12T02:12:12.698103+0000","last_unstale":"2024-09-12T02:13:46.852948+0000","last_undegraded":"2024-09-12T02:13:46.852948+0000","last_fullsized":"2024-09-12T02:13:46.852948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:35.776397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693120+0000","last_change":"2024-09-12T02:12:12.698499+0000","last_active":"2024-09-12T02:13:46.693120+0000","last_peered":"2024-09-12T02:13:46.693120+0000","last_clean":"2024-09-12T02:13:46.693120+0000","last_became_active":"2024-09-12T02:12:12.698103+0000","last_became_peered":"2024-09-12T02:12:12.698103+0000","last_unstale":"2024-09-12T02:13:46.693120+0000","last_undegraded":"2024-09-12T02:13:46.693120+0000","last_fullsized":"2024-09-12T02:13:46.693120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:59.116424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851852+0000","last_change":"2024-09-12T02:12:12.687918+0000","last_active":"2024-09-12T02:13:46.851852+0000","last_peered":"2024-09-12T02:13:46.851852+0000","last_clean":"2024-09-12T02:13:46.851852+0000","last_became_active":"2024-09-12T02:12:12.684732+0000","last_became_peered":"2024-09-12T02:12:12.684732+0000","last_unstale":"2024-09-12T02:13:46.851852+0000","last_undegraded":"2024-09-12T02:13:46.851852+0000","last_fullsized":"2024-09-12T02:13:46.851852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:06.675996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852184+0000","last_change":"2024-09-12T02:12:12.680429+0000","last_active":"2024-09-12T02:13:46.852184+0000","last_peered":"2024-09-12T02:13:46.852184+0000","last_clean":"2024-09-12T02:13:46.852184+0000","last_became_active":"2024-09-12T02:12:12.680138+0000","last_became_peered":"2024-09-12T02:12:12.680138+0000","last_unstale":"2024-09-12T02:13:46.852184+0000","last_undegraded":"2024-09-12T02:13:46.852184+0000","last_fullsized":"2024-09-12T02:13:46.852184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:16.144740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692808+0000","last_change":"2024-09-12T02:12:12.688403+0000","last_active":"2024-09-12T02:13:46.692808+0000","last_peered":"2024-09-12T02:13:46.692808+0000","last_clean":"2024-09-12T02:13:46.692808+0000","last_became_active":"2024-09-12T02:12:12.686037+0000","last_became_peered":"2024-09-12T02:12:12.686037+0000","last_unstale":"2024-09-12T02:13:46.692808+0000","last_undegraded":"2024-09-12T02:13:46.692808+0000","last_fullsized":"2024-09-12T02:13:46.692808+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:01.825875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.691027+0000","last_change":"2024-09-12T02:12:12.677197+0000","last_active":"2024-09-12T02:13:46.691027+0000","last_peered":"2024-09-12T02:13:46.691027+0000","last_clean":"2024-09-12T02:13:46.691027+0000","last_became_active":"2024-09-12T02:12:12.676845+0000","last_became_peered":"2024-09-12T02:12:12.676845+0000","last_unstale":"2024-09-12T02:13:46.691027+0000","last_undegraded":"2024-09-12T02:13:46.691027+0000","last_fullsized":"2024-09-12T02:13:46.691027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:35.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851732+0000","last_change":"2024-09-12T02:12:12.687061+0000","last_active":"2024-09-12T02:13:46.851732+0000","last_peered":"2024-09-12T02:13:46.851732+0000","last_clean":"2024-09-12T02:13:46.851732+0000","last_became_active":"2024-09-12T02:12:12.686616+0000","last_became_peered":"2024-09-12T02:12:12.686616+0000","last_unstale":"2024-09-12T02:13:46.851732+0000","last_undegraded":"2024-09-12T02:13:46.851732+0000","last_fullsized":"2024-09-12T02:13:46.851732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:09.368228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851760+0000","last_change":"2024-09-12T02:12:12.677137+0000","last_active":"2024-09-12T02:13:46.851760+0000","last_peered":"2024-09-12T02:13:46.851760+0000","last_clean":"2024-09-12T02:13:46.851760+0000","last_became_active":"2024-09-12T02:12:12.676818+0000","last_became_peered":"2024-09-12T02:12:12.676818+0000","last_unstale":"2024-09-12T02:13:46.851760+0000","last_undegraded":"2024-09-12T02:13:46.851760+0000","last_fullsized":"2024-09-12T02:13:46.851760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:31.734571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853649+0000","last_change":"2024-09-12T02:13:46.853649+0000","last_active":"2024-09-12T02:13:46.853649+0000","last_peered":"2024-09-12T02:13:46.853649+0000","last_clean":"2024-09-12T02:13:46.853649+0000","last_became_active":"2024-09-12T02:13:46.853347+0000","last_became_peered":"2024-09-12T02:13:46.853347+0000","last_unstale":"2024-09-12T02:13:46.853649+0000","last_undegraded":"2024-09-12T02:13:46.853649+0000","last_fullsized":"2024-09-12T02:13:46.853649+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:47.798643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851641+0000","last_change":"2024-09-12T02:12:12.694662+0000","last_active":"2024-09-12T02:13:46.851641+0000","last_peered":"2024-09-12T02:13:46.851641+0000","last_clean":"2024-09-12T02:13:46.851641+0000","last_became_active":"2024-09-12T02:12:12.693454+0000","last_became_peered":"2024-09-12T02:12:12.693454+0000","last_unstale":"2024-09-12T02:13:46.851641+0000","last_undegraded":"2024-09-12T02:13:46.851641+0000","last_fullsized":"2024-09-12T02:13:46.851641+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:14.818573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851282+0000","last_change":"2024-09-12T02:12:12.693045+0000","last_active":"2024-09-12T02:13:46.851282+0000","last_peered":"2024-09-12T02:13:46.851282+0000","last_clean":"2024-09-12T02:13:46.851282+0000","last_became_active":"2024-09-12T02:12:12.692520+0000","last_became_peered":"2024-09-12T02:12:12.692520+0000","last_unstale":"2024-09-12T02:13:46.851282+0000","last_undegraded":"2024-09-12T02:13:46.851282+0000","last_fullsized":"2024-09-12T02:13:46.851282+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.613656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851270+0000","last_change":"2024-09-12T02:12:12.677141+0000","last_active":"2024-09-12T02:13:46.851270+0000","last_peered":"2024-09-12T02:13:46.851270+0000","last_clean":"2024-09-12T02:13:46.851270+0000","last_became_active":"2024-09-12T02:12:12.676828+0000","last_became_peered":"2024-09-12T02:12:12.676828+0000","last_unstale":"2024-09-12T02:13:46.851270+0000","last_undegraded":"2024-09-12T02:13:46.851270+0000","last_fullsized":"2024-09-12T02:13:46.851270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:51.355531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852102+0000","last_change":"2024-09-12T02:12:12.688588+0000","last_active":"2024-09-12T02:13:46.852102+0000","last_peered":"2024-09-12T02:13:46.852102+0000","last_clean":"2024-09-12T02:13:46.852102+0000","last_became_active":"2024-09-12T02:12:12.688275+0000","last_became_peered":"2024-09-12T02:12:12.688275+0000","last_unstale":"2024-09-12T02:13:46.852102+0000","last_undegraded":"2024-09-12T02:13:46.852102+0000","last_fullsized":"2024-09-12T02:13:46.852102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:28.540937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690971+0000","last_change":"2024-09-12T02:12:12.685463+0000","last_active":"2024-09-12T02:13:46.690971+0000","last_peered":"2024-09-12T02:13:46.690971+0000","last_clean":"2024-09-12T02:13:46.690971+0000","last_became_active":"2024-09-12T02:12:12.684219+0000","last_became_peered":"2024-09-12T02:12:12.684219+0000","last_unstale":"2024-09-12T02:13:46.690971+0000","last_undegraded":"2024-09-12T02:13:46.690971+0000","last_fullsized":"2024-09-12T02:13:46.690971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:09.512781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852791+0000","last_change":"2024-09-12T02:12:12.699531+0000","last_active":"2024-09-12T02:13:46.852791+0000","last_peered":"2024-09-12T02:13:46.852791+0000","last_clean":"2024-09-12T02:13:46.852791+0000","last_became_active":"2024-09-12T02:12:12.691874+0000","last_became_peered":"2024-09-12T02:12:12.691874+0000","last_unstale":"2024-09-12T02:13:46.852791+0000","last_undegraded":"2024-09-12T02:13:46.852791+0000","last_fullsized":"2024-09-12T02:13:46.852791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:32.484656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852901+0000","last_change":"2024-09-12T02:12:12.691135+0000","last_active":"2024-09-12T02:13:46.852901+0000","last_peered":"2024-09-12T02:13:46.852901+0000","last_clean":"2024-09-12T02:13:46.852901+0000","last_became_active":"2024-09-12T02:12:12.690812+0000","last_became_peered":"2024-09-12T02:12:12.690812+0000","last_unstale":"2024-09-12T02:13:46.852901+0000","last_undegraded":"2024-09-12T02:13:46.852901+0000","last_fullsized":"2024-09-12T02:13:46.852901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:50.835731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852854+0000","last_change":"2024-09-12T02:12:12.697439+0000","last_active":"2024-09-12T02:13:46.852854+0000","last_peered":"2024-09-12T02:13:46.852854+0000","last_clean":"2024-09-12T02:13:46.852854+0000","last_became_active":"2024-09-12T02:12:12.697142+0000","last_became_peered":"2024-09-12T02:12:12.697142+0000","last_unstale":"2024-09-12T02:13:46.852854+0000","last_undegraded":"2024-09-12T02:13:46.852854+0000","last_fullsized":"2024-09-12T02:13:46.852854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:12.032053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68143,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":393,"num_read_kb":265,"num_write":168,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":204429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449125,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1122304,"data_stored":557273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678059,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37112,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708040,"statfs":{"total":95995035648,"available":95957032960,"internally_reserved":0,"allocated":1806336,"data_stored":1208569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841584,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36460,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708692,"statfs":{"total":95995035648,"available":95957700608,"internally_reserved":0,"allocated":1134592,"data_stored":561493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103223,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36444,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708708,"statfs":{"total":95995035648,"available":95957716992,"internally_reserved":0,"allocated":1122304,"data_stored":557205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332155,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1724416,"data_stored":1153228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495680,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1110016,"data_stored":552573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757319,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28720,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716432,"statfs":{"total":95995035648,"available":95965626368,"internally_reserved":0,"allocated":1732608,"data_stored":1148816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920845,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1122304,"data_stored":557223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149777,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36448,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708704,"statfs":{"total":95995035648,"available":95957712896,"internally_reserved":0,"allocated":1122304,"data_stored":552767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28208,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716944,"statfs":{"total":95995035648,"available":95966150656,"internally_reserved":0,"allocated":1204224,"data_stored":618366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36500,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708652,"statfs":{"total":95995035648,"available":95957659648,"internally_reserved":0,"allocated":1179648,"data_stored":616623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36460,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708692,"statfs":{"total":95995035648,"available":95957700608,"internally_reserved":0,"allocated":1134592,"data_stored":553961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:14:09.905 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T02:14:10.276 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:10.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:10 smithi110 ceph-mon[30548]: from='client.24935 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:14:10.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:10 smithi110 ceph-mon[30548]: pgmap v369: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:10.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.877+0000 7f6194400640 1 -- 172.21.15.110:0/1703175176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c074e30 msgr2=0x7f618c10df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:10.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.877+0000 7f6194400640 1 --2- 172.21.15.110:0/1703175176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c074e30 0x7f618c10df00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6178009900 tx=0x7f617802a480 comp rx=0 tx=0).stop 2024-09-12T02:14:10.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.877+0000 7f6194400640 1 -- 172.21.15.110:0/1703175176 shutdown_connections 2024-09-12T02:14:10.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.877+0000 7f6194400640 1 --2- 172.21.15.110:0/1703175176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f618c10e440 0x7f618c110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:10.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.877+0000 7f6194400640 1 --2- 172.21.15.110:0/1703175176 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c074e30 0x7f618c10df00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:10.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.877+0000 7f6194400640 1 --2- 172.21.15.110:0/1703175176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f618c074510 0x7f618c0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:10.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.877+0000 7f6194400640 1 -- 172.21.15.110:0/1703175176 >> 172.21.15.110:0/1703175176 conn(0x7f618c0fd8c0 msgr2=0x7f618c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:10.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.877+0000 7f6194400640 1 -- 172.21.15.110:0/1703175176 shutdown_connections 2024-09-12T02:14:10.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.877+0000 7f6194400640 1 -- 172.21.15.110:0/1703175176 wait complete. 2024-09-12T02:14:10.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.878+0000 7f6194400640 1 Processor -- start 2024-09-12T02:14:10.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.878+0000 7f6194400640 1 -- start start 2024-09-12T02:14:10.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.879+0000 7f6194400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f618c074510 0x7f618c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:10.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.879+0000 7f6194400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c074e30 0x7f618c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:10.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.879+0000 7f6194400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f618c10e440 0x7f618c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:10.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.879+0000 7f6194400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f618c114190 con 0x7f618c074510 2024-09-12T02:14:10.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.879+0000 7f6194400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f618c114010 con 0x7f618c074e30 2024-09-12T02:14:10.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.879+0000 7f6194400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f618c114310 con 0x7f618c10e440 2024-09-12T02:14:10.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.879+0000 7f6191000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c074e30 0x7f618c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:10.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.879+0000 7f6191a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f618c074510 0x7f618c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:10.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.879+0000 7f6191000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c074e30 0x7f618c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:34216/0 (socket says 172.21.15.110:34216) 2024-09-12T02:14:10.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.879+0000 7f6191000640 1 -- 172.21.15.110:0/225167487 learned_addr learned my addr 172.21.15.110:0/225167487 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:10.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.879+0000 7f6192400640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f618c10e440 0x7f618c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.880+0000 7f6191000640 1 -- 172.21.15.110:0/225167487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f618c10e440 msgr2=0x7f618c19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.880+0000 7f6191000640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f618c10e440 0x7f618c19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.880+0000 7f6191000640 1 -- 172.21.15.110:0/225167487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f618c074510 msgr2=0x7f618c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.880+0000 7f6191000640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f618c074510 0x7f618c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.880+0000 7f6191000640 1 -- 172.21.15.110:0/225167487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c19f660 con 0x7f618c074e30 2024-09-12T02:14:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.880+0000 7f6192400640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f618c10e440 0x7f618c19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.880+0000 7f6191000640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c074e30 0x7f618c19abf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6178004770 tx=0x7f6178003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.880+0000 7f618a000640 1 -- 172.21.15.110:0/225167487 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617803f070 con 0x7f618c074e30 2024-09-12T02:14:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.880+0000 7f618a000640 1 -- 172.21.15.110:0/225167487 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6178031ca0 con 0x7f618c074e30 2024-09-12T02:14:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.880+0000 7f6194400640 1 -- 172.21.15.110:0/225167487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c19f8f0 con 0x7f618c074e30 2024-09-12T02:14:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.880+0000 7f6194400640 1 -- 172.21.15.110:0/225167487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c1a7230 con 0x7f618c074e30 2024-09-12T02:14:10.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.880+0000 7f618a000640 1 -- 172.21.15.110:0/225167487 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178035030 con 0x7f618c074e30 2024-09-12T02:14:10.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.882+0000 7f6194400640 1 -- 172.21.15.110:0/225167487 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618c0748f0 con 0x7f618c074e30 2024-09-12T02:14:10.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.885+0000 7f618a000640 1 -- 172.21.15.110:0/225167487 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6178042070 con 0x7f618c074e30 2024-09-12T02:14:10.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.886+0000 7f618a000640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f61740a2c90 0x7f61740a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:10.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.886+0000 7f618a000640 1 -- 172.21.15.110:0/225167487 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f61780efb80 con 0x7f618c074e30 2024-09-12T02:14:10.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.886+0000 7f6191a00640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f61740a2c90 0x7f61740a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:10.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.887+0000 7f6191a00640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f61740a2c90 0x7f61740a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6180009bd0 tx=0x7f6180005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:10.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:10.890+0000 7f618a000640 1 -- 172.21.15.110:0/225167487 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f61780bc6a0 con 0x7f618c074e30 2024-09-12T02:14:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:10 smithi136 ceph-mon[35814]: from='client.24935 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:14:10.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:10 smithi136 ceph-mon[35814]: pgmap v369: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:11.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:10 smithi115 ceph-mon[35351]: from='client.24935 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:14:11.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:10 smithi115 ceph-mon[35351]: pgmap v369: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:11.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.068+0000 7f6194400640 1 -- 172.21.15.110:0/225167487 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f618c062630 con 0x7f61740a2c90 2024-09-12T02:14:11.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.081+0000 7f618a000640 1 -- 172.21.15.110:0/225167487 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340368 (secure 0 0 0) 0x7f618c062630 con 0x7f61740a2c90 2024-09-12T02:14:11.087 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:11.089 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-09-12T02:14:11.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.087+0000 7f6194400640 1 -- 172.21.15.110:0/225167487 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f61740a2c90 msgr2=0x7f61740a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.087+0000 7f6194400640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f61740a2c90 0x7f61740a5150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6180009bd0 tx=0x7f6180005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.087+0000 7f6194400640 1 -- 172.21.15.110:0/225167487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c074e30 msgr2=0x7f618c19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.087+0000 7f6194400640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c074e30 0x7f618c19abf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6178004770 tx=0x7f6178003c10 comp rx=0 tx=0).stop 2024-09-12T02:14:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.087+0000 7f6194400640 1 -- 172.21.15.110:0/225167487 shutdown_connections 2024-09-12T02:14:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.087+0000 7f6194400640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f61740a2c90 0x7f61740a5150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.087+0000 7f6194400640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f618c10e440 0x7f618c19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.087+0000 7f6194400640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f618c074e30 0x7f618c19abf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.087+0000 7f6194400640 1 --2- 172.21.15.110:0/225167487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f618c074510 0x7f618c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.087+0000 7f6194400640 1 -- 172.21.15.110:0/225167487 >> 172.21.15.110:0/225167487 conn(0x7f618c0fd8c0 msgr2=0x7f618c0fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.087+0000 7f6194400640 1 -- 172.21.15.110:0/225167487 shutdown_connections 2024-09-12T02:14:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:11.087+0000 7f6194400640 1 -- 172.21.15.110:0/225167487 wait complete. 2024-09-12T02:14:11.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:11 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:14:11.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:11 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:14:11.934 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:11 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:14:11.974 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-12T02:14:09.477676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658745,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":554,"num_read_kb":399,"num_write":351,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":282,"ondisk_log_size":282,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":393592,"kb_used_data":15152,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124548232,"statfs":{"total":1151940427776,"available":1151537389568,"internally_reserved":0,"allocated":15515648,"data_stored":8638097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":387233082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003144"},"pg_stats":[{"pgid":"2.1f","version":"95'9","reported_seq":54,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690330+0000","last_change":"2024-09-12T02:12:09.666492+0000","last_active":"2024-09-12T02:13:46.690330+0000","last_peered":"2024-09-12T02:13:46.690330+0000","last_clean":"2024-09-12T02:13:46.690330+0000","last_became_active":"2024-09-12T02:12:09.666198+0000","last_became_peered":"2024-09-12T02:12:09.666198+0000","last_unstale":"2024-09-12T02:13:46.690330+0000","last_undegraded":"2024-09-12T02:13:46.690330+0000","last_fullsized":"2024-09-12T02:13:46.690330+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:01.779452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851931+0000","last_change":"2024-09-12T02:12:12.695888+0000","last_active":"2024-09-12T02:13:46.851931+0000","last_peered":"2024-09-12T02:13:46.851931+0000","last_clean":"2024-09-12T02:13:46.851931+0000","last_became_active":"2024-09-12T02:12:12.695065+0000","last_became_peered":"2024-09-12T02:12:12.695065+0000","last_unstale":"2024-09-12T02:13:46.851931+0000","last_undegraded":"2024-09-12T02:13:46.851931+0000","last_fullsized":"2024-09-12T02:13:46.851931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:09.799039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690478+0000","last_change":"2024-09-12T02:12:22.738585+0000","last_active":"2024-09-12T02:13:46.690478+0000","last_peered":"2024-09-12T02:13:46.690478+0000","last_clean":"2024-09-12T02:13:46.690478+0000","last_became_active":"2024-09-12T02:12:22.738174+0000","last_became_peered":"2024-09-12T02:12:22.738174+0000","last_unstale":"2024-09-12T02:13:46.690478+0000","last_undegraded":"2024-09-12T02:13:46.690478+0000","last_fullsized":"2024-09-12T02:13:46.690478+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:00.875256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"95'2","reported_seq":45,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852143+0000","last_change":"2024-09-12T02:12:09.735005+0000","last_active":"2024-09-12T02:13:46.852143+0000","last_peered":"2024-09-12T02:13:46.852143+0000","last_clean":"2024-09-12T02:13:46.852143+0000","last_became_active":"2024-09-12T02:12:09.734590+0000","last_became_peered":"2024-09-12T02:12:09.734590+0000","last_unstale":"2024-09-12T02:13:46.852143+0000","last_undegraded":"2024-09-12T02:13:46.852143+0000","last_fullsized":"2024-09-12T02:13:46.852143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:17.079183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852572+0000","last_change":"2024-09-12T02:12:12.692688+0000","last_active":"2024-09-12T02:13:46.852572+0000","last_peered":"2024-09-12T02:13:46.852572+0000","last_clean":"2024-09-12T02:13:46.852572+0000","last_became_active":"2024-09-12T02:12:12.692252+0000","last_became_peered":"2024-09-12T02:12:12.692252+0000","last_unstale":"2024-09-12T02:13:46.852572+0000","last_undegraded":"2024-09-12T02:13:46.852572+0000","last_fullsized":"2024-09-12T02:13:46.852572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:40.757986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690131+0000","last_change":"2024-09-12T02:12:22.738074+0000","last_active":"2024-09-12T02:13:46.690131+0000","last_peered":"2024-09-12T02:13:46.690131+0000","last_clean":"2024-09-12T02:13:46.690131+0000","last_became_active":"2024-09-12T02:12:22.737692+0000","last_became_peered":"2024-09-12T02:12:22.737692+0000","last_unstale":"2024-09-12T02:13:46.690131+0000","last_undegraded":"2024-09-12T02:13:46.690131+0000","last_fullsized":"2024-09-12T02:13:46.690131+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:04.003426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"95'4","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852823+0000","last_change":"2024-09-12T02:12:09.670228+0000","last_active":"2024-09-12T02:13:46.852823+0000","last_peered":"2024-09-12T02:13:46.852823+0000","last_clean":"2024-09-12T02:13:46.852823+0000","last_became_active":"2024-09-12T02:12:09.669517+0000","last_became_peered":"2024-09-12T02:12:09.669517+0000","last_unstale":"2024-09-12T02:13:46.852823+0000","last_undegraded":"2024-09-12T02:13:46.852823+0000","last_fullsized":"2024-09-12T02:13:46.852823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:49.547787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693430+0000","last_change":"2024-09-12T02:12:12.693797+0000","last_active":"2024-09-12T02:13:46.693430+0000","last_peered":"2024-09-12T02:13:46.693430+0000","last_clean":"2024-09-12T02:13:46.693430+0000","last_became_active":"2024-09-12T02:12:12.692757+0000","last_became_peered":"2024-09-12T02:12:12.692757+0000","last_unstale":"2024-09-12T02:13:46.693430+0000","last_undegraded":"2024-09-12T02:13:46.693430+0000","last_fullsized":"2024-09-12T02:13:46.693430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:04.738832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690440+0000","last_change":"2024-09-12T02:12:22.742804+0000","last_active":"2024-09-12T02:13:46.690440+0000","last_peered":"2024-09-12T02:13:46.690440+0000","last_clean":"2024-09-12T02:13:46.690440+0000","last_became_active":"2024-09-12T02:12:22.742478+0000","last_became_peered":"2024-09-12T02:12:22.742478+0000","last_unstale":"2024-09-12T02:13:46.690440+0000","last_undegraded":"2024-09-12T02:13:46.690440+0000","last_fullsized":"2024-09-12T02:13:46.690440+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:25.406069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'2","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852426+0000","last_change":"2024-09-12T02:12:09.669360+0000","last_active":"2024-09-12T02:13:46.852426+0000","last_peered":"2024-09-12T02:13:46.852426+0000","last_clean":"2024-09-12T02:13:46.852426+0000","last_became_active":"2024-09-12T02:12:09.668908+0000","last_became_peered":"2024-09-12T02:12:09.668908+0000","last_unstale":"2024-09-12T02:13:46.852426+0000","last_undegraded":"2024-09-12T02:13:46.852426+0000","last_fullsized":"2024-09-12T02:13:46.852426+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:48.253463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853791+0000","last_change":"2024-09-12T02:12:46.542028+0000","last_active":"2024-09-12T02:13:46.853791+0000","last_peered":"2024-09-12T02:13:46.853791+0000","last_clean":"2024-09-12T02:13:46.853791+0000","last_became_active":"2024-09-12T02:12:46.541630+0000","last_became_peered":"2024-09-12T02:12:46.541630+0000","last_unstale":"2024-09-12T02:13:46.853791+0000","last_undegraded":"2024-09-12T02:13:46.853791+0000","last_fullsized":"2024-09-12T02:13:46.853791+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:08.641424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690257+0000","last_change":"2024-09-12T02:12:22.738663+0000","last_active":"2024-09-12T02:13:46.690257+0000","last_peered":"2024-09-12T02:13:46.690257+0000","last_clean":"2024-09-12T02:13:46.690257+0000","last_became_active":"2024-09-12T02:12:22.738280+0000","last_became_peered":"2024-09-12T02:12:22.738280+0000","last_unstale":"2024-09-12T02:13:46.690257+0000","last_undegraded":"2024-09-12T02:13:46.690257+0000","last_fullsized":"2024-09-12T02:13:46.690257+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:44.271539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851669+0000","last_change":"2024-09-12T02:12:12.687131+0000","last_active":"2024-09-12T02:13:46.851669+0000","last_peered":"2024-09-12T02:13:46.851669+0000","last_clean":"2024-09-12T02:13:46.851669+0000","last_became_active":"2024-09-12T02:12:12.686793+0000","last_became_peered":"2024-09-12T02:12:12.686793+0000","last_unstale":"2024-09-12T02:13:46.851669+0000","last_undegraded":"2024-09-12T02:13:46.851669+0000","last_fullsized":"2024-09-12T02:13:46.851669+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:58.370130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"95'4","reported_seq":23,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852119+0000","last_change":"2024-09-12T02:12:46.550259+0000","last_active":"2024-09-12T02:13:46.852119+0000","last_peered":"2024-09-12T02:13:46.852119+0000","last_clean":"2024-09-12T02:13:46.852119+0000","last_became_active":"2024-09-12T02:12:46.543047+0000","last_became_peered":"2024-09-12T02:12:46.543047+0000","last_unstale":"2024-09-12T02:13:46.852119+0000","last_undegraded":"2024-09-12T02:13:46.852119+0000","last_fullsized":"2024-09-12T02:13:46.852119+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:04.359689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690623+0000","last_change":"2024-09-12T02:12:23.023792+0000","last_active":"2024-09-12T02:13:46.690623+0000","last_peered":"2024-09-12T02:13:46.690623+0000","last_clean":"2024-09-12T02:13:46.690623+0000","last_became_active":"2024-09-12T02:12:23.023337+0000","last_became_peered":"2024-09-12T02:12:23.023337+0000","last_unstale":"2024-09-12T02:13:46.690623+0000","last_undegraded":"2024-09-12T02:13:46.690623+0000","last_fullsized":"2024-09-12T02:13:46.690623+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:01.859092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851789+0000","last_change":"2024-09-12T02:12:12.683615+0000","last_active":"2024-09-12T02:13:46.851789+0000","last_peered":"2024-09-12T02:13:46.851789+0000","last_clean":"2024-09-12T02:13:46.851789+0000","last_became_active":"2024-09-12T02:12:12.683279+0000","last_became_peered":"2024-09-12T02:12:12.683279+0000","last_unstale":"2024-09-12T02:13:46.851789+0000","last_undegraded":"2024-09-12T02:13:46.851789+0000","last_fullsized":"2024-09-12T02:13:46.851789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:10.819995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"95'1","reported_seq":45,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690664+0000","last_change":"2024-09-12T02:12:09.667600+0000","last_active":"2024-09-12T02:13:46.690664+0000","last_peered":"2024-09-12T02:13:46.690664+0000","last_clean":"2024-09-12T02:13:46.690664+0000","last_became_active":"2024-09-12T02:12:09.666053+0000","last_became_peered":"2024-09-12T02:12:09.666053+0000","last_unstale":"2024-09-12T02:13:46.690664+0000","last_undegraded":"2024-09-12T02:13:46.690664+0000","last_fullsized":"2024-09-12T02:13:46.690664+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:01.597906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"95'1","reported_seq":29,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690729+0000","last_change":"2024-09-12T02:12:22.748946+0000","last_active":"2024-09-12T02:13:46.690729+0000","last_peered":"2024-09-12T02:13:46.690729+0000","last_clean":"2024-09-12T02:13:46.690729+0000","last_became_active":"2024-09-12T02:12:22.748163+0000","last_became_peered":"2024-09-12T02:12:22.748163+0000","last_unstale":"2024-09-12T02:13:46.690729+0000","last_undegraded":"2024-09-12T02:13:46.690729+0000","last_fullsized":"2024-09-12T02:13:46.690729+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:49.560905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851904+0000","last_change":"2024-09-12T02:12:12.692275+0000","last_active":"2024-09-12T02:13:46.851904+0000","last_peered":"2024-09-12T02:13:46.851904+0000","last_clean":"2024-09-12T02:13:46.851904+0000","last_became_active":"2024-09-12T02:12:12.691932+0000","last_became_peered":"2024-09-12T02:12:12.691932+0000","last_unstale":"2024-09-12T02:13:46.851904+0000","last_undegraded":"2024-09-12T02:13:46.851904+0000","last_fullsized":"2024-09-12T02:13:46.851904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:01.922677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"95'3","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852215+0000","last_change":"2024-09-12T02:12:09.665190+0000","last_active":"2024-09-12T02:13:46.852215+0000","last_peered":"2024-09-12T02:13:46.852215+0000","last_clean":"2024-09-12T02:13:46.852215+0000","last_became_active":"2024-09-12T02:12:09.664805+0000","last_became_peered":"2024-09-12T02:12:09.664805+0000","last_unstale":"2024-09-12T02:13:46.852215+0000","last_undegraded":"2024-09-12T02:13:46.852215+0000","last_fullsized":"2024-09-12T02:13:46.852215+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:41.770072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690043+0000","last_change":"2024-09-12T02:12:22.744555+0000","last_active":"2024-09-12T02:13:46.690043+0000","last_peered":"2024-09-12T02:13:46.690043+0000","last_clean":"2024-09-12T02:13:46.690043+0000","last_became_active":"2024-09-12T02:12:22.742530+0000","last_became_peered":"2024-09-12T02:12:22.742530+0000","last_unstale":"2024-09-12T02:13:46.690043+0000","last_undegraded":"2024-09-12T02:13:46.690043+0000","last_fullsized":"2024-09-12T02:13:46.690043+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:45.737376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852140+0000","last_change":"2024-09-12T02:12:12.681891+0000","last_active":"2024-09-12T02:13:46.852140+0000","last_peered":"2024-09-12T02:13:46.852140+0000","last_clean":"2024-09-12T02:13:46.852140+0000","last_became_active":"2024-09-12T02:12:12.681522+0000","last_became_peered":"2024-09-12T02:12:12.681522+0000","last_unstale":"2024-09-12T02:13:46.852140+0000","last_undegraded":"2024-09-12T02:13:46.852140+0000","last_fullsized":"2024-09-12T02:13:46.852140+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:04.363251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"95'2","reported_seq":45,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693272+0000","last_change":"2024-09-12T02:12:09.735407+0000","last_active":"2024-09-12T02:13:46.693272+0000","last_peered":"2024-09-12T02:13:46.693272+0000","last_clean":"2024-09-12T02:13:46.693272+0000","last_became_active":"2024-09-12T02:12:09.735010+0000","last_became_peered":"2024-09-12T02:12:09.735010+0000","last_unstale":"2024-09-12T02:13:46.693272+0000","last_undegraded":"2024-09-12T02:13:46.693272+0000","last_fullsized":"2024-09-12T02:13:46.693272+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:19.457664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":35,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690692+0000","last_change":"2024-09-12T02:12:46.948014+0000","last_active":"2024-09-12T02:13:46.690692+0000","last_peered":"2024-09-12T02:13:46.690692+0000","last_clean":"2024-09-12T02:13:46.690692+0000","last_became_active":"2024-09-12T02:12:46.947557+0000","last_became_peered":"2024-09-12T02:12:46.947557+0000","last_unstale":"2024-09-12T02:13:46.690692+0000","last_undegraded":"2024-09-12T02:13:46.690692+0000","last_fullsized":"2024-09-12T02:13:46.690692+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:25.012171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853136+0000","last_change":"2024-09-12T02:12:12.691186+0000","last_active":"2024-09-12T02:13:46.853136+0000","last_peered":"2024-09-12T02:13:46.853136+0000","last_clean":"2024-09-12T02:13:46.853136+0000","last_became_active":"2024-09-12T02:12:12.690861+0000","last_became_peered":"2024-09-12T02:12:12.690861+0000","last_unstale":"2024-09-12T02:13:46.853136+0000","last_undegraded":"2024-09-12T02:13:46.853136+0000","last_fullsized":"2024-09-12T02:13:46.853136+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:07.126197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"95'4","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.691040+0000","last_change":"2024-09-12T02:12:09.665891+0000","last_active":"2024-09-12T02:13:46.691040+0000","last_peered":"2024-09-12T02:13:46.691040+0000","last_clean":"2024-09-12T02:13:46.691040+0000","last_became_active":"2024-09-12T02:12:09.665474+0000","last_became_peered":"2024-09-12T02:12:09.665474+0000","last_unstale":"2024-09-12T02:13:46.691040+0000","last_undegraded":"2024-09-12T02:13:46.691040+0000","last_fullsized":"2024-09-12T02:13:46.691040+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:48.118918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690733+0000","last_change":"2024-09-12T02:12:22.732360+0000","last_active":"2024-09-12T02:13:46.690733+0000","last_peered":"2024-09-12T02:13:46.690733+0000","last_clean":"2024-09-12T02:13:46.690733+0000","last_became_active":"2024-09-12T02:12:22.731908+0000","last_became_peered":"2024-09-12T02:12:22.731908+0000","last_unstale":"2024-09-12T02:13:46.690733+0000","last_undegraded":"2024-09-12T02:13:46.690733+0000","last_fullsized":"2024-09-12T02:13:46.690733+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:25.918921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852641+0000","last_change":"2024-09-12T02:12:12.683478+0000","last_active":"2024-09-12T02:13:46.852641+0000","last_peered":"2024-09-12T02:13:46.852641+0000","last_clean":"2024-09-12T02:13:46.852641+0000","last_became_active":"2024-09-12T02:12:12.683112+0000","last_became_peered":"2024-09-12T02:12:12.683112+0000","last_unstale":"2024-09-12T02:13:46.852641+0000","last_undegraded":"2024-09-12T02:13:46.852641+0000","last_fullsized":"2024-09-12T02:13:46.852641+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:54.092216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'11","reported_seq":55,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.689973+0000","last_change":"2024-09-12T02:12:09.665209+0000","last_active":"2024-09-12T02:13:46.689973+0000","last_peered":"2024-09-12T02:13:46.689973+0000","last_clean":"2024-09-12T02:13:46.689973+0000","last_became_active":"2024-09-12T02:12:09.664849+0000","last_became_peered":"2024-09-12T02:12:09.664849+0000","last_unstale":"2024-09-12T02:13:46.689973+0000","last_undegraded":"2024-09-12T02:13:46.689973+0000","last_fullsized":"2024-09-12T02:13:46.689973+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:31.415245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852420+0000","last_change":"2024-09-12T02:12:23.024293+0000","last_active":"2024-09-12T02:13:46.852420+0000","last_peered":"2024-09-12T02:13:46.852420+0000","last_clean":"2024-09-12T02:13:46.852420+0000","last_became_active":"2024-09-12T02:12:23.022939+0000","last_became_peered":"2024-09-12T02:12:23.022939+0000","last_unstale":"2024-09-12T02:13:46.852420+0000","last_undegraded":"2024-09-12T02:13:46.852420+0000","last_fullsized":"2024-09-12T02:13:46.852420+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:17.425084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693155+0000","last_change":"2024-09-12T02:12:12.696102+0000","last_active":"2024-09-12T02:13:46.693155+0000","last_peered":"2024-09-12T02:13:46.693155+0000","last_clean":"2024-09-12T02:13:46.693155+0000","last_became_active":"2024-09-12T02:12:12.695789+0000","last_became_peered":"2024-09-12T02:12:12.695789+0000","last_unstale":"2024-09-12T02:13:46.693155+0000","last_undegraded":"2024-09-12T02:13:46.693155+0000","last_fullsized":"2024-09-12T02:13:46.693155+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:07.674070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"95'1","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852818+0000","last_change":"2024-09-12T02:12:09.736807+0000","last_active":"2024-09-12T02:13:46.852818+0000","last_peered":"2024-09-12T02:13:46.852818+0000","last_clean":"2024-09-12T02:13:46.852818+0000","last_became_active":"2024-09-12T02:12:09.736351+0000","last_became_peered":"2024-09-12T02:12:09.736351+0000","last_unstale":"2024-09-12T02:13:46.852818+0000","last_undegraded":"2024-09-12T02:13:46.852818+0000","last_fullsized":"2024-09-12T02:13:46.852818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:14.228251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852192+0000","last_change":"2024-09-12T02:12:22.738679+0000","last_active":"2024-09-12T02:13:46.852192+0000","last_peered":"2024-09-12T02:13:46.852192+0000","last_clean":"2024-09-12T02:13:46.852192+0000","last_became_active":"2024-09-12T02:12:22.738221+0000","last_became_peered":"2024-09-12T02:12:22.738221+0000","last_unstale":"2024-09-12T02:13:46.852192+0000","last_undegraded":"2024-09-12T02:13:46.852192+0000","last_fullsized":"2024-09-12T02:13:46.852192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:41.143026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851711+0000","last_change":"2024-09-12T02:12:12.685853+0000","last_active":"2024-09-12T02:13:46.851711+0000","last_peered":"2024-09-12T02:13:46.851711+0000","last_clean":"2024-09-12T02:13:46.851711+0000","last_became_active":"2024-09-12T02:12:12.685537+0000","last_became_peered":"2024-09-12T02:12:12.685537+0000","last_unstale":"2024-09-12T02:13:46.851711+0000","last_undegraded":"2024-09-12T02:13:46.851711+0000","last_fullsized":"2024-09-12T02:13:46.851711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:57:01.159056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.689902+0000","last_change":"2024-09-12T02:12:09.736953+0000","last_active":"2024-09-12T02:13:46.689902+0000","last_peered":"2024-09-12T02:13:46.689902+0000","last_clean":"2024-09-12T02:13:46.689902+0000","last_became_active":"2024-09-12T02:12:09.736584+0000","last_became_peered":"2024-09-12T02:12:09.736584+0000","last_unstale":"2024-09-12T02:13:46.689902+0000","last_undegraded":"2024-09-12T02:13:46.689902+0000","last_fullsized":"2024-09-12T02:13:46.689902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:26.923372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852320+0000","last_change":"2024-09-12T02:12:23.023892+0000","last_active":"2024-09-12T02:13:46.852320+0000","last_peered":"2024-09-12T02:13:46.852320+0000","last_clean":"2024-09-12T02:13:46.852320+0000","last_became_active":"2024-09-12T02:12:23.023377+0000","last_became_peered":"2024-09-12T02:12:23.023377+0000","last_unstale":"2024-09-12T02:13:46.852320+0000","last_undegraded":"2024-09-12T02:13:46.852320+0000","last_fullsized":"2024-09-12T02:13:46.852320+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:06.944269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851485+0000","last_change":"2024-09-12T02:12:12.680026+0000","last_active":"2024-09-12T02:13:46.851485+0000","last_peered":"2024-09-12T02:13:46.851485+0000","last_clean":"2024-09-12T02:13:46.851485+0000","last_became_active":"2024-09-12T02:12:12.679683+0000","last_became_peered":"2024-09-12T02:12:12.679683+0000","last_unstale":"2024-09-12T02:13:46.851485+0000","last_undegraded":"2024-09-12T02:13:46.851485+0000","last_fullsized":"2024-09-12T02:13:46.851485+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:10.911026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"95'1","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851851+0000","last_change":"2024-09-12T02:12:09.666246+0000","last_active":"2024-09-12T02:13:46.851851+0000","last_peered":"2024-09-12T02:13:46.851851+0000","last_clean":"2024-09-12T02:13:46.851851+0000","last_became_active":"2024-09-12T02:12:09.665095+0000","last_became_peered":"2024-09-12T02:12:09.665095+0000","last_unstale":"2024-09-12T02:13:46.851851+0000","last_undegraded":"2024-09-12T02:13:46.851851+0000","last_fullsized":"2024-09-12T02:13:46.851851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:40.468381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693049+0000","last_change":"2024-09-12T02:12:22.739778+0000","last_active":"2024-09-12T02:13:46.693049+0000","last_peered":"2024-09-12T02:13:46.693049+0000","last_clean":"2024-09-12T02:13:46.693049+0000","last_became_active":"2024-09-12T02:12:22.739402+0000","last_became_peered":"2024-09-12T02:12:22.739402+0000","last_unstale":"2024-09-12T02:13:46.693049+0000","last_undegraded":"2024-09-12T02:13:46.693049+0000","last_fullsized":"2024-09-12T02:13:46.693049+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:10.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853258+0000","last_change":"2024-09-12T02:12:12.686121+0000","last_active":"2024-09-12T02:13:46.853258+0000","last_peered":"2024-09-12T02:13:46.853258+0000","last_clean":"2024-09-12T02:13:46.853258+0000","last_became_active":"2024-09-12T02:12:12.682209+0000","last_became_peered":"2024-09-12T02:12:12.682209+0000","last_unstale":"2024-09-12T02:13:46.853258+0000","last_undegraded":"2024-09-12T02:13:46.853258+0000","last_fullsized":"2024-09-12T02:13:46.853258+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:28.068552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"95'4","reported_seq":113,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:14:05.702286+0000","last_change":"2024-09-12T02:12:09.736820+0000","last_active":"2024-09-12T02:14:05.702286+0000","last_peered":"2024-09-12T02:14:05.702286+0000","last_clean":"2024-09-12T02:14:05.702286+0000","last_became_active":"2024-09-12T02:12:09.736472+0000","last_became_peered":"2024-09-12T02:12:09.736472+0000","last_unstale":"2024-09-12T02:14:05.702286+0000","last_undegraded":"2024-09-12T02:14:05.702286+0000","last_fullsized":"2024-09-12T02:14:05.702286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:37.753089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692828+0000","last_change":"2024-09-12T02:12:23.024329+0000","last_active":"2024-09-12T02:13:46.692828+0000","last_peered":"2024-09-12T02:13:46.692828+0000","last_clean":"2024-09-12T02:13:46.692828+0000","last_became_active":"2024-09-12T02:12:23.023494+0000","last_became_peered":"2024-09-12T02:12:23.023494+0000","last_unstale":"2024-09-12T02:13:46.692828+0000","last_undegraded":"2024-09-12T02:13:46.692828+0000","last_fullsized":"2024-09-12T02:13:46.692828+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:56.650693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692472+0000","last_change":"2024-09-12T02:12:12.687520+0000","last_active":"2024-09-12T02:13:46.692472+0000","last_peered":"2024-09-12T02:13:46.692472+0000","last_clean":"2024-09-12T02:13:46.692472+0000","last_became_active":"2024-09-12T02:12:12.687147+0000","last_became_peered":"2024-09-12T02:12:12.687147+0000","last_unstale":"2024-09-12T02:13:46.692472+0000","last_undegraded":"2024-09-12T02:13:46.692472+0000","last_fullsized":"2024-09-12T02:13:46.692472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:40.391396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"95'3","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851320+0000","last_change":"2024-09-12T02:12:09.668841+0000","last_active":"2024-09-12T02:13:46.851320+0000","last_peered":"2024-09-12T02:13:46.851320+0000","last_clean":"2024-09-12T02:13:46.851320+0000","last_became_active":"2024-09-12T02:12:09.668488+0000","last_became_peered":"2024-09-12T02:12:09.668488+0000","last_unstale":"2024-09-12T02:13:46.851320+0000","last_undegraded":"2024-09-12T02:13:46.851320+0000","last_fullsized":"2024-09-12T02:13:46.851320+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:28.259068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853333+0000","last_change":"2024-09-12T02:12:23.023804+0000","last_active":"2024-09-12T02:13:46.853333+0000","last_peered":"2024-09-12T02:13:46.853333+0000","last_clean":"2024-09-12T02:13:46.853333+0000","last_became_active":"2024-09-12T02:12:23.023331+0000","last_became_peered":"2024-09-12T02:12:23.023331+0000","last_unstale":"2024-09-12T02:13:46.853333+0000","last_undegraded":"2024-09-12T02:13:46.853333+0000","last_fullsized":"2024-09-12T02:13:46.853333+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:50.133965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852420+0000","last_change":"2024-09-12T02:12:12.695881+0000","last_active":"2024-09-12T02:13:46.852420+0000","last_peered":"2024-09-12T02:13:46.852420+0000","last_clean":"2024-09-12T02:13:46.852420+0000","last_became_active":"2024-09-12T02:12:12.695321+0000","last_became_peered":"2024-09-12T02:12:12.695321+0000","last_unstale":"2024-09-12T02:13:46.852420+0000","last_undegraded":"2024-09-12T02:13:46.852420+0000","last_fullsized":"2024-09-12T02:13:46.852420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:24.938014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"95'3","reported_seq":49,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690846+0000","last_change":"2024-09-12T02:12:09.667252+0000","last_active":"2024-09-12T02:13:46.690846+0000","last_peered":"2024-09-12T02:13:46.690846+0000","last_clean":"2024-09-12T02:13:46.690846+0000","last_became_active":"2024-09-12T02:12:09.666892+0000","last_became_peered":"2024-09-12T02:12:09.666892+0000","last_unstale":"2024-09-12T02:13:46.690846+0000","last_undegraded":"2024-09-12T02:13:46.690846+0000","last_fullsized":"2024-09-12T02:13:46.690846+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:52.390469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":369,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851492+0000","last_change":"2024-09-12T02:10:50.611240+0000","last_active":"2024-09-12T02:13:46.851492+0000","last_peered":"2024-09-12T02:13:46.851492+0000","last_clean":"2024-09-12T02:13:46.851492+0000","last_became_active":"2024-09-12T02:10:50.610769+0000","last_became_peered":"2024-09-12T02:10:50.610769+0000","last_unstale":"2024-09-12T02:13:46.851492+0000","last_undegraded":"2024-09-12T02:13:46.851492+0000","last_fullsized":"2024-09-12T02:13:46.851492+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:07:07.996202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:07:07.996202+0000","last_clean_scrub_stamp":"2024-09-12T02:07:07.996202+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:40.113749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"95'1","reported_seq":29,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851563+0000","last_change":"2024-09-12T02:12:22.734156+0000","last_active":"2024-09-12T02:13:46.851563+0000","last_peered":"2024-09-12T02:13:46.851563+0000","last_clean":"2024-09-12T02:13:46.851563+0000","last_became_active":"2024-09-12T02:12:22.733679+0000","last_became_peered":"2024-09-12T02:12:22.733679+0000","last_unstale":"2024-09-12T02:13:46.851563+0000","last_undegraded":"2024-09-12T02:13:46.851563+0000","last_fullsized":"2024-09-12T02:13:46.851563+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:38.764902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851830+0000","last_change":"2024-09-12T02:12:12.686957+0000","last_active":"2024-09-12T02:13:46.851830+0000","last_peered":"2024-09-12T02:13:46.851830+0000","last_clean":"2024-09-12T02:13:46.851830+0000","last_became_active":"2024-09-12T02:12:12.686160+0000","last_became_peered":"2024-09-12T02:12:12.686160+0000","last_unstale":"2024-09-12T02:13:46.851830+0000","last_undegraded":"2024-09-12T02:13:46.851830+0000","last_fullsized":"2024-09-12T02:13:46.851830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:29.390487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"95'3","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.691174+0000","last_change":"2024-09-12T02:12:09.737061+0000","last_active":"2024-09-12T02:13:46.691174+0000","last_peered":"2024-09-12T02:13:46.691174+0000","last_clean":"2024-09-12T02:13:46.691174+0000","last_became_active":"2024-09-12T02:12:09.736550+0000","last_became_peered":"2024-09-12T02:12:09.736550+0000","last_unstale":"2024-09-12T02:13:46.691174+0000","last_undegraded":"2024-09-12T02:13:46.691174+0000","last_fullsized":"2024-09-12T02:13:46.691174+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:27.859724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693166+0000","last_change":"2024-09-12T02:12:22.734200+0000","last_active":"2024-09-12T02:13:46.693166+0000","last_peered":"2024-09-12T02:13:46.693166+0000","last_clean":"2024-09-12T02:13:46.693166+0000","last_became_active":"2024-09-12T02:12:22.733679+0000","last_became_peered":"2024-09-12T02:12:22.733679+0000","last_unstale":"2024-09-12T02:13:46.693166+0000","last_undegraded":"2024-09-12T02:13:46.693166+0000","last_fullsized":"2024-09-12T02:13:46.693166+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:33.308512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852161+0000","last_change":"2024-09-12T02:12:12.691852+0000","last_active":"2024-09-12T02:13:46.852161+0000","last_peered":"2024-09-12T02:13:46.852161+0000","last_clean":"2024-09-12T02:13:46.852161+0000","last_became_active":"2024-09-12T02:12:12.691461+0000","last_became_peered":"2024-09-12T02:12:12.691461+0000","last_unstale":"2024-09-12T02:13:46.852161+0000","last_undegraded":"2024-09-12T02:13:46.852161+0000","last_fullsized":"2024-09-12T02:13:46.852161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:28.587845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'1","reported_seq":45,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.854117+0000","last_change":"2024-09-12T02:12:09.668230+0000","last_active":"2024-09-12T02:13:46.854117+0000","last_peered":"2024-09-12T02:13:46.854117+0000","last_clean":"2024-09-12T02:13:46.854117+0000","last_became_active":"2024-09-12T02:12:09.667802+0000","last_became_peered":"2024-09-12T02:12:09.667802+0000","last_unstale":"2024-09-12T02:13:46.854117+0000","last_undegraded":"2024-09-12T02:13:46.854117+0000","last_fullsized":"2024-09-12T02:13:46.854117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:58.505854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852653+0000","last_change":"2024-09-12T02:12:22.743207+0000","last_active":"2024-09-12T02:13:46.852653+0000","last_peered":"2024-09-12T02:13:46.852653+0000","last_clean":"2024-09-12T02:13:46.852653+0000","last_became_active":"2024-09-12T02:12:22.742820+0000","last_became_peered":"2024-09-12T02:12:22.742820+0000","last_unstale":"2024-09-12T02:13:46.852653+0000","last_undegraded":"2024-09-12T02:13:46.852653+0000","last_fullsized":"2024-09-12T02:13:46.852653+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:09.469987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852162+0000","last_change":"2024-09-12T02:12:12.681966+0000","last_active":"2024-09-12T02:13:46.852162+0000","last_peered":"2024-09-12T02:13:46.852162+0000","last_clean":"2024-09-12T02:13:46.852162+0000","last_became_active":"2024-09-12T02:12:12.681603+0000","last_became_peered":"2024-09-12T02:12:12.681603+0000","last_unstale":"2024-09-12T02:13:46.852162+0000","last_undegraded":"2024-09-12T02:13:46.852162+0000","last_fullsized":"2024-09-12T02:13:46.852162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:51:00.236008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'2","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692986+0000","last_change":"2024-09-12T02:12:09.665620+0000","last_active":"2024-09-12T02:13:46.692986+0000","last_peered":"2024-09-12T02:13:46.692986+0000","last_clean":"2024-09-12T02:13:46.692986+0000","last_became_active":"2024-09-12T02:12:09.665306+0000","last_became_peered":"2024-09-12T02:12:09.665306+0000","last_unstale":"2024-09-12T02:13:46.692986+0000","last_undegraded":"2024-09-12T02:13:46.692986+0000","last_fullsized":"2024-09-12T02:13:46.692986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.910141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853094+0000","last_change":"2024-09-12T02:12:22.732559+0000","last_active":"2024-09-12T02:13:46.853094+0000","last_peered":"2024-09-12T02:13:46.853094+0000","last_clean":"2024-09-12T02:13:46.853094+0000","last_became_active":"2024-09-12T02:12:22.732005+0000","last_became_peered":"2024-09-12T02:12:22.732005+0000","last_unstale":"2024-09-12T02:13:46.853094+0000","last_undegraded":"2024-09-12T02:13:46.853094+0000","last_fullsized":"2024-09-12T02:13:46.853094+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:14.101574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852593+0000","last_change":"2024-09-12T02:12:12.689448+0000","last_active":"2024-09-12T02:13:46.852593+0000","last_peered":"2024-09-12T02:13:46.852593+0000","last_clean":"2024-09-12T02:13:46.852593+0000","last_became_active":"2024-09-12T02:12:12.689112+0000","last_became_peered":"2024-09-12T02:12:12.689112+0000","last_unstale":"2024-09-12T02:13:46.852593+0000","last_undegraded":"2024-09-12T02:13:46.852593+0000","last_fullsized":"2024-09-12T02:13:46.852593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.802911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"95'2","reported_seq":47,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852953+0000","last_change":"2024-09-12T02:12:09.666062+0000","last_active":"2024-09-12T02:13:46.852953+0000","last_peered":"2024-09-12T02:13:46.852953+0000","last_clean":"2024-09-12T02:13:46.852953+0000","last_became_active":"2024-09-12T02:12:09.665632+0000","last_became_peered":"2024-09-12T02:12:09.665632+0000","last_unstale":"2024-09-12T02:13:46.852953+0000","last_undegraded":"2024-09-12T02:13:46.852953+0000","last_fullsized":"2024-09-12T02:13:46.852953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:23.794505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853254+0000","last_change":"2024-09-12T02:12:22.733650+0000","last_active":"2024-09-12T02:13:46.853254+0000","last_peered":"2024-09-12T02:13:46.853254+0000","last_clean":"2024-09-12T02:13:46.853254+0000","last_became_active":"2024-09-12T02:12:22.733258+0000","last_became_peered":"2024-09-12T02:12:22.733258+0000","last_unstale":"2024-09-12T02:13:46.853254+0000","last_undegraded":"2024-09-12T02:13:46.853254+0000","last_fullsized":"2024-09-12T02:13:46.853254+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:56.885431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853605+0000","last_change":"2024-09-12T02:12:12.687166+0000","last_active":"2024-09-12T02:13:46.853605+0000","last_peered":"2024-09-12T02:13:46.853605+0000","last_clean":"2024-09-12T02:13:46.853605+0000","last_became_active":"2024-09-12T02:12:12.686646+0000","last_became_peered":"2024-09-12T02:12:12.686646+0000","last_unstale":"2024-09-12T02:13:46.853605+0000","last_undegraded":"2024-09-12T02:13:46.853605+0000","last_fullsized":"2024-09-12T02:13:46.853605+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:13.038063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"95'15","reported_seq":33,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851763+0000","last_change":"2024-09-12T02:12:46.547259+0000","last_active":"2024-09-12T02:13:46.851763+0000","last_peered":"2024-09-12T02:13:46.851763+0000","last_clean":"2024-09-12T02:13:46.851763+0000","last_became_active":"2024-09-12T02:12:46.540288+0000","last_became_peered":"2024-09-12T02:12:46.540288+0000","last_unstale":"2024-09-12T02:13:46.851763+0000","last_undegraded":"2024-09-12T02:13:46.851763+0000","last_fullsized":"2024-09-12T02:13:46.851763+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:10.251191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692936+0000","last_change":"2024-09-12T02:12:22.745382+0000","last_active":"2024-09-12T02:13:46.692936+0000","last_peered":"2024-09-12T02:13:46.692936+0000","last_clean":"2024-09-12T02:13:46.692936+0000","last_became_active":"2024-09-12T02:12:22.740850+0000","last_became_peered":"2024-09-12T02:12:22.740850+0000","last_unstale":"2024-09-12T02:13:46.692936+0000","last_undegraded":"2024-09-12T02:13:46.692936+0000","last_fullsized":"2024-09-12T02:13:46.692936+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:40.207459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851196+0000","last_change":"2024-09-12T02:12:12.692745+0000","last_active":"2024-09-12T02:13:46.851196+0000","last_peered":"2024-09-12T02:13:46.851196+0000","last_clean":"2024-09-12T02:13:46.851196+0000","last_became_active":"2024-09-12T02:12:12.692213+0000","last_became_peered":"2024-09-12T02:12:12.692213+0000","last_unstale":"2024-09-12T02:13:46.851196+0000","last_undegraded":"2024-09-12T02:13:46.851196+0000","last_fullsized":"2024-09-12T02:13:46.851196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:11.869094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"95'3","reported_seq":113,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:14:04.701534+0000","last_change":"2024-09-12T02:12:09.668239+0000","last_active":"2024-09-12T02:14:04.701534+0000","last_peered":"2024-09-12T02:14:04.701534+0000","last_clean":"2024-09-12T02:14:04.701534+0000","last_became_active":"2024-09-12T02:12:09.667870+0000","last_became_peered":"2024-09-12T02:12:09.667870+0000","last_unstale":"2024-09-12T02:14:04.701534+0000","last_undegraded":"2024-09-12T02:14:04.701534+0000","last_fullsized":"2024-09-12T02:14:04.701534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:55.426386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690150+0000","last_change":"2024-09-12T02:12:22.743248+0000","last_active":"2024-09-12T02:13:46.690150+0000","last_peered":"2024-09-12T02:13:46.690150+0000","last_clean":"2024-09-12T02:13:46.690150+0000","last_became_active":"2024-09-12T02:12:22.742861+0000","last_became_peered":"2024-09-12T02:12:22.742861+0000","last_unstale":"2024-09-12T02:13:46.690150+0000","last_undegraded":"2024-09-12T02:13:46.690150+0000","last_fullsized":"2024-09-12T02:13:46.690150+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:07.939602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851868+0000","last_change":"2024-09-12T02:12:12.687994+0000","last_active":"2024-09-12T02:13:46.851868+0000","last_peered":"2024-09-12T02:13:46.851868+0000","last_clean":"2024-09-12T02:13:46.851868+0000","last_became_active":"2024-09-12T02:12:12.687652+0000","last_became_peered":"2024-09-12T02:12:12.687652+0000","last_unstale":"2024-09-12T02:13:46.851868+0000","last_undegraded":"2024-09-12T02:13:46.851868+0000","last_fullsized":"2024-09-12T02:13:46.851868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:16.168879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"95'3","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.854060+0000","last_change":"2024-09-12T02:12:09.670281+0000","last_active":"2024-09-12T02:13:46.854060+0000","last_peered":"2024-09-12T02:13:46.854060+0000","last_clean":"2024-09-12T02:13:46.854060+0000","last_became_active":"2024-09-12T02:12:09.669953+0000","last_became_peered":"2024-09-12T02:12:09.669953+0000","last_unstale":"2024-09-12T02:13:46.854060+0000","last_undegraded":"2024-09-12T02:13:46.854060+0000","last_fullsized":"2024-09-12T02:13:46.854060+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.189591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852321+0000","last_change":"2024-09-12T02:12:22.747973+0000","last_active":"2024-09-12T02:13:46.852321+0000","last_peered":"2024-09-12T02:13:46.852321+0000","last_clean":"2024-09-12T02:13:46.852321+0000","last_became_active":"2024-09-12T02:12:22.747635+0000","last_became_peered":"2024-09-12T02:12:22.747635+0000","last_unstale":"2024-09-12T02:13:46.852321+0000","last_undegraded":"2024-09-12T02:13:46.852321+0000","last_fullsized":"2024-09-12T02:13:46.852321+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:59:11.310108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692646+0000","last_change":"2024-09-12T02:12:12.697466+0000","last_active":"2024-09-12T02:13:46.692646+0000","last_peered":"2024-09-12T02:13:46.692646+0000","last_clean":"2024-09-12T02:13:46.692646+0000","last_became_active":"2024-09-12T02:12:12.697119+0000","last_became_peered":"2024-09-12T02:12:12.697119+0000","last_unstale":"2024-09-12T02:13:46.692646+0000","last_undegraded":"2024-09-12T02:13:46.692646+0000","last_fullsized":"2024-09-12T02:13:46.692646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:10:37.396793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"95'6","reported_seq":51,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690878+0000","last_change":"2024-09-12T02:12:09.670895+0000","last_active":"2024-09-12T02:13:46.690878+0000","last_peered":"2024-09-12T02:13:46.690878+0000","last_clean":"2024-09-12T02:13:46.690878+0000","last_became_active":"2024-09-12T02:12:09.670301+0000","last_became_peered":"2024-09-12T02:12:09.670301+0000","last_unstale":"2024-09-12T02:13:46.690878+0000","last_undegraded":"2024-09-12T02:13:46.690878+0000","last_fullsized":"2024-09-12T02:13:46.690878+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:06.693381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853611+0000","last_change":"2024-09-12T02:12:22.740419+0000","last_active":"2024-09-12T02:13:46.853611+0000","last_peered":"2024-09-12T02:13:46.853611+0000","last_clean":"2024-09-12T02:13:46.853611+0000","last_became_active":"2024-09-12T02:12:22.739966+0000","last_became_peered":"2024-09-12T02:12:22.739966+0000","last_unstale":"2024-09-12T02:13:46.853611+0000","last_undegraded":"2024-09-12T02:13:46.853611+0000","last_fullsized":"2024-09-12T02:13:46.853611+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:47.556038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852682+0000","last_change":"2024-09-12T02:12:12.681814+0000","last_active":"2024-09-12T02:13:46.852682+0000","last_peered":"2024-09-12T02:13:46.852682+0000","last_clean":"2024-09-12T02:13:46.852682+0000","last_became_active":"2024-09-12T02:12:12.681468+0000","last_became_peered":"2024-09-12T02:12:12.681468+0000","last_unstale":"2024-09-12T02:13:46.852682+0000","last_undegraded":"2024-09-12T02:13:46.852682+0000","last_fullsized":"2024-09-12T02:13:46.852682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:31.964646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"95'33","reported_seq":215,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:14:06.693363+0000","last_change":"2024-09-12T02:12:09.664324+0000","last_active":"2024-09-12T02:14:06.693363+0000","last_peered":"2024-09-12T02:14:06.693363+0000","last_clean":"2024-09-12T02:14:06.693363+0000","last_became_active":"2024-09-12T02:12:09.663970+0000","last_became_peered":"2024-09-12T02:12:09.663970+0000","last_unstale":"2024-09-12T02:14:06.693363+0000","last_undegraded":"2024-09-12T02:14:06.693363+0000","last_fullsized":"2024-09-12T02:14:06.693363+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:03.408761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64140,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":131,"num_write":34,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851238+0000","last_change":"2024-09-12T02:12:46.538194+0000","last_active":"2024-09-12T02:13:46.851238+0000","last_peered":"2024-09-12T02:13:46.851238+0000","last_clean":"2024-09-12T02:13:46.851238+0000","last_became_active":"2024-09-12T02:12:46.537669+0000","last_became_peered":"2024-09-12T02:12:46.537669+0000","last_unstale":"2024-09-12T02:13:46.851238+0000","last_undegraded":"2024-09-12T02:13:46.851238+0000","last_fullsized":"2024-09-12T02:13:46.851238+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:05.394149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693525+0000","last_change":"2024-09-12T02:12:12.690126+0000","last_active":"2024-09-12T02:13:46.693525+0000","last_peered":"2024-09-12T02:13:46.693525+0000","last_clean":"2024-09-12T02:13:46.693525+0000","last_became_active":"2024-09-12T02:12:12.689821+0000","last_became_peered":"2024-09-12T02:12:12.689821+0000","last_unstale":"2024-09-12T02:13:46.693525+0000","last_undegraded":"2024-09-12T02:13:46.693525+0000","last_fullsized":"2024-09-12T02:13:46.693525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:39.503772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"95'4","reported_seq":48,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.854011+0000","last_change":"2024-09-12T02:12:09.735571+0000","last_active":"2024-09-12T02:13:46.854011+0000","last_peered":"2024-09-12T02:13:46.854011+0000","last_clean":"2024-09-12T02:13:46.854011+0000","last_became_active":"2024-09-12T02:12:09.735150+0000","last_became_peered":"2024-09-12T02:12:09.735150+0000","last_unstale":"2024-09-12T02:13:46.854011+0000","last_undegraded":"2024-09-12T02:13:46.854011+0000","last_fullsized":"2024-09-12T02:13:46.854011+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:44.840395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690565+0000","last_change":"2024-09-12T02:12:46.543628+0000","last_active":"2024-09-12T02:13:46.690565+0000","last_peered":"2024-09-12T02:13:46.690565+0000","last_clean":"2024-09-12T02:13:46.690565+0000","last_became_active":"2024-09-12T02:12:46.543158+0000","last_became_peered":"2024-09-12T02:12:46.543158+0000","last_unstale":"2024-09-12T02:13:46.690565+0000","last_undegraded":"2024-09-12T02:13:46.690565+0000","last_fullsized":"2024-09-12T02:13:46.690565+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:05.686523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852895+0000","last_change":"2024-09-12T02:12:12.683253+0000","last_active":"2024-09-12T02:13:46.852895+0000","last_peered":"2024-09-12T02:13:46.852895+0000","last_clean":"2024-09-12T02:13:46.852895+0000","last_became_active":"2024-09-12T02:12:12.682761+0000","last_became_peered":"2024-09-12T02:12:12.682761+0000","last_unstale":"2024-09-12T02:13:46.852895+0000","last_undegraded":"2024-09-12T02:13:46.852895+0000","last_fullsized":"2024-09-12T02:13:46.852895+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:56.321662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"95'2","reported_seq":51,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852047+0000","last_change":"2024-09-12T02:12:46.542190+0000","last_active":"2024-09-12T02:13:46.852047+0000","last_peered":"2024-09-12T02:13:46.852047+0000","last_clean":"2024-09-12T02:13:46.852047+0000","last_became_active":"2024-09-12T02:12:46.541755+0000","last_became_peered":"2024-09-12T02:12:46.541755+0000","last_unstale":"2024-09-12T02:13:46.852047+0000","last_undegraded":"2024-09-12T02:13:46.852047+0000","last_fullsized":"2024-09-12T02:13:46.852047+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:53.224512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852019+0000","last_change":"2024-09-12T02:12:46.540620+0000","last_active":"2024-09-12T02:13:46.852019+0000","last_peered":"2024-09-12T02:13:46.852019+0000","last_clean":"2024-09-12T02:13:46.852019+0000","last_became_active":"2024-09-12T02:12:46.540177+0000","last_became_peered":"2024-09-12T02:12:46.540177+0000","last_unstale":"2024-09-12T02:13:46.852019+0000","last_undegraded":"2024-09-12T02:13:46.852019+0000","last_fullsized":"2024-09-12T02:13:46.852019+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:30.701052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693712+0000","last_change":"2024-09-12T02:12:12.686728+0000","last_active":"2024-09-12T02:13:46.693712+0000","last_peered":"2024-09-12T02:13:46.693712+0000","last_clean":"2024-09-12T02:13:46.693712+0000","last_became_active":"2024-09-12T02:12:12.686159+0000","last_became_peered":"2024-09-12T02:12:12.686159+0000","last_unstale":"2024-09-12T02:13:46.693712+0000","last_undegraded":"2024-09-12T02:13:46.693712+0000","last_fullsized":"2024-09-12T02:13:46.693712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:51.567343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"95'3","reported_seq":111,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:14:05.691862+0000","last_change":"2024-09-12T02:12:09.665179+0000","last_active":"2024-09-12T02:14:05.691862+0000","last_peered":"2024-09-12T02:14:05.691862+0000","last_clean":"2024-09-12T02:14:05.691862+0000","last_became_active":"2024-09-12T02:12:09.664794+0000","last_became_peered":"2024-09-12T02:12:09.664794+0000","last_unstale":"2024-09-12T02:14:05.691862+0000","last_undegraded":"2024-09-12T02:14:05.691862+0000","last_fullsized":"2024-09-12T02:14:05.691862+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:36.646536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851790+0000","last_change":"2024-09-12T02:12:22.735715+0000","last_active":"2024-09-12T02:13:46.851790+0000","last_peered":"2024-09-12T02:13:46.851790+0000","last_clean":"2024-09-12T02:13:46.851790+0000","last_became_active":"2024-09-12T02:12:22.735341+0000","last_became_peered":"2024-09-12T02:12:22.735341+0000","last_unstale":"2024-09-12T02:13:46.851790+0000","last_undegraded":"2024-09-12T02:13:46.851790+0000","last_fullsized":"2024-09-12T02:13:46.851790+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:36.141512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852856+0000","last_change":"2024-09-12T02:12:22.743286+0000","last_active":"2024-09-12T02:13:46.852856+0000","last_peered":"2024-09-12T02:13:46.852856+0000","last_clean":"2024-09-12T02:13:46.852856+0000","last_became_active":"2024-09-12T02:12:22.742804+0000","last_became_peered":"2024-09-12T02:12:22.742804+0000","last_unstale":"2024-09-12T02:13:46.852856+0000","last_undegraded":"2024-09-12T02:13:46.852856+0000","last_fullsized":"2024-09-12T02:13:46.852856+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:26.133009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.689604+0000","last_change":"2024-09-12T02:12:12.682970+0000","last_active":"2024-09-12T02:13:46.689604+0000","last_peered":"2024-09-12T02:13:46.689604+0000","last_clean":"2024-09-12T02:13:46.689604+0000","last_became_active":"2024-09-12T02:12:12.682625+0000","last_became_peered":"2024-09-12T02:12:12.682625+0000","last_unstale":"2024-09-12T02:13:46.689604+0000","last_undegraded":"2024-09-12T02:13:46.689604+0000","last_fullsized":"2024-09-12T02:13:46.689604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:44.585654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"95'1","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853560+0000","last_change":"2024-09-12T02:12:09.669380+0000","last_active":"2024-09-12T02:13:46.853560+0000","last_peered":"2024-09-12T02:13:46.853560+0000","last_clean":"2024-09-12T02:13:46.853560+0000","last_became_active":"2024-09-12T02:12:09.669052+0000","last_became_peered":"2024-09-12T02:12:09.669052+0000","last_unstale":"2024-09-12T02:13:46.853560+0000","last_undegraded":"2024-09-12T02:13:46.853560+0000","last_fullsized":"2024-09-12T02:13:46.853560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:35.828558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852610+0000","last_change":"2024-09-12T02:12:22.745871+0000","last_active":"2024-09-12T02:13:46.852610+0000","last_peered":"2024-09-12T02:13:46.852610+0000","last_clean":"2024-09-12T02:13:46.852610+0000","last_became_active":"2024-09-12T02:12:22.745370+0000","last_became_peered":"2024-09-12T02:12:22.745370+0000","last_unstale":"2024-09-12T02:13:46.852610+0000","last_undegraded":"2024-09-12T02:13:46.852610+0000","last_fullsized":"2024-09-12T02:13:46.852610+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:20.579806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851748+0000","last_change":"2024-09-12T02:12:12.684996+0000","last_active":"2024-09-12T02:13:46.851748+0000","last_peered":"2024-09-12T02:13:46.851748+0000","last_clean":"2024-09-12T02:13:46.851748+0000","last_became_active":"2024-09-12T02:12:12.684663+0000","last_became_peered":"2024-09-12T02:12:12.684663+0000","last_unstale":"2024-09-12T02:13:46.851748+0000","last_undegraded":"2024-09-12T02:13:46.851748+0000","last_fullsized":"2024-09-12T02:13:46.851748+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:35.054435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"95'2","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692472+0000","last_change":"2024-09-12T02:12:09.668939+0000","last_active":"2024-09-12T02:13:46.692472+0000","last_peered":"2024-09-12T02:13:46.692472+0000","last_clean":"2024-09-12T02:13:46.692472+0000","last_became_active":"2024-09-12T02:12:09.665857+0000","last_became_peered":"2024-09-12T02:12:09.665857+0000","last_unstale":"2024-09-12T02:13:46.692472+0000","last_undegraded":"2024-09-12T02:13:46.692472+0000","last_fullsized":"2024-09-12T02:13:46.692472+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:42.311387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"95'3","reported_seq":46,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851371+0000","last_change":"2024-09-12T02:12:09.666892+0000","last_active":"2024-09-12T02:13:46.851371+0000","last_peered":"2024-09-12T02:13:46.851371+0000","last_clean":"2024-09-12T02:13:46.851371+0000","last_became_active":"2024-09-12T02:12:09.666503+0000","last_became_peered":"2024-09-12T02:12:09.666503+0000","last_unstale":"2024-09-12T02:13:46.851371+0000","last_undegraded":"2024-09-12T02:13:46.851371+0000","last_fullsized":"2024-09-12T02:13:46.851371+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:16.010778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853678+0000","last_change":"2024-09-12T02:12:12.683323+0000","last_active":"2024-09-12T02:13:46.853678+0000","last_peered":"2024-09-12T02:13:46.853678+0000","last_clean":"2024-09-12T02:13:46.853678+0000","last_became_active":"2024-09-12T02:12:12.683017+0000","last_became_peered":"2024-09-12T02:12:12.683017+0000","last_unstale":"2024-09-12T02:13:46.853678+0000","last_undegraded":"2024-09-12T02:13:46.853678+0000","last_fullsized":"2024-09-12T02:13:46.853678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:00.287600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690892+0000","last_change":"2024-09-12T02:12:22.743509+0000","last_active":"2024-09-12T02:13:46.690892+0000","last_peered":"2024-09-12T02:13:46.690892+0000","last_clean":"2024-09-12T02:13:46.690892+0000","last_became_active":"2024-09-12T02:12:22.743185+0000","last_became_peered":"2024-09-12T02:12:22.743185+0000","last_unstale":"2024-09-12T02:13:46.690892+0000","last_undegraded":"2024-09-12T02:13:46.690892+0000","last_fullsized":"2024-09-12T02:13:46.690892+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:11:44.990530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'6","reported_seq":118,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:14:06.693951+0000","last_change":"2024-09-12T02:12:09.672316+0000","last_active":"2024-09-12T02:14:06.693951+0000","last_peered":"2024-09-12T02:14:06.693951+0000","last_clean":"2024-09-12T02:14:06.693951+0000","last_became_active":"2024-09-12T02:12:09.671947+0000","last_became_peered":"2024-09-12T02:12:09.671947+0000","last_unstale":"2024-09-12T02:14:06.693951+0000","last_undegraded":"2024-09-12T02:14:06.693951+0000","last_fullsized":"2024-09-12T02:14:06.693951+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:08.646260+0000","last_clean_scrub_stamp":"2024-09-12T02:12:08.646260+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:00.632297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852492+0000","last_change":"2024-09-12T02:12:12.689437+0000","last_active":"2024-09-12T02:13:46.852492+0000","last_peered":"2024-09-12T02:13:46.852492+0000","last_clean":"2024-09-12T02:13:46.852492+0000","last_became_active":"2024-09-12T02:12:12.689123+0000","last_became_peered":"2024-09-12T02:12:12.689123+0000","last_unstale":"2024-09-12T02:13:46.852492+0000","last_undegraded":"2024-09-12T02:13:46.852492+0000","last_fullsized":"2024-09-12T02:13:46.852492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:07.635955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.691100+0000","last_change":"2024-09-12T02:12:22.733472+0000","last_active":"2024-09-12T02:13:46.691100+0000","last_peered":"2024-09-12T02:13:46.691100+0000","last_clean":"2024-09-12T02:13:46.691100+0000","last_became_active":"2024-09-12T02:12:22.733040+0000","last_became_peered":"2024-09-12T02:12:22.733040+0000","last_unstale":"2024-09-12T02:13:46.691100+0000","last_undegraded":"2024-09-12T02:13:46.691100+0000","last_fullsized":"2024-09-12T02:13:46.691100+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:21.712902+0000","last_clean_scrub_stamp":"2024-09-12T02:12:21.712902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:15.556414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851861+0000","last_change":"2024-09-12T02:12:12.684758+0000","last_active":"2024-09-12T02:13:46.851861+0000","last_peered":"2024-09-12T02:13:46.851861+0000","last_clean":"2024-09-12T02:13:46.851861+0000","last_became_active":"2024-09-12T02:12:12.684430+0000","last_became_peered":"2024-09-12T02:12:12.684430+0000","last_unstale":"2024-09-12T02:13:46.851861+0000","last_undegraded":"2024-09-12T02:13:46.851861+0000","last_fullsized":"2024-09-12T02:13:46.851861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:26.209634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690802+0000","last_change":"2024-09-12T02:12:12.688350+0000","last_active":"2024-09-12T02:13:46.690802+0000","last_peered":"2024-09-12T02:13:46.690802+0000","last_clean":"2024-09-12T02:13:46.690802+0000","last_became_active":"2024-09-12T02:12:12.688037+0000","last_became_peered":"2024-09-12T02:12:12.688037+0000","last_unstale":"2024-09-12T02:13:46.690802+0000","last_undegraded":"2024-09-12T02:13:46.690802+0000","last_fullsized":"2024-09-12T02:13:46.690802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:02.133024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690600+0000","last_change":"2024-09-12T02:12:12.686031+0000","last_active":"2024-09-12T02:13:46.690600+0000","last_peered":"2024-09-12T02:13:46.690600+0000","last_clean":"2024-09-12T02:13:46.690600+0000","last_became_active":"2024-09-12T02:12:12.685690+0000","last_became_peered":"2024-09-12T02:12:12.685690+0000","last_unstale":"2024-09-12T02:13:46.690600+0000","last_undegraded":"2024-09-12T02:13:46.690600+0000","last_fullsized":"2024-09-12T02:13:46.690600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:43.406506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852653+0000","last_change":"2024-09-12T02:12:12.695698+0000","last_active":"2024-09-12T02:13:46.852653+0000","last_peered":"2024-09-12T02:13:46.852653+0000","last_clean":"2024-09-12T02:13:46.852653+0000","last_became_active":"2024-09-12T02:12:12.694277+0000","last_became_peered":"2024-09-12T02:12:12.694277+0000","last_unstale":"2024-09-12T02:13:46.852653+0000","last_undegraded":"2024-09-12T02:13:46.852653+0000","last_fullsized":"2024-09-12T02:13:46.852653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:55.013973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.854017+0000","last_change":"2024-09-12T02:13:46.854017+0000","last_active":"2024-09-12T02:13:46.854017+0000","last_peered":"2024-09-12T02:13:46.854017+0000","last_clean":"2024-09-12T02:13:46.854017+0000","last_became_active":"2024-09-12T02:13:46.853633+0000","last_became_peered":"2024-09-12T02:13:46.853633+0000","last_unstale":"2024-09-12T02:13:46.854017+0000","last_undegraded":"2024-09-12T02:13:46.854017+0000","last_fullsized":"2024-09-12T02:13:46.854017+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:42.852113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852778+0000","last_change":"2024-09-12T02:12:12.683057+0000","last_active":"2024-09-12T02:13:46.852778+0000","last_peered":"2024-09-12T02:13:46.852778+0000","last_clean":"2024-09-12T02:13:46.852778+0000","last_became_active":"2024-09-12T02:12:12.682751+0000","last_became_peered":"2024-09-12T02:12:12.682751+0000","last_unstale":"2024-09-12T02:13:46.852778+0000","last_undegraded":"2024-09-12T02:13:46.852778+0000","last_fullsized":"2024-09-12T02:13:46.852778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:58.642560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.691313+0000","last_change":"2024-09-12T02:12:12.682975+0000","last_active":"2024-09-12T02:13:46.691313+0000","last_peered":"2024-09-12T02:13:46.691313+0000","last_clean":"2024-09-12T02:13:46.691313+0000","last_became_active":"2024-09-12T02:12:12.682643+0000","last_became_peered":"2024-09-12T02:12:12.682643+0000","last_unstale":"2024-09-12T02:13:46.691313+0000","last_undegraded":"2024-09-12T02:13:46.691313+0000","last_fullsized":"2024-09-12T02:13:46.691313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:49.859554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692735+0000","last_change":"2024-09-12T02:13:46.692044+0000","last_active":"2024-09-12T02:13:46.692735+0000","last_peered":"2024-09-12T02:13:46.692735+0000","last_clean":"2024-09-12T02:13:46.692735+0000","last_became_active":"2024-09-12T02:13:46.691640+0000","last_became_peered":"2024-09-12T02:13:46.691640+0000","last_unstale":"2024-09-12T02:13:46.692735+0000","last_undegraded":"2024-09-12T02:13:46.692735+0000","last_fullsized":"2024-09-12T02:13:46.692735+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:46.331316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,2],"acting":[9,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853230+0000","last_change":"2024-09-12T02:12:12.687454+0000","last_active":"2024-09-12T02:13:46.853230+0000","last_peered":"2024-09-12T02:13:46.853230+0000","last_clean":"2024-09-12T02:13:46.853230+0000","last_became_active":"2024-09-12T02:12:12.686203+0000","last_became_peered":"2024-09-12T02:12:12.686203+0000","last_unstale":"2024-09-12T02:13:46.853230+0000","last_undegraded":"2024-09-12T02:13:46.853230+0000","last_fullsized":"2024-09-12T02:13:46.853230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:25.029872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852052+0000","last_change":"2024-09-12T02:12:12.683777+0000","last_active":"2024-09-12T02:13:46.852052+0000","last_peered":"2024-09-12T02:13:46.852052+0000","last_clean":"2024-09-12T02:13:46.852052+0000","last_became_active":"2024-09-12T02:12:12.682096+0000","last_became_peered":"2024-09-12T02:12:12.682096+0000","last_unstale":"2024-09-12T02:13:46.852052+0000","last_undegraded":"2024-09-12T02:13:46.852052+0000","last_fullsized":"2024-09-12T02:13:46.852052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:18.624449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693473+0000","last_change":"2024-09-12T02:12:12.689690+0000","last_active":"2024-09-12T02:13:46.693473+0000","last_peered":"2024-09-12T02:13:46.693473+0000","last_clean":"2024-09-12T02:13:46.693473+0000","last_became_active":"2024-09-12T02:12:12.689339+0000","last_became_peered":"2024-09-12T02:12:12.689339+0000","last_unstale":"2024-09-12T02:13:46.693473+0000","last_undegraded":"2024-09-12T02:13:46.693473+0000","last_fullsized":"2024-09-12T02:13:46.693473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:48:06.517136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692821+0000","last_change":"2024-09-12T02:12:12.696480+0000","last_active":"2024-09-12T02:13:46.692821+0000","last_peered":"2024-09-12T02:13:46.692821+0000","last_clean":"2024-09-12T02:13:46.692821+0000","last_became_active":"2024-09-12T02:12:12.696163+0000","last_became_peered":"2024-09-12T02:12:12.696163+0000","last_unstale":"2024-09-12T02:13:46.692821+0000","last_undegraded":"2024-09-12T02:13:46.692821+0000","last_fullsized":"2024-09-12T02:13:46.692821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:12.381644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852425+0000","last_change":"2024-09-12T02:12:46.947998+0000","last_active":"2024-09-12T02:13:46.852425+0000","last_peered":"2024-09-12T02:13:46.852425+0000","last_clean":"2024-09-12T02:13:46.852425+0000","last_became_active":"2024-09-12T02:12:46.947602+0000","last_became_peered":"2024-09-12T02:12:46.947602+0000","last_unstale":"2024-09-12T02:13:46.852425+0000","last_undegraded":"2024-09-12T02:13:46.852425+0000","last_fullsized":"2024-09-12T02:13:46.852425+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:50.123283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.691257+0000","last_change":"2024-09-12T02:12:12.689152+0000","last_active":"2024-09-12T02:13:46.691257+0000","last_peered":"2024-09-12T02:13:46.691257+0000","last_clean":"2024-09-12T02:13:46.691257+0000","last_became_active":"2024-09-12T02:12:12.688830+0000","last_became_peered":"2024-09-12T02:12:12.688830+0000","last_unstale":"2024-09-12T02:13:46.691257+0000","last_undegraded":"2024-09-12T02:13:46.691257+0000","last_fullsized":"2024-09-12T02:13:46.691257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:24.057884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.689919+0000","last_change":"2024-09-12T02:12:12.683089+0000","last_active":"2024-09-12T02:13:46.689919+0000","last_peered":"2024-09-12T02:13:46.689919+0000","last_clean":"2024-09-12T02:13:46.689919+0000","last_became_active":"2024-09-12T02:12:12.682783+0000","last_became_peered":"2024-09-12T02:12:12.682783+0000","last_unstale":"2024-09-12T02:13:46.689919+0000","last_undegraded":"2024-09-12T02:13:46.689919+0000","last_fullsized":"2024-09-12T02:13:46.689919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:07.182958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852948+0000","last_change":"2024-09-12T02:12:12.698373+0000","last_active":"2024-09-12T02:13:46.852948+0000","last_peered":"2024-09-12T02:13:46.852948+0000","last_clean":"2024-09-12T02:13:46.852948+0000","last_became_active":"2024-09-12T02:12:12.698103+0000","last_became_peered":"2024-09-12T02:12:12.698103+0000","last_unstale":"2024-09-12T02:13:46.852948+0000","last_undegraded":"2024-09-12T02:13:46.852948+0000","last_fullsized":"2024-09-12T02:13:46.852948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:55:35.776397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.693120+0000","last_change":"2024-09-12T02:12:12.698499+0000","last_active":"2024-09-12T02:13:46.693120+0000","last_peered":"2024-09-12T02:13:46.693120+0000","last_clean":"2024-09-12T02:13:46.693120+0000","last_became_active":"2024-09-12T02:12:12.698103+0000","last_became_peered":"2024-09-12T02:12:12.698103+0000","last_unstale":"2024-09-12T02:13:46.693120+0000","last_undegraded":"2024-09-12T02:13:46.693120+0000","last_fullsized":"2024-09-12T02:13:46.693120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:59.116424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851852+0000","last_change":"2024-09-12T02:12:12.687918+0000","last_active":"2024-09-12T02:13:46.851852+0000","last_peered":"2024-09-12T02:13:46.851852+0000","last_clean":"2024-09-12T02:13:46.851852+0000","last_became_active":"2024-09-12T02:12:12.684732+0000","last_became_peered":"2024-09-12T02:12:12.684732+0000","last_unstale":"2024-09-12T02:13:46.851852+0000","last_undegraded":"2024-09-12T02:13:46.851852+0000","last_fullsized":"2024-09-12T02:13:46.851852+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:06.675996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852184+0000","last_change":"2024-09-12T02:12:12.680429+0000","last_active":"2024-09-12T02:13:46.852184+0000","last_peered":"2024-09-12T02:13:46.852184+0000","last_clean":"2024-09-12T02:13:46.852184+0000","last_became_active":"2024-09-12T02:12:12.680138+0000","last_became_peered":"2024-09-12T02:12:12.680138+0000","last_unstale":"2024-09-12T02:13:46.852184+0000","last_undegraded":"2024-09-12T02:13:46.852184+0000","last_fullsized":"2024-09-12T02:13:46.852184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:16.144740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.692808+0000","last_change":"2024-09-12T02:12:12.688403+0000","last_active":"2024-09-12T02:13:46.692808+0000","last_peered":"2024-09-12T02:13:46.692808+0000","last_clean":"2024-09-12T02:13:46.692808+0000","last_became_active":"2024-09-12T02:12:12.686037+0000","last_became_peered":"2024-09-12T02:12:12.686037+0000","last_unstale":"2024-09-12T02:13:46.692808+0000","last_undegraded":"2024-09-12T02:13:46.692808+0000","last_fullsized":"2024-09-12T02:13:46.692808+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T14:04:01.825875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.691027+0000","last_change":"2024-09-12T02:12:12.677197+0000","last_active":"2024-09-12T02:13:46.691027+0000","last_peered":"2024-09-12T02:13:46.691027+0000","last_clean":"2024-09-12T02:13:46.691027+0000","last_became_active":"2024-09-12T02:12:12.676845+0000","last_became_peered":"2024-09-12T02:12:12.676845+0000","last_unstale":"2024-09-12T02:13:46.691027+0000","last_undegraded":"2024-09-12T02:13:46.691027+0000","last_fullsized":"2024-09-12T02:13:46.691027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:35.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851732+0000","last_change":"2024-09-12T02:12:12.687061+0000","last_active":"2024-09-12T02:13:46.851732+0000","last_peered":"2024-09-12T02:13:46.851732+0000","last_clean":"2024-09-12T02:13:46.851732+0000","last_became_active":"2024-09-12T02:12:12.686616+0000","last_became_peered":"2024-09-12T02:12:12.686616+0000","last_unstale":"2024-09-12T02:13:46.851732+0000","last_undegraded":"2024-09-12T02:13:46.851732+0000","last_fullsized":"2024-09-12T02:13:46.851732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:09.368228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851760+0000","last_change":"2024-09-12T02:12:12.677137+0000","last_active":"2024-09-12T02:13:46.851760+0000","last_peered":"2024-09-12T02:13:46.851760+0000","last_clean":"2024-09-12T02:13:46.851760+0000","last_became_active":"2024-09-12T02:12:12.676818+0000","last_became_peered":"2024-09-12T02:12:12.676818+0000","last_unstale":"2024-09-12T02:13:46.851760+0000","last_undegraded":"2024-09-12T02:13:46.851760+0000","last_fullsized":"2024-09-12T02:13:46.851760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:31.734571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":44,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.853649+0000","last_change":"2024-09-12T02:13:46.853649+0000","last_active":"2024-09-12T02:13:46.853649+0000","last_peered":"2024-09-12T02:13:46.853649+0000","last_clean":"2024-09-12T02:13:46.853649+0000","last_became_active":"2024-09-12T02:13:46.853347+0000","last_became_peered":"2024-09-12T02:13:46.853347+0000","last_unstale":"2024-09-12T02:13:46.853649+0000","last_undegraded":"2024-09-12T02:13:46.853649+0000","last_fullsized":"2024-09-12T02:13:46.853649+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:47.798643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851641+0000","last_change":"2024-09-12T02:12:12.694662+0000","last_active":"2024-09-12T02:13:46.851641+0000","last_peered":"2024-09-12T02:13:46.851641+0000","last_clean":"2024-09-12T02:13:46.851641+0000","last_became_active":"2024-09-12T02:12:12.693454+0000","last_became_peered":"2024-09-12T02:12:12.693454+0000","last_unstale":"2024-09-12T02:13:46.851641+0000","last_undegraded":"2024-09-12T02:13:46.851641+0000","last_fullsized":"2024-09-12T02:13:46.851641+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:14.818573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851282+0000","last_change":"2024-09-12T02:12:12.693045+0000","last_active":"2024-09-12T02:13:46.851282+0000","last_peered":"2024-09-12T02:13:46.851282+0000","last_clean":"2024-09-12T02:13:46.851282+0000","last_became_active":"2024-09-12T02:12:12.692520+0000","last_became_peered":"2024-09-12T02:12:12.692520+0000","last_unstale":"2024-09-12T02:13:46.851282+0000","last_undegraded":"2024-09-12T02:13:46.851282+0000","last_fullsized":"2024-09-12T02:13:46.851282+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:29.613656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.851270+0000","last_change":"2024-09-12T02:12:12.677141+0000","last_active":"2024-09-12T02:13:46.851270+0000","last_peered":"2024-09-12T02:13:46.851270+0000","last_clean":"2024-09-12T02:13:46.851270+0000","last_became_active":"2024-09-12T02:12:12.676828+0000","last_became_peered":"2024-09-12T02:12:12.676828+0000","last_unstale":"2024-09-12T02:13:46.851270+0000","last_undegraded":"2024-09-12T02:13:46.851270+0000","last_fullsized":"2024-09-12T02:13:46.851270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:51.355531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852102+0000","last_change":"2024-09-12T02:12:12.688588+0000","last_active":"2024-09-12T02:13:46.852102+0000","last_peered":"2024-09-12T02:13:46.852102+0000","last_clean":"2024-09-12T02:13:46.852102+0000","last_became_active":"2024-09-12T02:12:12.688275+0000","last_became_peered":"2024-09-12T02:12:12.688275+0000","last_unstale":"2024-09-12T02:13:46.852102+0000","last_undegraded":"2024-09-12T02:13:46.852102+0000","last_fullsized":"2024-09-12T02:13:46.852102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:28.540937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.690971+0000","last_change":"2024-09-12T02:12:12.685463+0000","last_active":"2024-09-12T02:13:46.690971+0000","last_peered":"2024-09-12T02:13:46.690971+0000","last_clean":"2024-09-12T02:13:46.690971+0000","last_became_active":"2024-09-12T02:12:12.684219+0000","last_became_peered":"2024-09-12T02:12:12.684219+0000","last_unstale":"2024-09-12T02:13:46.690971+0000","last_undegraded":"2024-09-12T02:13:46.690971+0000","last_fullsized":"2024-09-12T02:13:46.690971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:09.512781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852791+0000","last_change":"2024-09-12T02:12:12.699531+0000","last_active":"2024-09-12T02:13:46.852791+0000","last_peered":"2024-09-12T02:13:46.852791+0000","last_clean":"2024-09-12T02:13:46.852791+0000","last_became_active":"2024-09-12T02:12:12.691874+0000","last_became_peered":"2024-09-12T02:12:12.691874+0000","last_unstale":"2024-09-12T02:13:46.852791+0000","last_undegraded":"2024-09-12T02:13:46.852791+0000","last_fullsized":"2024-09-12T02:13:46.852791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:32.484656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852901+0000","last_change":"2024-09-12T02:12:12.691135+0000","last_active":"2024-09-12T02:13:46.852901+0000","last_peered":"2024-09-12T02:13:46.852901+0000","last_clean":"2024-09-12T02:13:46.852901+0000","last_became_active":"2024-09-12T02:12:12.690812+0000","last_became_peered":"2024-09-12T02:12:12.690812+0000","last_unstale":"2024-09-12T02:13:46.852901+0000","last_undegraded":"2024-09-12T02:13:46.852901+0000","last_fullsized":"2024-09-12T02:13:46.852901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:50.835731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-12T02:13:46.852854+0000","last_change":"2024-09-12T02:12:12.697439+0000","last_active":"2024-09-12T02:13:46.852854+0000","last_peered":"2024-09-12T02:13:46.852854+0000","last_clean":"2024-09-12T02:13:46.852854+0000","last_became_active":"2024-09-12T02:12:12.697142+0000","last_became_peered":"2024-09-12T02:12:12.697142+0000","last_unstale":"2024-09-12T02:13:46.852854+0000","last_undegraded":"2024-09-12T02:13:46.852854+0000","last_fullsized":"2024-09-12T02:13:46.852854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T02:12:11.657115+0000","last_clean_scrub_stamp":"2024-09-12T02:12:11.657115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:12.032053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68143,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":418,"num_read_kb":280,"num_write":168,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":204429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449126,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28128,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717024,"statfs":{"total":95995035648,"available":95966232576,"internally_reserved":0,"allocated":1122304,"data_stored":557273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678060,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37112,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708040,"statfs":{"total":95995035648,"available":95957032960,"internally_reserved":0,"allocated":1806336,"data_stored":1208569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841584,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36460,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708692,"statfs":{"total":95995035648,"available":95957700608,"internally_reserved":0,"allocated":1134592,"data_stored":561493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103223,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36444,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708708,"statfs":{"total":95995035648,"available":95957716992,"internally_reserved":0,"allocated":1122304,"data_stored":557205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332156,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1724416,"data_stored":1153228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495681,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1110016,"data_stored":552573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757320,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28720,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716432,"statfs":{"total":95995035648,"available":95965626368,"internally_reserved":0,"allocated":1732608,"data_stored":1148816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920845,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1122304,"data_stored":557223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149777,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36448,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708704,"statfs":{"total":95995035648,"available":95957712896,"internally_reserved":0,"allocated":1122304,"data_stored":552767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28208,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716944,"statfs":{"total":95995035648,"available":95966150656,"internally_reserved":0,"allocated":1204224,"data_stored":618366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36500,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708652,"statfs":{"total":95995035648,"available":95957659648,"internally_reserved":0,"allocated":1179648,"data_stored":616623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36460,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708692,"statfs":{"total":95995035648,"available":95957700608,"internally_reserved":0,"allocated":1134592,"data_stored":553961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T02:14:11.979 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T02:14:11.979 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T02:14:11.979 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T02:14:11.980 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T02:14:12.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:12 smithi136 ceph-mon[35814]: from='client.24941 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:14:12.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:12 smithi136 ceph-mon[35814]: pgmap v370: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:12.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:12 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:12.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:12 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:12.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:12 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:12.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:12 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:12.911 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:12 smithi110 ceph-mon[30548]: from='client.24941 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:14:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:12 smithi110 ceph-mon[30548]: pgmap v370: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:12.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:12 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:13.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:12 smithi115 ceph-mon[35351]: from='client.24941 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T02:14:13.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:12 smithi115 ceph-mon[35351]: pgmap v370: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:13.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:12 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:13.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:12 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:13.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:12 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:13.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:12 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.509+0000 7f9d0c200640 1 -- 172.21.15.110:0/3744901426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d041027a0 msgr2=0x7f9d041067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.509+0000 7f9d0c200640 1 --2- 172.21.15.110:0/3744901426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d041027a0 0x7f9d041067f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009900 tx=0x7f9cf002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:14:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.509+0000 7f9d0c200640 1 -- 172.21.15.110:0/3744901426 shutdown_connections 2024-09-12T02:14:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.509+0000 7f9d0c200640 1 --2- 172.21.15.110:0/3744901426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d04106f20 0x7f9d0410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.509+0000 7f9d0c200640 1 --2- 172.21.15.110:0/3744901426 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d041027a0 0x7f9d041067f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.509+0000 7f9d0c200640 1 --2- 172.21.15.110:0/3744901426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d04101df0 0x7f9d041021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.509+0000 7f9d0c200640 1 -- 172.21.15.110:0/3744901426 >> 172.21.15.110:0/3744901426 conn(0x7f9d040fd8b0 msgr2=0x7f9d040ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.509+0000 7f9d0c200640 1 -- 172.21.15.110:0/3744901426 shutdown_connections 2024-09-12T02:14:13.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.509+0000 7f9d0c200640 1 -- 172.21.15.110:0/3744901426 wait complete. 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.510+0000 7f9d0c200640 1 Processor -- start 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.510+0000 7f9d0c200640 1 -- start start 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.510+0000 7f9d0c200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d04101df0 0x7f9d04198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0c200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d041027a0 0x7f9d04198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0c200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d04106f20 0x7f9d0419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0c200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04111f80 con 0x7f9d04106f20 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0c200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04111e00 con 0x7f9d041027a0 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0c200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04112100 con 0x7f9d04101df0 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0a200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d04106f20 0x7f9d0419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0a200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d04106f20 0x7f9d0419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57754/0 (socket says 172.21.15.110:57754) 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0a200640 1 -- 172.21.15.110:0/2104199222 learned_addr learned my addr 172.21.15.110:0/2104199222 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d09800640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d04101df0 0x7f9d04198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:13.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d08e00640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d041027a0 0x7f9d04198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0a200640 1 -- 172.21.15.110:0/2104199222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d04101df0 msgr2=0x7f9d04198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0a200640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d04101df0 0x7f9d04198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0a200640 1 -- 172.21.15.110:0/2104199222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d041027a0 msgr2=0x7f9d04198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0a200640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d041027a0 0x7f9d04198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.511+0000 7f9d0a200640 1 -- 172.21.15.110:0/2104199222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0419d4b0 con 0x7f9d04106f20 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.512+0000 7f9d0a200640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d04106f20 0x7f9d0419cdd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00eb10 tx=0x7f9cfc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.512+0000 7f9d02000640 1 -- 172.21.15.110:0/2104199222 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc004b20 con 0x7f9d04106f20 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.512+0000 7f9d0c200640 1 -- 172.21.15.110:0/2104199222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0419d7a0 con 0x7f9d04106f20 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.512+0000 7f9d02000640 1 -- 172.21.15.110:0/2104199222 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cfc004cc0 con 0x7f9d04106f20 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.512+0000 7f9d02000640 1 -- 172.21.15.110:0/2104199222 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc010760 con 0x7f9d04106f20 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.512+0000 7f9d0c200640 1 -- 172.21.15.110:0/2104199222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d04074420 con 0x7f9d04106f20 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.513+0000 7f9d0c200640 1 -- 172.21.15.110:0/2104199222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d041032d0 con 0x7f9d04106f20 2024-09-12T02:14:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.515+0000 7f9d02000640 1 -- 172.21.15.110:0/2104199222 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f9cfc005020 con 0x7f9d04106f20 2024-09-12T02:14:13.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.516+0000 7f9d02000640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f9cec0a2c10 0x7f9cec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:13.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.516+0000 7f9d02000640 1 -- 172.21.15.110:0/2104199222 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f9cfc0cfc10 con 0x7f9d04106f20 2024-09-12T02:14:13.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.517+0000 7f9d09800640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f9cec0a2c10 0x7f9cec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:13.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.517+0000 7f9d09800640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f9cec0a2c10 0x7f9cec0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80095f0 tx=0x7f9cf8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:13.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.520+0000 7f9d02000640 1 -- 172.21.15.110:0/2104199222 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9cfc09c610 con 0x7f9d04106f20 2024-09-12T02:14:13.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.749+0000 7f9d0c200640 1 -- 172.21.15.110:0/2104199222 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9d0410a100 con 0x7f9d04106f20 2024-09-12T02:14:13.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.750+0000 7f9d02000640 1 -- 172.21.15.110:0/2104199222 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9cfc09bf10 con 0x7f9d04106f20 2024-09-12T02:14:13.751 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:13.751 INFO:teuthology.orchestra.run.smithi110.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T02:14:13.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.753+0000 7f9d0c200640 1 -- 172.21.15.110:0/2104199222 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f9cec0a2c10 msgr2=0x7f9cec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:13.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.753+0000 7f9d0c200640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f9cec0a2c10 0x7f9cec0a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80095f0 tx=0x7f9cf8005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:13.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.753+0000 7f9d0c200640 1 -- 172.21.15.110:0/2104199222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d04106f20 msgr2=0x7f9d0419cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:13.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.753+0000 7f9d0c200640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d04106f20 0x7f9d0419cdd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00eb10 tx=0x7f9cfc00c2d0 comp rx=0 tx=0).stop 2024-09-12T02:14:13.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.753+0000 7f9d0c200640 1 -- 172.21.15.110:0/2104199222 shutdown_connections 2024-09-12T02:14:13.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.753+0000 7f9d0c200640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f9cec0a2c10 0x7f9cec0a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:13.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.753+0000 7f9d0c200640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d04106f20 0x7f9d0419cdd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:13.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.753+0000 7f9d0c200640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9d041027a0 0x7f9d04198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:13.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.753+0000 7f9d0c200640 1 --2- 172.21.15.110:0/2104199222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d04101df0 0x7f9d04198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:13.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.753+0000 7f9d0c200640 1 -- 172.21.15.110:0/2104199222 >> 172.21.15.110:0/2104199222 conn(0x7f9d040fd8b0 msgr2=0x7f9d040feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:13.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.753+0000 7f9d0c200640 1 -- 172.21.15.110:0/2104199222 shutdown_connections 2024-09-12T02:14:13.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:13.753+0000 7f9d0c200640 1 -- 172.21.15.110:0/2104199222 wait complete. 2024-09-12T02:14:14.591 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T02:14:14.592 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:14:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:14 smithi136 ceph-mon[35814]: pgmap v371: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:14 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2104199222' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:14:14.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:14 smithi110 ceph-mon[30548]: pgmap v371: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:14.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:14 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2104199222' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:14:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:15.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:14 smithi115 ceph-mon[35351]: pgmap v371: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:15.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:14 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2104199222' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T02:14:15.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.602+0000 7f04c9e00640 1 -- 172.21.15.110:0/3990311974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c4103e30 msgr2=0x7f04c4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:15.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.602+0000 7f04c9e00640 1 --2- 172.21.15.110:0/3990311974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c4103e30 0x7f04c4104210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009900 tx=0x7f04b802a410 comp rx=0 tx=0).stop 2024-09-12T02:14:15.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.603+0000 7f04c9e00640 1 -- 172.21.15.110:0/3990311974 shutdown_connections 2024-09-12T02:14:15.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.603+0000 7f04c9e00640 1 --2- 172.21.15.110:0/3990311974 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c4108f60 0x7f04c4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:15.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.603+0000 7f04c9e00640 1 --2- 172.21.15.110:0/3990311974 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04c41047e0 0x7f04c4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:15.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.603+0000 7f04c9e00640 1 --2- 172.21.15.110:0/3990311974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c4103e30 0x7f04c4104210 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:15.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.603+0000 7f04c9e00640 1 -- 172.21.15.110:0/3990311974 >> 172.21.15.110:0/3990311974 conn(0x7f04c40ff8d0 msgr2=0x7f04c4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:15.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.603+0000 7f04c9e00640 1 -- 172.21.15.110:0/3990311974 shutdown_connections 2024-09-12T02:14:15.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.603+0000 7f04c9e00640 1 -- 172.21.15.110:0/3990311974 wait complete. 2024-09-12T02:14:15.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.604+0000 7f04c9e00640 1 Processor -- start 2024-09-12T02:14:15.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.604+0000 7f04c9e00640 1 -- start start 2024-09-12T02:14:15.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.604+0000 7f04c9e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04c4103e30 0x7f04c4110940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:15.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.604+0000 7f04c9e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c41047e0 0x7f04c410d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:15.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.604+0000 7f04c9e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c4108f60 0x7f04c410df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:15.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.604+0000 7f04c9e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f04c4114010 con 0x7f04c4108f60 2024-09-12T02:14:15.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.604+0000 7f04c9e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f04c4113e90 con 0x7f04c41047e0 2024-09-12T02:14:15.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.604+0000 7f04c9e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04c4114190 con 0x7f04c4103e30 2024-09-12T02:14:15.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.604+0000 7f04c3e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c41047e0 0x7f04c410d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:15.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.604+0000 7f04c3e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c41047e0 0x7f04c410d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:34258/0 (socket says 172.21.15.110:34258) 2024-09-12T02:14:15.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.604+0000 7f04c3e00640 1 -- 172.21.15.110:0/2661456206 learned_addr learned my addr 172.21.15.110:0/2661456206 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:15.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.604+0000 7f04c8a00640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04c4103e30 0x7f04c4110940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:15.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.605+0000 7f04c9400640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c4108f60 0x7f04c410df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:15.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.605+0000 7f04c3e00640 1 -- 172.21.15.110:0/2661456206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04c4103e30 msgr2=0x7f04c4110940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:15.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.605+0000 7f04c3e00640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04c4103e30 0x7f04c4110940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:15.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.605+0000 7f04c3e00640 1 -- 172.21.15.110:0/2661456206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c4108f60 msgr2=0x7f04c410df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:15.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.605+0000 7f04c3e00640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c4108f60 0x7f04c410df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:15.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.605+0000 7f04c3e00640 1 -- 172.21.15.110:0/2661456206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04c410e7c0 con 0x7f04c41047e0 2024-09-12T02:14:15.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.605+0000 7f04c3e00640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c41047e0 0x7f04c410d9f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f04b000e9f0 tx=0x7f04b000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:15.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.605+0000 7f04c1600640 1 -- 172.21.15.110:0/2661456206 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b000cd80 con 0x7f04c41047e0 2024-09-12T02:14:15.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.605+0000 7f04c9e00640 1 -- 172.21.15.110:0/2661456206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04c41aadf0 con 0x7f04c41047e0 2024-09-12T02:14:15.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.605+0000 7f04c1600640 1 -- 172.21.15.110:0/2661456206 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04b0005500 con 0x7f04c41047e0 2024-09-12T02:14:15.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.605+0000 7f04c1600640 1 -- 172.21.15.110:0/2661456206 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b0010690 con 0x7f04c41047e0 2024-09-12T02:14:15.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.606+0000 7f04c9e00640 1 -- 172.21.15.110:0/2661456206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04c41ab250 con 0x7f04c41047e0 2024-09-12T02:14:15.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.607+0000 7f04c9e00640 1 -- 172.21.15.110:0/2661456206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04c4105310 con 0x7f04c41047e0 2024-09-12T02:14:15.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.609+0000 7f04c1600640 1 -- 172.21.15.110:0/2661456206 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f04b00046c0 con 0x7f04c41047e0 2024-09-12T02:14:15.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.610+0000 7f04c1600640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f04ac0a2c10 0x7f04ac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:15.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.611+0000 7f04c1600640 1 -- 172.21.15.110:0/2661456206 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f04b00cf940 con 0x7f04c41047e0 2024-09-12T02:14:15.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.611+0000 7f04c8a00640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f04ac0a2c10 0x7f04ac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:15.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.611+0000 7f04c8a00640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f04ac0a2c10 0x7f04ac0a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f04b8000c00 tx=0x7f04b8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:15.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.612+0000 7f04c1600640 1 -- 172.21.15.110:0/2661456206 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f04b009c340 con 0x7f04c41047e0 2024-09-12T02:14:15.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.825+0000 7f04c9e00640 1 -- 172.21.15.110:0/2661456206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04c410ef20 con 0x7f04c41047e0 2024-09-12T02:14:15.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.826+0000 7f04c1600640 1 -- 172.21.15.110:0/2661456206 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11932 (secure 0 0 0) 0x7f04b009bc40 con 0x7f04c41047e0 2024-09-12T02:14:15.827 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:15.827 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"btime":"2024-09-12T02:13:05:600095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:12:13.698489+0000","modified":"2024-09-12T02:13:04.635785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.110:6841/4021694968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":4021694968},{"type":"v1","addr":"172.21.15.110:6841","nonce":4021694968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6839/1796624254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1796624254},{"type":"v1","addr":"172.21.15.115:6839","nonce":1796624254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24538,24517]},"id":1}]} 2024-09-12T02:14:15.827 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-09-12T02:14:15.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.828+0000 7f04c9e00640 1 -- 172.21.15.110:0/2661456206 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f04ac0a2c10 msgr2=0x7f04ac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:15.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.828+0000 7f04c9e00640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f04ac0a2c10 0x7f04ac0a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f04b8000c00 tx=0x7f04b8005b50 comp rx=0 tx=0).stop 2024-09-12T02:14:15.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.828+0000 7f04c9e00640 1 -- 172.21.15.110:0/2661456206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c41047e0 msgr2=0x7f04c410d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:15.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.828+0000 7f04c9e00640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c41047e0 0x7f04c410d9f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f04b000e9f0 tx=0x7f04b000edf0 comp rx=0 tx=0).stop 2024-09-12T02:14:15.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.828+0000 7f04c9e00640 1 -- 172.21.15.110:0/2661456206 shutdown_connections 2024-09-12T02:14:15.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.828+0000 7f04c9e00640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f04ac0a2c10 0x7f04ac0a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:15.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.828+0000 7f04c9e00640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c4108f60 0x7f04c410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:15.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.828+0000 7f04c9e00640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04c41047e0 0x7f04c410d9f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:15.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.828+0000 7f04c9e00640 1 --2- 172.21.15.110:0/2661456206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04c4103e30 0x7f04c4110940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:15.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.828+0000 7f04c9e00640 1 -- 172.21.15.110:0/2661456206 >> 172.21.15.110:0/2661456206 conn(0x7f04c40ff8d0 msgr2=0x7f04c4100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:15.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.829+0000 7f04c9e00640 1 -- 172.21.15.110:0/2661456206 shutdown_connections 2024-09-12T02:14:15.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:15.829+0000 7f04c9e00640 1 -- 172.21.15.110:0/2661456206 wait complete. 2024-09-12T02:14:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:15 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:15 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:15 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:14:15.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:15 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:14:15.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:15 smithi136 ceph-mon[35814]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:14:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:14:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:15 smithi110 ceph-mon[30548]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:16.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:15 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:15 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:15 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:14:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:15 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:14:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:15 smithi115 ceph-mon[35351]: from='mgr.14150 172.21.15.110:0/1802522177' entity='mgr.x' 2024-09-12T02:14:16.653 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:14:16.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:16 smithi136 ceph-mon[35814]: pgmap v372: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:16.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:16 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2661456206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:16.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:16 smithi110 ceph-mon[30548]: pgmap v372: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:16.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:16 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2661456206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:17.022 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:17.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:16 smithi115 ceph-mon[35351]: pgmap v372: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:17.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:16 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2661456206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:17.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.618+0000 7fec5de00640 1 -- 172.21.15.110:0/2447969347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec581047e0 msgr2=0x7fec58108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.618+0000 7fec5de00640 1 --2- 172.21.15.110:0/2447969347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec581047e0 0x7fec58108830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fec44009900 tx=0x7fec4402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:14:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.618+0000 7fec5de00640 1 -- 172.21.15.110:0/2447969347 shutdown_connections 2024-09-12T02:14:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.618+0000 7fec5de00640 1 --2- 172.21.15.110:0/2447969347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec58108f60 0x7fec58110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.618+0000 7fec5de00640 1 --2- 172.21.15.110:0/2447969347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec581047e0 0x7fec58108830 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.618+0000 7fec5de00640 1 --2- 172.21.15.110:0/2447969347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec58103e30 0x7fec58104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.618+0000 7fec5de00640 1 -- 172.21.15.110:0/2447969347 >> 172.21.15.110:0/2447969347 conn(0x7fec580ff8d0 msgr2=0x7fec58101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.618+0000 7fec5de00640 1 -- 172.21.15.110:0/2447969347 shutdown_connections 2024-09-12T02:14:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.618+0000 7fec5de00640 1 -- 172.21.15.110:0/2447969347 wait complete. 2024-09-12T02:14:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.619+0000 7fec5de00640 1 Processor -- start 2024-09-12T02:14:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.619+0000 7fec5de00640 1 -- start start 2024-09-12T02:14:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5de00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec58103e30 0x7fec5819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5de00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec581047e0 0x7fec5819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec58108f60 0x7fec5819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5de00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fec58114010 con 0x7fec58108f60 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5de00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fec58113e90 con 0x7fec58103e30 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5de00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fec58114190 con 0x7fec581047e0 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec58108f60 0x7fec5819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec58108f60 0x7fec5819ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57778/0 (socket says 172.21.15.110:57778) 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5d400640 1 -- 172.21.15.110:0/1256332879 learned_addr learned my addr 172.21.15.110:0/1256332879 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5ca00640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec58103e30 0x7fec5819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec57e00640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec581047e0 0x7fec5819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5d400640 1 -- 172.21.15.110:0/1256332879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec581047e0 msgr2=0x7fec5819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5d400640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec581047e0 0x7fec5819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5d400640 1 -- 172.21.15.110:0/1256332879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec58103e30 msgr2=0x7fec5819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5d400640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec58103e30 0x7fec5819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec5d400640 1 -- 172.21.15.110:0/1256332879 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5819f440 con 0x7fec58108f60 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.620+0000 7fec57e00640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec581047e0 0x7fec5819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.621+0000 7fec5d400640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec58108f60 0x7fec5819ed60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fec5000efd0 tx=0x7fec5000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.621+0000 7fec55600640 1 -- 172.21.15.110:0/1256332879 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec50003b70 con 0x7fec58108f60 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.621+0000 7fec55600640 1 -- 172.21.15.110:0/1256332879 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec50003d10 con 0x7fec58108f60 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.621+0000 7fec5de00640 1 -- 172.21.15.110:0/1256332879 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5819f730 con 0x7fec58108f60 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.621+0000 7fec55600640 1 -- 172.21.15.110:0/1256332879 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec500109f0 con 0x7fec58108f60 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.621+0000 7fec5de00640 1 -- 172.21.15.110:0/1256332879 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec581a7010 con 0x7fec58108f60 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.622+0000 7fec5de00640 1 -- 172.21.15.110:0/1256332879 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec58104210 con 0x7fec58108f60 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.624+0000 7fec55600640 1 -- 172.21.15.110:0/1256332879 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fec50004020 con 0x7fec58108f60 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.626+0000 7fec55600640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fec400a2c10 0x7fec400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.626+0000 7fec55600640 1 -- 172.21.15.110:0/1256332879 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fec500cfa20 con 0x7fec58108f60 2024-09-12T02:14:17.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.626+0000 7fec5ca00640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fec400a2c10 0x7fec400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:17.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.627+0000 7fec5ca00640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fec400a2c10 0x7fec400a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009bd0 tx=0x7fec4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:17.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.630+0000 7fec55600640 1 -- 172.21.15.110:0/1256332879 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec5009c420 con 0x7fec58108f60 2024-09-12T02:14:17.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.844+0000 7fec5de00640 1 -- 172.21.15.110:0/1256332879 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec5810c200 con 0x7fec58108f60 2024-09-12T02:14:17.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.844+0000 7fec55600640 1 -- 172.21.15.110:0/1256332879 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11932 (secure 0 0 0) 0x7fec5009bd20 con 0x7fec58108f60 2024-09-12T02:14:17.845 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-09-12T02:14:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:17.846 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"btime":"2024-09-12T02:13:05:600095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:12:13.698489+0000","modified":"2024-09-12T02:13:04.635785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.110:6841/4021694968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":4021694968},{"type":"v1","addr":"172.21.15.110:6841","nonce":4021694968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6839/1796624254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1796624254},{"type":"v1","addr":"172.21.15.115:6839","nonce":1796624254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24538,24517]},"id":1}]} 2024-09-12T02:14:17.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.847+0000 7fec5de00640 1 -- 172.21.15.110:0/1256332879 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fec400a2c10 msgr2=0x7fec400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:17.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.847+0000 7fec5de00640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fec400a2c10 0x7fec400a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec4c009bd0 tx=0x7fec4c005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:17.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.847+0000 7fec5de00640 1 -- 172.21.15.110:0/1256332879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec58108f60 msgr2=0x7fec5819ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:17.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.847+0000 7fec5de00640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec58108f60 0x7fec5819ed60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fec5000efd0 tx=0x7fec5000c6a0 comp rx=0 tx=0).stop 2024-09-12T02:14:17.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.847+0000 7fec5de00640 1 -- 172.21.15.110:0/1256332879 shutdown_connections 2024-09-12T02:14:17.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.847+0000 7fec5de00640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fec400a2c10 0x7fec400a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:17.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.847+0000 7fec5de00640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec58108f60 0x7fec5819ed60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:17.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.847+0000 7fec5de00640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec581047e0 0x7fec5819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:17.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.847+0000 7fec5de00640 1 --2- 172.21.15.110:0/1256332879 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec58103e30 0x7fec5819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:17.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.847+0000 7fec5de00640 1 -- 172.21.15.110:0/1256332879 >> 172.21.15.110:0/1256332879 conn(0x7fec580ff8d0 msgr2=0x7fec58100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:17.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.847+0000 7fec5de00640 1 -- 172.21.15.110:0/1256332879 shutdown_connections 2024-09-12T02:14:17.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:17.847+0000 7fec5de00640 1 -- 172.21.15.110:0/1256332879 wait complete. 2024-09-12T02:14:18.642 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:14:18.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:18 smithi110 ceph-mon[30548]: pgmap v373: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:18.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:18 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1256332879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:19.012 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:19.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:18 smithi115 ceph-mon[35351]: pgmap v373: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:19.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:18 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1256332879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:19.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:18 smithi136 ceph-mon[35814]: pgmap v373: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:19.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:18 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1256332879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:19.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.660+0000 7f970ec00640 1 -- 172.21.15.110:0/3831817547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f970810c180 msgr2=0x7f970810e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:19.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.660+0000 7f970ec00640 1 --2- 172.21.15.110:0/3831817547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f970810c180 0x7f970810e620 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9700009ca0 tx=0x7f970002a940 comp rx=0 tx=0).stop 2024-09-12T02:14:19.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.660+0000 7f970ec00640 1 -- 172.21.15.110:0/3831817547 shutdown_connections 2024-09-12T02:14:19.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.660+0000 7f970ec00640 1 --2- 172.21.15.110:0/3831817547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f970810c180 0x7f970810e620 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:19.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.660+0000 7f970ec00640 1 --2- 172.21.15.110:0/3831817547 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9708103670 0x7f970810bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:19.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.660+0000 7f970ec00640 1 --2- 172.21.15.110:0/3831817547 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9708102d50 0x7f9708103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:19.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.660+0000 7f970ec00640 1 -- 172.21.15.110:0/3831817547 >> 172.21.15.110:0/3831817547 conn(0x7f97080fc7d0 msgr2=0x7f97080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:19.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.660+0000 7f970ec00640 1 -- 172.21.15.110:0/3831817547 shutdown_connections 2024-09-12T02:14:19.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.660+0000 7f970ec00640 1 -- 172.21.15.110:0/3831817547 wait complete. 2024-09-12T02:14:19.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.661+0000 7f970ec00640 1 Processor -- start 2024-09-12T02:14:19.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.662+0000 7f970ec00640 1 -- start start 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.662+0000 7f970ec00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9708102d50 0x7f970819f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.662+0000 7f970ec00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9708103670 0x7f970819f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.662+0000 7f970ec00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f970810c180 0x7f970819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.662+0000 7f970ec00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9708100db0 con 0x7f9708103670 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.662+0000 7f970ec00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9708100c30 con 0x7f970810c180 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.662+0000 7f970ec00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9708100f30 con 0x7f9708102d50 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.662+0000 7f9707e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9708102d50 0x7f970819f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.662+0000 7f9707e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9708102d50 0x7f970819f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:44576/0 (socket says 172.21.15.110:44576) 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.662+0000 7f9707e00640 1 -- 172.21.15.110:0/2370460576 learned_addr learned my addr 172.21.15.110:0/2370460576 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.662+0000 7f970cc00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f970810c180 0x7f970819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.662+0000 7f96ffe00640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9708103670 0x7f970819f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.663+0000 7f9707e00640 1 -- 172.21.15.110:0/2370460576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f970810c180 msgr2=0x7f970819ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:19.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.663+0000 7f9707e00640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f970810c180 0x7f970819ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:19.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.663+0000 7f9707e00640 1 -- 172.21.15.110:0/2370460576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9708103670 msgr2=0x7f970819f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:19.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.663+0000 7f9707e00640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9708103670 0x7f970819f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:19.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.663+0000 7f9707e00640 1 -- 172.21.15.110:0/2370460576 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970819b470 con 0x7f9708102d50 2024-09-12T02:14:19.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.663+0000 7f9707e00640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9708102d50 0x7f970819f200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f96f800e9f0 tx=0x7f96f800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:19.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.663+0000 7f9705600640 1 -- 172.21.15.110:0/2370460576 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f800cd80 con 0x7f9708102d50 2024-09-12T02:14:19.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.663+0000 7f9705600640 1 -- 172.21.15.110:0/2370460576 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96f8010910 con 0x7f9708102d50 2024-09-12T02:14:19.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.663+0000 7f9705600640 1 -- 172.21.15.110:0/2370460576 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f8018990 con 0x7f9708102d50 2024-09-12T02:14:19.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.664+0000 7f970ec00640 1 -- 172.21.15.110:0/2370460576 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970819b760 con 0x7f9708102d50 2024-09-12T02:14:19.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.664+0000 7f970ec00640 1 -- 172.21.15.110:0/2370460576 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97081a72e0 con 0x7f9708102d50 2024-09-12T02:14:19.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.665+0000 7f970ec00640 1 -- 172.21.15.110:0/2370460576 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f970806b070 con 0x7f9708102d50 2024-09-12T02:14:19.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.666+0000 7f9705600640 1 -- 172.21.15.110:0/2370460576 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f96f8010ac0 con 0x7f9708102d50 2024-09-12T02:14:19.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.668+0000 7f9705600640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f96ec0a2c10 0x7f96ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:19.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.668+0000 7f9705600640 1 -- 172.21.15.110:0/2370460576 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f96f80cf880 con 0x7f9708102d50 2024-09-12T02:14:19.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.668+0000 7f96ffe00640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f96ec0a2c10 0x7f96ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:19.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.668+0000 7f96ffe00640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f96ec0a2c10 0x7f96ec0a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f970810e090 tx=0x7f96f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:19.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.672+0000 7f9705600640 1 -- 172.21.15.110:0/2370460576 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96f809bc90 con 0x7f9708102d50 2024-09-12T02:14:19.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.849+0000 7f970ec00640 1 -- 172.21.15.110:0/2370460576 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f970810be50 con 0x7f9708102d50 2024-09-12T02:14:19.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.851+0000 7f9705600640 1 -- 172.21.15.110:0/2370460576 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+24936 (secure 0 0 0) 0x7f96f809ff90 con 0x7f9708102d50 2024-09-12T02:14:19.852 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:19.852 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":97,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:13:46.686934+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:12:08.596125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:12:11.312393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:12:21.215161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:14:19.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.853+0000 7f970ec00640 1 -- 172.21.15.110:0/2370460576 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f96ec0a2c10 msgr2=0x7f96ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:19.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.853+0000 7f970ec00640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f96ec0a2c10 0x7f96ec0a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f970810e090 tx=0x7f96f0005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:19.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.853+0000 7f970ec00640 1 -- 172.21.15.110:0/2370460576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9708102d50 msgr2=0x7f970819f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:19.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.854+0000 7f970ec00640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9708102d50 0x7f970819f200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f96f800e9f0 tx=0x7f96f800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:14:19.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.854+0000 7f970ec00640 1 -- 172.21.15.110:0/2370460576 shutdown_connections 2024-09-12T02:14:19.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.854+0000 7f970ec00640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f96ec0a2c10 0x7f96ec0a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:19.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.854+0000 7f970ec00640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f970810c180 0x7f970819ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:19.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.854+0000 7f970ec00640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9708103670 0x7f970819f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:19.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.854+0000 7f970ec00640 1 --2- 172.21.15.110:0/2370460576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9708102d50 0x7f970819f200 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:19.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.854+0000 7f970ec00640 1 -- 172.21.15.110:0/2370460576 >> 172.21.15.110:0/2370460576 conn(0x7f97080fc7d0 msgr2=0x7f970810c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:19.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.854+0000 7f970ec00640 1 -- 172.21.15.110:0/2370460576 shutdown_connections 2024-09-12T02:14:19.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:19.854+0000 7f970ec00640 1 -- 172.21.15.110:0/2370460576 wait complete. 2024-09-12T02:14:20.653 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:14:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:20 smithi110 ceph-mon[30548]: pgmap v374: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:20 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2370460576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:14:21.024 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:21.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:20 smithi115 ceph-mon[35351]: pgmap v374: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:21.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:20 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2370460576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:14:21.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:20 smithi136 ceph-mon[35814]: pgmap v374: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:21.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:20 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2370460576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:14:21.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.570+0000 7f4312600640 1 -- 172.21.15.110:0/1129778259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430c101de0 msgr2=0x7f430c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:21.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.570+0000 7f4312600640 1 --2- 172.21.15.110:0/1129778259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430c101de0 0x7f430c1021c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009900 tx=0x7f42fc02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:14:21.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.570+0000 7f4312600640 1 -- 172.21.15.110:0/1129778259 shutdown_connections 2024-09-12T02:14:21.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.570+0000 7f4312600640 1 --2- 172.21.15.110:0/1129778259 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f430c106f10 0x7f430c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:21.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.570+0000 7f4312600640 1 --2- 172.21.15.110:0/1129778259 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f430c102790 0x7f430c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:21.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.570+0000 7f4312600640 1 --2- 172.21.15.110:0/1129778259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430c101de0 0x7f430c1021c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:21.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.570+0000 7f4312600640 1 -- 172.21.15.110:0/1129778259 >> 172.21.15.110:0/1129778259 conn(0x7f430c0fd8c0 msgr2=0x7f430c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:21.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.570+0000 7f4312600640 1 -- 172.21.15.110:0/1129778259 shutdown_connections 2024-09-12T02:14:21.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.570+0000 7f4312600640 1 -- 172.21.15.110:0/1129778259 wait complete. 2024-09-12T02:14:21.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.571+0000 7f4312600640 1 Processor -- start 2024-09-12T02:14:21.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.571+0000 7f4312600640 1 -- start start 2024-09-12T02:14:21.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.571+0000 7f4312600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430c101de0 0x7f430c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:21.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f4312600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f430c102790 0x7f430c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:21.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f4312600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f430c106f10 0x7f430c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:21.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f4312600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f430c111fc0 con 0x7f430c101de0 2024-09-12T02:14:21.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f4312600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f430c111e40 con 0x7f430c102790 2024-09-12T02:14:21.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f4312600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f430c112140 con 0x7f430c106f10 2024-09-12T02:14:21.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f430b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430c101de0 0x7f430c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:21.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f430b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430c101de0 0x7f430c19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42060/0 (socket says 172.21.15.110:42060) 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f430b400640 1 -- 172.21.15.110:0/1813733509 learned_addr learned my addr 172.21.15.110:0/1813733509 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f430be00640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f430c106f10 0x7f430c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f4302a00640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f430c102790 0x7f430c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f4302a00640 1 -- 172.21.15.110:0/1813733509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f430c106f10 msgr2=0x7f430c19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f4302a00640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f430c106f10 0x7f430c19ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f4302a00640 1 -- 172.21.15.110:0/1813733509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430c101de0 msgr2=0x7f430c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f4302a00640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430c101de0 0x7f430c19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f4302a00640 1 -- 172.21.15.110:0/1813733509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c19f630 con 0x7f430c102790 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f430b400640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430c101de0 0x7f430c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.572+0000 7f430be00640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f430c106f10 0x7f430c19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.573+0000 7f4302a00640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f430c102790 0x7f430c19abc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f42f400e9f0 tx=0x7f42f400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.573+0000 7f4308c00640 1 -- 172.21.15.110:0/1813733509 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f400ccc0 con 0x7f430c102790 2024-09-12T02:14:21.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.573+0000 7f4312600640 1 -- 172.21.15.110:0/1813733509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430c19f920 con 0x7f430c102790 2024-09-12T02:14:21.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.573+0000 7f4308c00640 1 -- 172.21.15.110:0/1813733509 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42f4005020 con 0x7f430c102790 2024-09-12T02:14:21.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.573+0000 7f4308c00640 1 -- 172.21.15.110:0/1813733509 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4004a00 con 0x7f430c102790 2024-09-12T02:14:21.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.573+0000 7f4312600640 1 -- 172.21.15.110:0/1813733509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430c1a7200 con 0x7f430c102790 2024-09-12T02:14:21.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.574+0000 7f4312600640 1 -- 172.21.15.110:0/1813733509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430c1021c0 con 0x7f430c102790 2024-09-12T02:14:21.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.577+0000 7f4308c00640 1 -- 172.21.15.110:0/1813733509 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f42f40051d0 con 0x7f430c102790 2024-09-12T02:14:21.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.578+0000 7f4308c00640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f42f00a2c10 0x7f42f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:21.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.578+0000 7f4308c00640 1 -- 172.21.15.110:0/1813733509 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f42f40cf5e0 con 0x7f430c102790 2024-09-12T02:14:21.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.578+0000 7f430b400640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f42f00a2c10 0x7f42f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:21.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.579+0000 7f430b400640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f42f00a2c10 0x7f42f00a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0096c0 tx=0x7f42fc0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:21.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.579+0000 7f4308c00640 1 -- 172.21.15.110:0/1813733509 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42f409c070 con 0x7f430c102790 2024-09-12T02:14:21.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.790+0000 7f4312600640 1 -- 172.21.15.110:0/1813733509 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f430c19b9e0 con 0x7f430c102790 2024-09-12T02:14:21.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.791+0000 7f4308c00640 1 -- 172.21.15.110:0/1813733509 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11932 (secure 0 0 0) 0x7f42f409b970 con 0x7f430c102790 2024-09-12T02:14:21.792 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:21.793 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"btime":"2024-09-12T02:13:05:600095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:12:13.698489+0000","modified":"2024-09-12T02:13:04.635785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.110:6841/4021694968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":4021694968},{"type":"v1","addr":"172.21.15.110:6841","nonce":4021694968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6839/1796624254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1796624254},{"type":"v1","addr":"172.21.15.115:6839","nonce":1796624254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24538,24517]},"id":1}]} 2024-09-12T02:14:21.793 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-09-12T02:14:21.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.794+0000 7f4312600640 1 -- 172.21.15.110:0/1813733509 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f42f00a2c10 msgr2=0x7f42f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:21.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.794+0000 7f4312600640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f42f00a2c10 0x7f42f00a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0096c0 tx=0x7f42fc0046c0 comp rx=0 tx=0).stop 2024-09-12T02:14:21.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.794+0000 7f4312600640 1 -- 172.21.15.110:0/1813733509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f430c102790 msgr2=0x7f430c19abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:21.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.794+0000 7f4312600640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f430c102790 0x7f430c19abc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f42f400e9f0 tx=0x7f42f400edf0 comp rx=0 tx=0).stop 2024-09-12T02:14:21.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.794+0000 7f4312600640 1 -- 172.21.15.110:0/1813733509 shutdown_connections 2024-09-12T02:14:21.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.794+0000 7f4312600640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f42f00a2c10 0x7f42f00a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:21.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.794+0000 7f4312600640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f430c106f10 0x7f430c19ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:21.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.794+0000 7f4312600640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f430c102790 0x7f430c19abc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:21.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.794+0000 7f4312600640 1 --2- 172.21.15.110:0/1813733509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430c101de0 0x7f430c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:21.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.794+0000 7f4312600640 1 -- 172.21.15.110:0/1813733509 >> 172.21.15.110:0/1813733509 conn(0x7f430c0fd8c0 msgr2=0x7f430c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:21.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.794+0000 7f4312600640 1 -- 172.21.15.110:0/1813733509 shutdown_connections 2024-09-12T02:14:21.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:21.794+0000 7f4312600640 1 -- 172.21.15.110:0/1813733509 wait complete. 2024-09-12T02:14:22.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:12:13.698489+0000', 'modified': '2024-09-12T02:13:04.635785+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24539, 'mds_1': 24538, 'mds_2': 24517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24493': {'gid': 24493, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6835/2205978549', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 2205978549}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 2205978549}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.115:6837/1922841773', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 1922841773}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 1922841773}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24505': {'gid': 24505, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6837/3503120492', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 3503120492}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 3503120492}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.136:6839/3572987086', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 3572987086}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 3572987086}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.110:6841/4021694968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6840', 'nonce': 4021694968}, {'type': 'v1', 'addr': '172.21.15.110:6841', 'nonce': 4021694968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24539': {'gid': 24539, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.115:6839/1796624254', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6838', 'nonce': 1796624254}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 1796624254}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24539, 'qdb_cluster': [24539, 24538, 24517]} 2024-09-12T02:14:22.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T02:14:22.652 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:14:22.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:22 smithi110 ceph-mon[30548]: pgmap v375: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:22.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:22 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1813733509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:23.023 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:23.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:22 smithi115 ceph-mon[35351]: pgmap v375: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:23.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:22 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1813733509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:23.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:22 smithi136 ceph-mon[35814]: pgmap v375: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:23.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:22 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1813733509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:23.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.676+0000 7f8dcca00640 1 -- 172.21.15.110:0/1349585883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc8104010 msgr2=0x7f8dc81043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:23.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.676+0000 7f8dcca00640 1 --2- 172.21.15.110:0/1349585883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc8104010 0x7f8dc81043f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8db8009900 tx=0x7f8db802a400 comp rx=0 tx=0).stop 2024-09-12T02:14:23.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.676+0000 7f8dcca00640 1 -- 172.21.15.110:0/1349585883 shutdown_connections 2024-09-12T02:14:23.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.676+0000 7f8dcca00640 1 --2- 172.21.15.110:0/1349585883 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc8109140 0x7f8dc8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.677+0000 7f8dcca00640 1 --2- 172.21.15.110:0/1349585883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dc81049c0 0x7f8dc8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.677+0000 7f8dcca00640 1 --2- 172.21.15.110:0/1349585883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc8104010 0x7f8dc81043f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.677+0000 7f8dcca00640 1 -- 172.21.15.110:0/1349585883 >> 172.21.15.110:0/1349585883 conn(0x7f8dc80ffa50 msgr2=0x7f8dc8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:23.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.677+0000 7f8dcca00640 1 -- 172.21.15.110:0/1349585883 shutdown_connections 2024-09-12T02:14:23.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.677+0000 7f8dcca00640 1 -- 172.21.15.110:0/1349585883 wait complete. 2024-09-12T02:14:23.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.677+0000 7f8dcca00640 1 Processor -- start 2024-09-12T02:14:23.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.678+0000 7f8dcca00640 1 -- start start 2024-09-12T02:14:23.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.678+0000 7f8dcca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc8104010 0x7f8dc819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.678+0000 7f8dcca00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc81049c0 0x7f8dc819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.678+0000 7f8dcca00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dc8109140 0x7f8dc819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.678+0000 7f8dcca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc8114190 con 0x7f8dc8104010 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.678+0000 7f8dcca00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc8114010 con 0x7f8dc81049c0 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.678+0000 7f8dcca00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc8114310 con 0x7f8dc8109140 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.678+0000 7f8dc5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc8104010 0x7f8dc819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.678+0000 7f8dc5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc8104010 0x7f8dc819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42072/0 (socket says 172.21.15.110:42072) 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.678+0000 7f8dc5e00640 1 -- 172.21.15.110:0/3098545696 learned_addr learned my addr 172.21.15.110:0/3098545696 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.678+0000 7f8dbd400640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc81049c0 0x7f8dc819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.678+0000 7f8dc6800640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dc8109140 0x7f8dc819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.679+0000 7f8dc5e00640 1 -- 172.21.15.110:0/3098545696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dc8109140 msgr2=0x7f8dc819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.679+0000 7f8dc5e00640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dc8109140 0x7f8dc819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.679+0000 7f8dc5e00640 1 -- 172.21.15.110:0/3098545696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc81049c0 msgr2=0x7f8dc819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:23.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.679+0000 7f8dc5e00640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc81049c0 0x7f8dc819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.679+0000 7f8dc5e00640 1 -- 172.21.15.110:0/3098545696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc819f600 con 0x7f8dc8104010 2024-09-12T02:14:23.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.679+0000 7f8dc5e00640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc8104010 0x7f8dc819a650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8db8004770 tx=0x7f8db8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:23.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.679+0000 7f8dbf400640 1 -- 172.21.15.110:0/3098545696 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db803f070 con 0x7f8dc8104010 2024-09-12T02:14:23.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.679+0000 7f8dbf400640 1 -- 172.21.15.110:0/3098545696 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db8031ca0 con 0x7f8dc8104010 2024-09-12T02:14:23.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.679+0000 7f8dbf400640 1 -- 172.21.15.110:0/3098545696 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db8035030 con 0x7f8dc8104010 2024-09-12T02:14:23.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.679+0000 7f8dcca00640 1 -- 172.21.15.110:0/3098545696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc819f890 con 0x7f8dc8104010 2024-09-12T02:14:23.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.680+0000 7f8dcca00640 1 -- 172.21.15.110:0/3098545696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc81a71d0 con 0x7f8dc8104010 2024-09-12T02:14:23.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.683+0000 7f8dbf400640 1 -- 172.21.15.110:0/3098545696 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f8db8042070 con 0x7f8dc8104010 2024-09-12T02:14:23.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.683+0000 7f8dcf63d740 1 Processor -- start 2024-09-12T02:14:23.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.683+0000 7f8dcf63d740 1 -- start start 2024-09-12T02:14:23.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.684+0000 7f8dcf63d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afba330 0x557c4afba710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.684+0000 7f8dcf63d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afbac50 0x557c4afc4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.684+0000 7f8dcf63d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afc7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.684+0000 7f8dcf63d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557c4af200b0 con 0x557c4afc5510 2024-09-12T02:14:23.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.684+0000 7f8dcf63d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x557c4aec7ab0 con 0x557c4afba330 2024-09-12T02:14:23.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.684+0000 7f8dcf63d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557c4af1c070 con 0x557c4afbac50 2024-09-12T02:14:23.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.684+0000 7f8dc5e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afbac50 0x557c4afc4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.684+0000 7f8dbd400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afc7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.684+0000 7f8dc6800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afba330 0x557c4afba710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.684+0000 7f8dc5e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afbac50 0x557c4afc4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:44636/0 (socket says 172.21.15.110:44636) 2024-09-12T02:14:23.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.684+0000 7f8dc5e00640 1 -- 172.21.15.110:0/2745232295 learned_addr learned my addr 172.21.15.110:0/2745232295 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8dbd400640 1 -- 172.21.15.110:0/2745232295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afbac50 msgr2=0x557c4afc4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8dbd400640 1 --2- 172.21.15.110:0/2745232295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afbac50 0x557c4afc4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8dbd400640 1 -- 172.21.15.110:0/2745232295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afba330 msgr2=0x557c4afba710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8dbd400640 1 --2- 172.21.15.110:0/2745232295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afba330 0x557c4afba710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8dbf400640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8dac0a2c10 0x7f8dac0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8dbd400640 1 -- 172.21.15.110:0/2745232295 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c4aed44a0 con 0x557c4afc5510 2024-09-12T02:14:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8dc6800640 1 --2- 172.21.15.110:0/2745232295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afba330 0x557c4afba710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8dbf400640 1 -- 172.21.15.110:0/3098545696 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f8db80ef990 con 0x7f8dc8104010 2024-09-12T02:14:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8dc5e00640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8dac0a2c10 0x7f8dac0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8dbd400640 1 --2- 172.21.15.110:0/2745232295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afc7900 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8db000bbc0 tx=0x7f8db00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7519c1c9079d9f76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8db7000640 1 -- 172.21.15.110:0/2745232295 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0004030 con 0x557c4afc5510 2024-09-12T02:14:23.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8db7000640 1 -- 172.21.15.110:0/2745232295 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db00041d0 con 0x557c4afc5510 2024-09-12T02:14:23.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.685+0000 7f8db7000640 1 -- 172.21.15.110:0/2745232295 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db00116a0 con 0x557c4afc5510 2024-09-12T02:14:23.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.686+0000 7f8dcf63d740 1 -- 172.21.15.110:0/2745232295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 msgr2=0x557c4afc7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:23.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.686+0000 7f8dc5e00640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8dac0a2c10 0x7f8dac0a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8db80efc30 tx=0x7f8db80f5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:23.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.686+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/2745232295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afc7900 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8db000bbc0 tx=0x7f8db00107a0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.686+0000 7f8dcf63d740 1 -- 172.21.15.110:0/2745232295 shutdown_connections 2024-09-12T02:14:23.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.686+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/2745232295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afc7900 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.686+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/2745232295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afbac50 0x557c4afc4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.686+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/2745232295 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afba330 0x557c4afba710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.686+0000 7f8dcf63d740 1 -- 172.21.15.110:0/2745232295 >> 172.21.15.110:0/2745232295 conn(0x557c4afb68c0 msgr2=0x557c4afb6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:23.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.686+0000 7f8dcf63d740 1 -- 172.21.15.110:0/2745232295 shutdown_connections 2024-09-12T02:14:23.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.686+0000 7f8dcf63d740 1 -- 172.21.15.110:0/2745232295 wait complete. 2024-09-12T02:14:23.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.687+0000 7f8dcf63d740 1 -- start start 2024-09-12T02:14:23.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.687+0000 7f8dcf63d740 1 Processor -- start 2024-09-12T02:14:23.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.687+0000 7f8dcf63d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afba330 0x557c4afc2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.687+0000 7f8dcf63d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afc2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.687+0000 7f8dcf63d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afc3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.687+0000 7f8dcf63d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557c4afc8060 con 0x557c4afc5510 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.687+0000 7f8dcf63d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x557c4aea8920 con 0x557c4afbac50 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.687+0000 7f8dcf63d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557c4afc81e0 con 0x557c4afba330 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.688+0000 7f8dcf63d740 10 client.0 _ll_register_callbacks cb 0x557c4aecc8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.688+0000 7f8dc6800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afba330 0x557c4afc2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.688+0000 7f8dc6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afc3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.688+0000 7f8dbd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afc2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.688+0000 7f8dc6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afc3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42102/0 (socket says 172.21.15.110:42102) 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.688+0000 7f8dc6800640 1 -- 172.21.15.110:0/445886943 learned_addr learned my addr 172.21.15.110:0/445886943 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.688+0000 7f8dbd400640 1 -- 172.21.15.110:0/445886943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afba330 msgr2=0x557c4afc2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.688+0000 7f8dbd400640 1 --2- 172.21.15.110:0/445886943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afba330 0x557c4afc2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.688+0000 7f8dbd400640 1 -- 172.21.15.110:0/445886943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 msgr2=0x557c4afc3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:23.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.688+0000 7f8dbd400640 1 --2- 172.21.15.110:0/445886943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afc3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.688+0000 7f8dbd400640 1 -- 172.21.15.110:0/445886943 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c4ac912b0 con 0x557c4afbac50 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.688+0000 7f8dc6800640 1 --2- 172.21.15.110:0/445886943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afc3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.689+0000 7f8dbd400640 1 --2- 172.21.15.110:0/445886943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afc2ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8db0000c00 tx=0x7f8db000bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=118f99bc0f2df802 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.689+0000 7f8dab400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.689+0000 7f8dab400640 1 -- 172.21.15.110:0/445886943 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db002a060 con 0x557c4afbac50 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.689+0000 7f8dcf63d740 1 -- 172.21.15.110:0/445886943 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8db00041d0 con 0x557c4afbac50 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.689+0000 7f8dab400640 1 -- 172.21.15.110:0/445886943 <== mon.2 v2:172.21.15.115:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f8db0004480 con 0x557c4afbac50 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.689+0000 7f8dab400640 1 -- 172.21.15.110:0/445886943 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8db0031050 con 0x557c4afbac50 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.689+0000 7f8dcf63d740 10 client.24980 fetch_fsmap learned FSMap version 25 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.689+0000 7f8dcf63d740 1 -- 172.21.15.110:0/445886943 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c4afd3e10 con 0x557c4afbac50 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.690+0000 7f8dab400640 1 -- 172.21.15.110:0/445886943 <== mon.2 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db00041d0 con 0x557c4afbac50 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.690+0000 7f8dab400640 1 -- 172.21.15.110:0/445886943 <== mon.2 v2:172.21.15.115:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f8db00046c0 con 0x557c4afbac50 2024-09-12T02:14:23.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.690+0000 7f8dcf63d740 10 client.24980 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:14:23.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.690+0000 7f8dcf63d740 10 client.24980 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:14:23.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.690+0000 7f8dcf63d740 20 client.24980 populate_metadata read hostname 'smithi110' 2024-09-12T02:14:23.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.690+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/445886943 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x557c4afd6040 0x557c4afd74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.690+0000 7f8dcf63d740 4 client.24980 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:14:23.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.690+0000 7f8dcf63d740 1 -- 172.21.15.110:0/445886943 --> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c4af2d620 con 0x557c4afd6040 2024-09-12T02:14:23.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.690+0000 7f8dc6800640 1 --2- 172.21.15.110:0/445886943 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x557c4afd6040 0x557c4afd74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.691+0000 7f8dc6800640 1 --2- 172.21.15.110:0/445886943 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x557c4afd6040 0x557c4afd74b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=23f290a10420d9b6 server_cookie=93eabf47e1bf8615 in_seq=0 out_seq=0 2024-09-12T02:14:23.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.691+0000 7f8dab400640 10 client.24980 ms_handle_connect on v2:172.21.15.136:6838/3572987086 2024-09-12T02:14:23.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dab400640 1 -- 172.21.15.110:0/445886943 <== mds.2 v2:172.21.15.136:6838/3572987086 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c4af2d620 con 0x557c4afd6040 2024-09-12T02:14:23.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dab400640 10 client.24980 handle_command_reply: tid=0 2024-09-12T02:14:23.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dcf63d740 1 client.24980 shutdown 2024-09-12T02:14:23.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dcf63d740 1 -- 172.21.15.110:0/445886943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 msgr2=0x557c4afc2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:23.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/445886943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afc2ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8db0000c00 tx=0x7f8db000bfa0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dcf63d740 1 -- 172.21.15.110:0/445886943 shutdown_connections 2024-09-12T02:14:23.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/445886943 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x557c4afd6040 0x557c4afd74b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/445886943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afc3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/445886943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afc2ac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dab400640 0 client.24980 ms_handle_reset on v2:172.21.15.136:6838/3572987086 2024-09-12T02:14:23.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/445886943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afba330 0x557c4afc2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dcf63d740 1 -- 172.21.15.110:0/445886943 >> 172.21.15.110:0/445886943 conn(0x557c4afb68c0 msgr2=0x557c4afbc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:23.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dcf63d740 1 -- 172.21.15.110:0/445886943 shutdown_connections 2024-09-12T02:14:23.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dcf63d740 1 -- 172.21.15.110:0/445886943 wait complete. 2024-09-12T02:14:23.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.692+0000 7f8dcf63d740 20 client.24980 trim_cache size 0 max 16384 2024-09-12T02:14:23.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.711+0000 7f8dcf63d740 1 Processor -- start 2024-09-12T02:14:23.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.711+0000 7f8dcf63d740 1 -- start start 2024-09-12T02:14:23.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.711+0000 7f8dcf63d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afba330 0x557c4afd74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.711+0000 7f8dcf63d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afc0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.711+0000 7f8dcf63d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afc5510 0x557c4afc1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.711+0000 7f8dcf63d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557c4afd57f0 con 0x557c4afba330 2024-09-12T02:14:23.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.711+0000 7f8dcf63d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x557c4afd5ec0 con 0x557c4afbac50 2024-09-12T02:14:23.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.711+0000 7f8dcf63d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557c4afd6590 con 0x557c4afc5510 2024-09-12T02:14:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.711+0000 7f8dc6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afba330 0x557c4afd74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.711+0000 7f8dbd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afc0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.711+0000 7f8dbd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afc0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:53160/0 (socket says 172.21.15.110:53160) 2024-09-12T02:14:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.711+0000 7f8dc6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afba330 0x557c4afd74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42112/0 (socket says 172.21.15.110:42112) 2024-09-12T02:14:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.712+0000 7f8dbd400640 1 -- 172.21.15.110:0/3017653102 learned_addr learned my addr 172.21.15.110:0/3017653102 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.712+0000 7f8dc6800640 1 --2- 172.21.15.110:0/3017653102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afc5510 0x557c4afc1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.712+0000 7f8dbd400640 1 -- 172.21.15.110:0/3017653102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afc5510 msgr2=0x557c4afc1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.712+0000 7f8dbd400640 1 --2- 172.21.15.110:0/3017653102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afc5510 0x557c4afc1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.712+0000 7f8dbd400640 1 -- 172.21.15.110:0/3017653102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afba330 msgr2=0x557c4afd74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.712+0000 7f8dbd400640 1 --2- 172.21.15.110:0/3017653102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afba330 0x557c4afd74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.712+0000 7f8dbd400640 1 -- 172.21.15.110:0/3017653102 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c4afb7550 con 0x557c4afbac50 2024-09-12T02:14:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.712+0000 7f8dc6800640 1 --2- 172.21.15.110:0/3017653102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afc5510 0x557c4afc1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.712+0000 7f8dbd400640 1 --2- 172.21.15.110:0/3017653102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afc0e50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8db0011010 tx=0x7f8db00107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd5dfa9ed46c9e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.712+0000 7f8db6600640 1 -- 172.21.15.110:0/3017653102 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db00053b0 con 0x557c4afbac50 2024-09-12T02:14:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.712+0000 7f8db6600640 1 -- 172.21.15.110:0/3017653102 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8db0005bf0 con 0x557c4afbac50 2024-09-12T02:14:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.712+0000 7f8db6600640 1 -- 172.21.15.110:0/3017653102 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db00042e0 con 0x557c4afbac50 2024-09-12T02:14:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.713+0000 7f8dcf63d740 1 -- 172.21.15.110:0/3017653102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 msgr2=0x557c4afc0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:23.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.713+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/3017653102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afc0e50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8db0011010 tx=0x7f8db00107a0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.713+0000 7f8dcf63d740 1 -- 172.21.15.110:0/3017653102 shutdown_connections 2024-09-12T02:14:23.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.713+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/3017653102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afc5510 0x557c4afc1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.713+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/3017653102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afc0e50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.713+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/3017653102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afba330 0x557c4afd74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.713+0000 7f8dcf63d740 1 -- 172.21.15.110:0/3017653102 >> 172.21.15.110:0/3017653102 conn(0x557c4afb68c0 msgr2=0x557c4afb1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:23.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.713+0000 7f8dcf63d740 1 -- 172.21.15.110:0/3017653102 shutdown_connections 2024-09-12T02:14:23.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.713+0000 7f8dcf63d740 1 -- 172.21.15.110:0/3017653102 wait complete. 2024-09-12T02:14:23.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.714+0000 7f8dcf63d740 1 -- start start 2024-09-12T02:14:23.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.714+0000 7f8dcf63d740 1 Processor -- start 2024-09-12T02:14:23.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.714+0000 7f8dcf63d740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afba330 0x557c4afdfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.714+0000 7f8dcf63d740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afe0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.714+0000 7f8dcf63d740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afd9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.714+0000 7f8dcf63d740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x557c4afd7330 con 0x557c4afc5510 2024-09-12T02:14:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.714+0000 7f8dcf63d740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x557c4afd6c60 con 0x557c4afbac50 2024-09-12T02:14:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.714+0000 7f8dcf63d740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x557c4afd7a00 con 0x557c4afba330 2024-09-12T02:14:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.714+0000 7f8dcf63d740 10 client.0 _ll_register_callbacks cb 0x7f8db000ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:14:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.715+0000 7f8dc6800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afba330 0x557c4afdfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.715+0000 7f8dc6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afd9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.715+0000 7f8dbd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afe0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.715+0000 7f8dbd400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afe0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:53166/0 (socket says 172.21.15.110:53166) 2024-09-12T02:14:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.715+0000 7f8dbd400640 1 -- 172.21.15.110:0/831355736 learned_addr learned my addr 172.21.15.110:0/831355736 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.715+0000 7f8dbd400640 1 -- 172.21.15.110:0/831355736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afba330 msgr2=0x557c4afdfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.715+0000 7f8dbd400640 1 --2- 172.21.15.110:0/831355736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afba330 0x557c4afdfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.715+0000 7f8dbd400640 1 -- 172.21.15.110:0/831355736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 msgr2=0x557c4afd9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.715+0000 7f8dbd400640 1 --2- 172.21.15.110:0/831355736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afd9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.715+0000 7f8dbd400640 1 -- 172.21.15.110:0/831355736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c4afd9880 con 0x557c4afbac50 2024-09-12T02:14:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.715+0000 7f8dbd400640 1 --2- 172.21.15.110:0/831355736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afe0060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8db0000c00 tx=0x7f8db0004d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1623503ef845c792 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.715+0000 7f8dab400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-12T02:14:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.716+0000 7f8dab400640 1 -- 172.21.15.110:0/831355736 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0043060 con 0x557c4afbac50 2024-09-12T02:14:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.716+0000 7f8dcf63d740 1 -- 172.21.15.110:0/831355736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c4af27b30 con 0x557c4afbac50 2024-09-12T02:14:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.716+0000 7f8dab400640 1 -- 172.21.15.110:0/831355736 <== mon.2 v2:172.21.15.115:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f8db0004ea0 con 0x557c4afbac50 2024-09-12T02:14:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.716+0000 7f8dab400640 1 -- 172.21.15.110:0/831355736 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8db004a050 con 0x557c4afbac50 2024-09-12T02:14:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.716+0000 7f8dcf63d740 10 client.24986 fetch_fsmap learned FSMap version 25 2024-09-12T02:14:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.716+0000 7f8dcf63d740 1 -- 172.21.15.110:0/831355736 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557c4afde330 con 0x557c4afbac50 2024-09-12T02:14:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.716+0000 7f8dab400640 1 -- 172.21.15.110:0/831355736 <== mon.2 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557c4af27b30 con 0x557c4afbac50 2024-09-12T02:14:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.716+0000 7f8dab400640 1 -- 172.21.15.110:0/831355736 <== mon.2 v2:172.21.15.115:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f8db0004700 con 0x557c4afbac50 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.716+0000 7f8dcf63d740 10 client.24986 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.716+0000 7f8dcf63d740 10 client.24986 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.716+0000 7f8dcf63d740 20 client.24986 populate_metadata read hostname 'smithi110' 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.717+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/831355736 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x557c4b044ce0 0x557c4b0439f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.717+0000 7f8dcf63d740 4 client.24986 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.717+0000 7f8dcf63d740 1 -- 172.21.15.110:0/831355736 --> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] -- command(tid 0: {"prefix": "status"}) -- 0x557c4aea3f80 con 0x557c4b044ce0 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.717+0000 7f8dc6800640 1 --2- 172.21.15.110:0/831355736 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x557c4b044ce0 0x557c4b0439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.717+0000 7f8dc6800640 1 --2- 172.21.15.110:0/831355736 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x557c4b044ce0 0x557c4b0439f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae93f4462cc72e7f server_cookie=993fb1cfe4693edd in_seq=0 out_seq=0 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.717+0000 7f8dab400640 10 client.24986 ms_handle_connect on v2:172.21.15.136:6838/3572987086 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dab400640 1 -- 172.21.15.110:0/831355736 <== mds.2 v2:172.21.15.136:6838/3572987086 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557c4aea3f80 con 0x557c4b044ce0 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dab400640 10 client.24986 handle_command_reply: tid=0 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dcf63d740 1 client.24986 shutdown 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dcf63d740 1 -- 172.21.15.110:0/831355736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 msgr2=0x557c4afe0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:23.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/831355736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afe0060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8db0000c00 tx=0x7f8db0004d90 comp rx=0 tx=0).stop 2024-09-12T02:14:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dcf63d740 1 -- 172.21.15.110:0/831355736 shutdown_connections 2024-09-12T02:14:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/831355736 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x557c4b044ce0 0x557c4b0439f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/831355736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x557c4afc5510 0x557c4afd9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/831355736 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x557c4afbac50 0x557c4afe0060 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dcf63d740 1 --2- 172.21.15.110:0/831355736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x557c4afba330 0x557c4afdfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dcf63d740 1 -- 172.21.15.110:0/831355736 >> 172.21.15.110:0/831355736 conn(0x557c4afb68c0 msgr2=0x557c4afc0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dab400640 0 client.24986 ms_handle_reset on v2:172.21.15.136:6838/3572987086 2024-09-12T02:14:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dcf63d740 1 -- 172.21.15.110:0/831355736 shutdown_connections 2024-09-12T02:14:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dcf63d740 1 -- 172.21.15.110:0/831355736 wait complete. 2024-09-12T02:14:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.718+0000 7f8dcf63d740 20 client.24986 trim_cache size 0 max 16384 2024-09-12T02:14:23.723 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:14:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "10ead734-70ab-11ef-bcea-c7b262605968", 2024-09-12T02:14:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 2, 2024-09-12T02:14:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24517, 2024-09-12T02:14:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-09-12T02:14:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-09-12T02:14:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-09-12T02:14:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 83.138564559000002, 2024-09-12T02:14:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 25, 2024-09-12T02:14:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 97, 2024-09-12T02:14:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 95, 2024-09-12T02:14:23.724 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 156.42230541699999 2024-09-12T02:14:23.724 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:14:23.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.719+0000 7f8dcca00640 1 -- 172.21.15.110:0/3098545696 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8dac0a2c10 msgr2=0x7f8dac0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:23.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.719+0000 7f8dcca00640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8dac0a2c10 0x7f8dac0a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8db80efc30 tx=0x7f8db80f5530 comp rx=0 tx=0).stop 2024-09-12T02:14:23.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.719+0000 7f8dcca00640 1 -- 172.21.15.110:0/3098545696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc8104010 msgr2=0x7f8dc819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:23.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.719+0000 7f8dcca00640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc8104010 0x7f8dc819a650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8db8004770 tx=0x7f8db8003c10 comp rx=0 tx=0).stop 2024-09-12T02:14:23.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.719+0000 7f8dcca00640 1 -- 172.21.15.110:0/3098545696 shutdown_connections 2024-09-12T02:14:23.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.719+0000 7f8dcca00640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f8dac0a2c10 0x7f8dac0a50d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.719+0000 7f8dcca00640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dc8109140 0x7f8dc819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.719+0000 7f8dcca00640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8dc81049c0 0x7f8dc819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.719+0000 7f8dcca00640 1 --2- 172.21.15.110:0/3098545696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dc8104010 0x7f8dc819a650 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:23.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.719+0000 7f8dcca00640 1 -- 172.21.15.110:0/3098545696 >> 172.21.15.110:0/3098545696 conn(0x7f8dc80ffa50 msgr2=0x7f8dc8100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:23.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.719+0000 7f8dcca00640 1 -- 172.21.15.110:0/3098545696 shutdown_connections 2024-09-12T02:14:23.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:23.719+0000 7f8dcca00640 1 -- 172.21.15.110:0/3098545696 wait complete. 2024-09-12T02:14:24.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell mds.a status 2024-09-12T02:14:24.884 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:24.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:24 smithi110 ceph-mon[30548]: pgmap v376: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:25.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:24 smithi115 ceph-mon[35351]: pgmap v376: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:25.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:24 smithi136 ceph-mon[35814]: pgmap v376: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:25.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.593+0000 7f19f3200640 1 -- 172.21.15.110:0/1379367020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19f41047e0 msgr2=0x7f19f4108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:25.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.593+0000 7f19f3200640 1 --2- 172.21.15.110:0/1379367020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19f41047e0 0x7f19f4108830 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009900 tx=0x7f19dc02a410 comp rx=0 tx=0).stop 2024-09-12T02:14:25.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.593+0000 7f19f3200640 1 -- 172.21.15.110:0/1379367020 shutdown_connections 2024-09-12T02:14:25.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.593+0000 7f19f3200640 1 --2- 172.21.15.110:0/1379367020 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19f4108f60 0x7f19f4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.593+0000 7f19f3200640 1 --2- 172.21.15.110:0/1379367020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19f41047e0 0x7f19f4108830 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.593+0000 7f19f3200640 1 --2- 172.21.15.110:0/1379367020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19f4103e30 0x7f19f4104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.593+0000 7f19f3200640 1 -- 172.21.15.110:0/1379367020 >> 172.21.15.110:0/1379367020 conn(0x7f19f40ff910 msgr2=0x7f19f4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:25.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.593+0000 7f19f3200640 1 -- 172.21.15.110:0/1379367020 shutdown_connections 2024-09-12T02:14:25.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.593+0000 7f19f3200640 1 -- 172.21.15.110:0/1379367020 wait complete. 2024-09-12T02:14:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.594+0000 7f19f3200640 1 Processor -- start 2024-09-12T02:14:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.594+0000 7f19f3200640 1 -- start start 2024-09-12T02:14:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.595+0000 7f19f3200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19f4103e30 0x7f19f419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.595+0000 7f19f3200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19f41047e0 0x7f19f419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.595+0000 7f19f3200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19f4108f60 0x7f19f419ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.595+0000 7f19f3200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4114010 con 0x7f19f4108f60 2024-09-12T02:14:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.595+0000 7f19f3200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4113e90 con 0x7f19f4103e30 2024-09-12T02:14:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.595+0000 7f19f3200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4114190 con 0x7f19f41047e0 2024-09-12T02:14:25.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.595+0000 7f19ebe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19f41047e0 0x7f19f419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.595+0000 7f19f1e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19f4103e30 0x7f19f419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.595+0000 7f19ebe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19f41047e0 0x7f19f419aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:44680/0 (socket says 172.21.15.110:44680) 2024-09-12T02:14:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.595+0000 7f19f2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19f4108f60 0x7f19f419ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.595+0000 7f19ebe00640 1 -- 172.21.15.110:0/131194509 learned_addr learned my addr 172.21.15.110:0/131194509 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.596+0000 7f19ebe00640 1 -- 172.21.15.110:0/131194509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19f4103e30 msgr2=0x7f19f419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.596+0000 7f19ebe00640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19f4103e30 0x7f19f419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.596+0000 7f19ebe00640 1 -- 172.21.15.110:0/131194509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19f4108f60 msgr2=0x7f19f419ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.596+0000 7f19ebe00640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19f4108f60 0x7f19f419ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.596+0000 7f19ebe00640 1 -- 172.21.15.110:0/131194509 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f419f4e0 con 0x7f19f41047e0 2024-09-12T02:14:25.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.596+0000 7f19f1e00640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19f4103e30 0x7f19f419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:25.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.596+0000 7f19ebe00640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19f41047e0 0x7f19f419aa70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19dc004770 tx=0x7f19dc003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:25.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.596+0000 7f19eaa00640 1 -- 172.21.15.110:0/131194509 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc03f070 con 0x7f19f41047e0 2024-09-12T02:14:25.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.596+0000 7f19eaa00640 1 -- 172.21.15.110:0/131194509 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19dc031ca0 con 0x7f19f41047e0 2024-09-12T02:14:25.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.596+0000 7f19f3200640 1 -- 172.21.15.110:0/131194509 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f419f770 con 0x7f19f41047e0 2024-09-12T02:14:25.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.596+0000 7f19eaa00640 1 -- 172.21.15.110:0/131194509 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc035030 con 0x7f19f41047e0 2024-09-12T02:14:25.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.596+0000 7f19f3200640 1 -- 172.21.15.110:0/131194509 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f41a70b0 con 0x7f19f41047e0 2024-09-12T02:14:25.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.599+0000 7f19fb4da740 1 Processor -- start 2024-09-12T02:14:25.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.599+0000 7f19fb4da740 1 -- start start 2024-09-12T02:14:25.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.599+0000 7f19eaa00640 1 -- 172.21.15.110:0/131194509 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f19dc042070 con 0x7f19f41047e0 2024-09-12T02:14:25.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.600+0000 7f19fb4da740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d24e0 0x559ca28d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.600+0000 7f19fb4da740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d2e00 0x559ca28dd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.600+0000 7f19fb4da740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28dd6c0 0x559ca28dfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.600+0000 7f19fb4da740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559ca28380b0 con 0x559ca28d24e0 2024-09-12T02:14:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.600+0000 7f19fb4da740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559ca27dfab0 con 0x559ca28dd6c0 2024-09-12T02:14:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.600+0000 7f19fb4da740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559ca2834070 con 0x559ca28d2e00 2024-09-12T02:14:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.600+0000 7f19f2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d24e0 0x559ca28d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.600+0000 7f19ebe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28dd6c0 0x559ca28dfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.600+0000 7f19f2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d24e0 0x559ca28d28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42142/0 (socket says 172.21.15.110:42142) 2024-09-12T02:14:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.600+0000 7f19f2800640 1 -- 172.21.15.110:0/3012679774 learned_addr learned my addr 172.21.15.110:0/3012679774 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.600+0000 7f19f1e00640 1 --2- 172.21.15.110:0/3012679774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d2e00 0x559ca28dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.601+0000 7f19f2800640 1 -- 172.21.15.110:0/3012679774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d2e00 msgr2=0x559ca28dd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.601+0000 7f19f2800640 1 --2- 172.21.15.110:0/3012679774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d2e00 0x559ca28dd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.601+0000 7f19f2800640 1 -- 172.21.15.110:0/3012679774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28dd6c0 msgr2=0x559ca28dfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.601+0000 7f19f2800640 1 --2- 172.21.15.110:0/3012679774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28dd6c0 0x559ca28dfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.601+0000 7f19f2800640 1 -- 172.21.15.110:0/3012679774 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ca27ec4a0 con 0x559ca28d24e0 2024-09-12T02:14:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.601+0000 7f19ebe00640 1 --2- 172.21.15.110:0/3012679774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28dd6c0 0x559ca28dfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.601+0000 7f19f2800640 1 --2- 172.21.15.110:0/3012679774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d24e0 0x559ca28d28c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009f90 tx=0x7f19ec010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc3e25acd76ce1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.601+0000 7f19e3000640 1 -- 172.21.15.110:0/3012679774 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec011700 con 0x559ca28d24e0 2024-09-12T02:14:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.601+0000 7f19eaa00640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f19d80a2c10 0x7f19d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.601+0000 7f19e3000640 1 -- 172.21.15.110:0/3012679774 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19ec011d80 con 0x559ca28d24e0 2024-09-12T02:14:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.601+0000 7f19e3000640 1 -- 172.21.15.110:0/3012679774 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec019e40 con 0x559ca28d24e0 2024-09-12T02:14:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.601+0000 7f19eaa00640 1 -- 172.21.15.110:0/131194509 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f19dc0efc10 con 0x7f19f41047e0 2024-09-12T02:14:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.602+0000 7f19f1e00640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f19d80a2c10 0x7f19d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.602+0000 7f19fb4da740 1 -- 172.21.15.110:0/3012679774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d24e0 msgr2=0x559ca28d28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.602+0000 7f19fb4da740 1 --2- 172.21.15.110:0/3012679774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d24e0 0x559ca28d28c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009f90 tx=0x7f19ec010860 comp rx=0 tx=0).stop 2024-09-12T02:14:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.602+0000 7f19f1e00640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f19d80a2c10 0x7f19d80a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x559ca28cf8d0 tx=0x7f19e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.602+0000 7f19fb4da740 1 -- 172.21.15.110:0/3012679774 shutdown_connections 2024-09-12T02:14:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.602+0000 7f19fb4da740 1 --2- 172.21.15.110:0/3012679774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28dd6c0 0x559ca28dfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.602+0000 7f19fb4da740 1 --2- 172.21.15.110:0/3012679774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d2e00 0x559ca28dd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.602+0000 7f19fb4da740 1 --2- 172.21.15.110:0/3012679774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d24e0 0x559ca28d28c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.602+0000 7f19fb4da740 1 -- 172.21.15.110:0/3012679774 >> 172.21.15.110:0/3012679774 conn(0x559ca28cea70 msgr2=0x559ca28cee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.602+0000 7f19fb4da740 1 -- 172.21.15.110:0/3012679774 shutdown_connections 2024-09-12T02:14:25.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.602+0000 7f19fb4da740 1 -- 172.21.15.110:0/3012679774 wait complete. 2024-09-12T02:14:25.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.603+0000 7f19fb4da740 1 -- start start 2024-09-12T02:14:25.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.603+0000 7f19fb4da740 1 Processor -- start 2024-09-12T02:14:25.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19fb4da740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d24e0 0x559ca28da530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.607 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19fb4da740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d2e00 0x559ca28daa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19fb4da740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 0x559ca28dafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19fb4da740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559ca28e0330 con 0x559ca28dd6c0 2024-09-12T02:14:25.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19fb4da740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559ca27c0920 con 0x559ca28d2e00 2024-09-12T02:14:25.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19fb4da740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559ca28e04b0 con 0x559ca28d24e0 2024-09-12T02:14:25.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19fb4da740 10 client.0 _ll_register_callbacks cb 0x559ca27e48a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:14:25.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19f2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 0x559ca28dafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19f2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 0x559ca28dafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42148/0 (socket says 172.21.15.110:42148) 2024-09-12T02:14:25.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19f2800640 1 -- 172.21.15.110:0/2728226283 learned_addr learned my addr 172.21.15.110:0/2728226283 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:25.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19f1e00640 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d24e0 0x559ca28da530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19ebe00640 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d2e00 0x559ca28daa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.608 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19f2800640 1 -- 172.21.15.110:0/2728226283 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d24e0 msgr2=0x559ca28da530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19f2800640 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d24e0 0x559ca28da530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19f2800640 1 -- 172.21.15.110:0/2728226283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d2e00 msgr2=0x559ca28daa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19f2800640 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d2e00 0x559ca28daa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.604+0000 7f19f2800640 1 -- 172.21.15.110:0/2728226283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ca25a92b0 con 0x559ca28dd6c0 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.605+0000 7f19f2800640 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 0x559ca28dafb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009990 tx=0x7f19ec0197e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635cb58d29b54fec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.605+0000 7f19d7400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.605+0000 7f19d7400640 1 -- 172.21.15.110:0/2728226283 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec027030 con 0x559ca28dd6c0 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.605+0000 7f19fb4da740 1 -- 172.21.15.110:0/2728226283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19ec011d80 con 0x559ca28dd6c0 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.605+0000 7f19d7400640 1 -- 172.21.15.110:0/2728226283 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f19ec01f070 con 0x559ca28dd6c0 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.605+0000 7f19d7400640 1 -- 172.21.15.110:0/2728226283 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f19ec031050 con 0x559ca28dd6c0 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.605+0000 7f19fb4da740 10 client.14988 fetch_fsmap learned FSMap version 25 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.605+0000 7f19fb4da740 1 -- 172.21.15.110:0/2728226283 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559ca28ebf60 con 0x559ca28dd6c0 2024-09-12T02:14:25.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.606+0000 7f19d7400640 1 -- 172.21.15.110:0/2728226283 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19ec011d80 con 0x559ca28dd6c0 2024-09-12T02:14:25.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.606+0000 7f19d7400640 1 -- 172.21.15.110:0/2728226283 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f19ec003bb0 con 0x559ca28dd6c0 2024-09-12T02:14:25.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.606+0000 7f19fb4da740 10 client.14988 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:14:25.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.606+0000 7f19fb4da740 10 client.14988 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:14:25.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.606+0000 7f19fb4da740 20 client.14988 populate_metadata read hostname 'smithi110' 2024-09-12T02:14:25.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.606+0000 7f19fb4da740 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x559ca28ee250 0x559ca28ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.606+0000 7f19fb4da740 4 client.14988 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:14:25.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.606+0000 7f19fb4da740 1 -- 172.21.15.110:0/2728226283 --> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ca2845620 con 0x559ca28ee250 2024-09-12T02:14:25.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.606+0000 7f19f1e00640 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x559ca28ee250 0x559ca28ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.607+0000 7f19d7400640 10 client.14988 ms_handle_connect on v2:172.21.15.110:6840/4021694968 2024-09-12T02:14:25.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.607+0000 7f19f1e00640 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x559ca28ee250 0x559ca28ef6c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=60d0b9024b032c21 server_cookie=981ff860d559d6a0 in_seq=0 out_seq=0 2024-09-12T02:14:25.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19d7400640 1 -- 172.21.15.110:0/2728226283 <== mds.1 v2:172.21.15.110:6840/4021694968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ca2845620 con 0x559ca28ee250 2024-09-12T02:14:25.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19d7400640 10 client.14988 handle_command_reply: tid=0 2024-09-12T02:14:25.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19fb4da740 1 client.14988 shutdown 2024-09-12T02:14:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19fb4da740 1 -- 172.21.15.110:0/2728226283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 msgr2=0x559ca28dafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19fb4da740 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 0x559ca28dafb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009990 tx=0x7f19ec0197e0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19fb4da740 1 -- 172.21.15.110:0/2728226283 shutdown_connections 2024-09-12T02:14:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19fb4da740 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 0x559ca28dafb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19fb4da740 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x559ca28ee250 0x559ca28ef6c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19fb4da740 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d2e00 0x559ca28daa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19fb4da740 1 --2- 172.21.15.110:0/2728226283 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d24e0 0x559ca28da530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19d7400640 0 client.14988 ms_handle_reset on v2:172.21.15.110:6840/4021694968 2024-09-12T02:14:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19fb4da740 1 -- 172.21.15.110:0/2728226283 >> 172.21.15.110:0/2728226283 conn(0x559ca28cea70 msgr2=0x559ca28d4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19fb4da740 1 -- 172.21.15.110:0/2728226283 shutdown_connections 2024-09-12T02:14:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.608+0000 7f19fb4da740 1 -- 172.21.15.110:0/2728226283 wait complete. 2024-09-12T02:14:25.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.609+0000 7f19fb4da740 20 client.14988 trim_cache size 0 max 16384 2024-09-12T02:14:25.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.626+0000 7f19fb4da740 1 Processor -- start 2024-09-12T02:14:25.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19fb4da740 1 -- start start 2024-09-12T02:14:25.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19fb4da740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d24e0 0x559ca28dae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19fb4da740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d2e00 0x559ca28e8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19fb4da740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28dd6c0 0x559ca28f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19fb4da740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559ca28eda00 con 0x559ca28d2e00 2024-09-12T02:14:25.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19fb4da740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559ca28ee0d0 con 0x559ca28d24e0 2024-09-12T02:14:25.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19fb4da740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559ca28ee7a0 con 0x559ca28dd6c0 2024-09-12T02:14:25.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19ebe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d2e00 0x559ca28e8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19ebe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d2e00 0x559ca28e8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42154/0 (socket says 172.21.15.110:42154) 2024-09-12T02:14:25.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19ebe00640 1 -- 172.21.15.110:0/163127721 learned_addr learned my addr 172.21.15.110:0/163127721 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:25.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19f1e00640 1 --2- 172.21.15.110:0/163127721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d24e0 0x559ca28dae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19f2800640 1 --2- 172.21.15.110:0/163127721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28dd6c0 0x559ca28f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19ebe00640 1 -- 172.21.15.110:0/163127721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28dd6c0 msgr2=0x559ca28f79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:25.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19ebe00640 1 --2- 172.21.15.110:0/163127721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28dd6c0 0x559ca28f79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19ebe00640 1 -- 172.21.15.110:0/163127721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d24e0 msgr2=0x559ca28dae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:25.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19ebe00640 1 --2- 172.21.15.110:0/163127721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d24e0 0x559ca28dae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19ebe00640 1 -- 172.21.15.110:0/163127721 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ca28cf700 con 0x559ca28d2e00 2024-09-12T02:14:25.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19f1e00640 1 --2- 172.21.15.110:0/163127721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d24e0 0x559ca28dae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:25.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19ebe00640 1 --2- 172.21.15.110:0/163127721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d2e00 0x559ca28e8e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0bbd20 tx=0x7f19dc0f3760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b970a5243f39e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:25.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19e2600640 1 -- 172.21.15.110:0/163127721 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc049040 con 0x559ca28d2e00 2024-09-12T02:14:25.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19e2600640 1 -- 172.21.15.110:0/163127721 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19dc0bc020 con 0x559ca28d2e00 2024-09-12T02:14:25.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.628+0000 7f19e2600640 1 -- 172.21.15.110:0/163127721 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc0ed470 con 0x559ca28d2e00 2024-09-12T02:14:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.629+0000 7f19fb4da740 1 -- 172.21.15.110:0/163127721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d2e00 msgr2=0x559ca28e8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.629+0000 7f19fb4da740 1 --2- 172.21.15.110:0/163127721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d2e00 0x559ca28e8e10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0bbd20 tx=0x7f19dc0f3760 comp rx=0 tx=0).stop 2024-09-12T02:14:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.629+0000 7f19fb4da740 1 -- 172.21.15.110:0/163127721 shutdown_connections 2024-09-12T02:14:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.629+0000 7f19fb4da740 1 --2- 172.21.15.110:0/163127721 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28dd6c0 0x559ca28f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.629+0000 7f19fb4da740 1 --2- 172.21.15.110:0/163127721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28d2e00 0x559ca28e8e10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.629+0000 7f19fb4da740 1 --2- 172.21.15.110:0/163127721 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d24e0 0x559ca28dae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.629+0000 7f19fb4da740 1 -- 172.21.15.110:0/163127721 >> 172.21.15.110:0/163127721 conn(0x559ca28cea70 msgr2=0x559ca28e8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.629+0000 7f19fb4da740 1 -- 172.21.15.110:0/163127721 shutdown_connections 2024-09-12T02:14:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.629+0000 7f19fb4da740 1 -- 172.21.15.110:0/163127721 wait complete. 2024-09-12T02:14:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.629+0000 7f19fb4da740 1 -- start start 2024-09-12T02:14:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19fb4da740 1 Processor -- start 2024-09-12T02:14:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19fb4da740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d24e0 0x559ca28d7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19fb4da740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d2e00 0x559ca28d7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19fb4da740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 0x559ca28d81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19fb4da740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x559ca28ef540 con 0x559ca28dd6c0 2024-09-12T02:14:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19fb4da740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559ca28eee70 con 0x559ca28d24e0 2024-09-12T02:14:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19fb4da740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559ca28efc10 con 0x559ca28d2e00 2024-09-12T02:14:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19fb4da740 10 client.0 _ll_register_callbacks cb 0x7f19ec009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:14:25.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19f2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 0x559ca28d81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19f2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 0x559ca28d81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42170/0 (socket says 172.21.15.110:42170) 2024-09-12T02:14:25.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19f2800640 1 -- 172.21.15.110:0/1302818151 learned_addr learned my addr 172.21.15.110:0/1302818151 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:25.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19f1e00640 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d24e0 0x559ca28d7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.630+0000 7f19ebe00640 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d2e00 0x559ca28d7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.631+0000 7f19f2800640 1 -- 172.21.15.110:0/1302818151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d2e00 msgr2=0x559ca28d7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:25.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.631+0000 7f19f2800640 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d2e00 0x559ca28d7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.631+0000 7f19f2800640 1 -- 172.21.15.110:0/1302818151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d24e0 msgr2=0x559ca28d7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:25.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.631+0000 7f19f2800640 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d24e0 0x559ca28d7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.631+0000 7f19f2800640 1 -- 172.21.15.110:0/1302818151 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ca28f6030 con 0x559ca28dd6c0 2024-09-12T02:14:25.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.631+0000 7f19f2800640 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 0x559ca28d81a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009a80 tx=0x7f19ec0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e29e792899f4537 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:25.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.631+0000 7f19d7400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-12T02:14:25.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.631+0000 7f19d7400640 1 -- 172.21.15.110:0/1302818151 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec027040 con 0x559ca28dd6c0 2024-09-12T02:14:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.631+0000 7f19fb4da740 1 -- 172.21.15.110:0/1302818151 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19dc0bc020 con 0x559ca28dd6c0 2024-09-12T02:14:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.631+0000 7f19d7400640 1 -- 172.21.15.110:0/1302818151 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f19ec01f040 con 0x559ca28dd6c0 2024-09-12T02:14:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.632+0000 7f19d7400640 1 -- 172.21.15.110:0/1302818151 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f19ec041050 con 0x559ca28dd6c0 2024-09-12T02:14:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.632+0000 7f19fb4da740 10 client.14994 fetch_fsmap learned FSMap version 25 2024-09-12T02:14:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.632+0000 7f19fb4da740 1 -- 172.21.15.110:0/1302818151 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559ca29614f0 con 0x559ca28dd6c0 2024-09-12T02:14:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.632+0000 7f19d7400640 1 -- 172.21.15.110:0/1302818151 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19dc0bc020 con 0x559ca28dd6c0 2024-09-12T02:14:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.632+0000 7f19d7400640 1 -- 172.21.15.110:0/1302818151 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f19ec011bc0 con 0x559ca28dd6c0 2024-09-12T02:14:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.632+0000 7f19fb4da740 10 client.14994 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:14:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.632+0000 7f19fb4da740 10 client.14994 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:14:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.632+0000 7f19fb4da740 20 client.14994 populate_metadata read hostname 'smithi110' 2024-09-12T02:14:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.632+0000 7f19fb4da740 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x559ca2965ff0 0x559ca2964d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:25.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.632+0000 7f19fb4da740 4 client.14994 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:14:25.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.632+0000 7f19fb4da740 1 -- 172.21.15.110:0/1302818151 --> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] -- command(tid 0: {"prefix": "status"}) -- 0x559ca283fb30 con 0x559ca2965ff0 2024-09-12T02:14:25.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.633+0000 7f19f1e00640 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x559ca2965ff0 0x559ca2964d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:25.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.633+0000 7f19f1e00640 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x559ca2965ff0 0x559ca2964d00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cca1ebf5028ff636 server_cookie=a9148ccee4015b76 in_seq=0 out_seq=0 2024-09-12T02:14:25.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.633+0000 7f19d7400640 10 client.14994 ms_handle_connect on v2:172.21.15.110:6840/4021694968 2024-09-12T02:14:25.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.633+0000 7f19d7400640 1 -- 172.21.15.110:0/1302818151 <== mds.1 v2:172.21.15.110:6840/4021694968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559ca283fb30 con 0x559ca2965ff0 2024-09-12T02:14:25.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.633+0000 7f19d7400640 10 client.14994 handle_command_reply: tid=0 2024-09-12T02:14:25.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.633+0000 7f19fb4da740 1 client.14994 shutdown 2024-09-12T02:14:25.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.634+0000 7f19fb4da740 1 -- 172.21.15.110:0/1302818151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 msgr2=0x559ca28d81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:25.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.634+0000 7f19fb4da740 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 0x559ca28d81a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009a80 tx=0x7f19ec0119d0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.634+0000 7f19fb4da740 1 -- 172.21.15.110:0/1302818151 shutdown_connections 2024-09-12T02:14:25.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.634+0000 7f19fb4da740 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x559ca28dd6c0 0x559ca28d81a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.634+0000 7f19fb4da740 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559ca28d2e00 0x559ca28d7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.634+0000 7f19fb4da740 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x559ca2965ff0 0x559ca2964d00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.634+0000 7f19fb4da740 1 --2- 172.21.15.110:0/1302818151 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559ca28d24e0 0x559ca28d7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.634+0000 7f19fb4da740 1 -- 172.21.15.110:0/1302818151 >> 172.21.15.110:0/1302818151 conn(0x559ca28cea70 msgr2=0x559ca28cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:25.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.634+0000 7f19d7400640 0 client.14994 ms_handle_reset on v2:172.21.15.110:6840/4021694968 2024-09-12T02:14:25.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.634+0000 7f19fb4da740 1 -- 172.21.15.110:0/1302818151 shutdown_connections 2024-09-12T02:14:25.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.634+0000 7f19fb4da740 1 -- 172.21.15.110:0/1302818151 wait complete. 2024-09-12T02:14:25.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.634+0000 7f19fb4da740 20 client.14994 trim_cache size 0 max 16384 2024-09-12T02:14:25.639 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:14:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "10ead734-70ab-11ef-bcea-c7b262605968", 2024-09-12T02:14:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 1, 2024-09-12T02:14:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24538, 2024-09-12T02:14:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-09-12T02:14:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-09-12T02:14:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-09-12T02:14:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 86.059825329999995, 2024-09-12T02:14:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 25, 2024-09-12T02:14:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 97, 2024-09-12T02:14:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 95, 2024-09-12T02:14:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 149.55341084200001 2024-09-12T02:14:25.640 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:14:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.635+0000 7f19f3200640 1 -- 172.21.15.110:0/131194509 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f19d80a2c10 msgr2=0x7f19d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.635+0000 7f19f3200640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f19d80a2c10 0x7f19d80a50d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x559ca28cf8d0 tx=0x7f19e4005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.635+0000 7f19f3200640 1 -- 172.21.15.110:0/131194509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19f41047e0 msgr2=0x7f19f419aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.635+0000 7f19f3200640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19f41047e0 0x7f19f419aa70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19dc004770 tx=0x7f19dc003c10 comp rx=0 tx=0).stop 2024-09-12T02:14:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.635+0000 7f19f3200640 1 -- 172.21.15.110:0/131194509 shutdown_connections 2024-09-12T02:14:25.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.635+0000 7f19f3200640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f19d80a2c10 0x7f19d80a50d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.635+0000 7f19f3200640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19f4108f60 0x7f19f419ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.635+0000 7f19f3200640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19f41047e0 0x7f19f419aa70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.635+0000 7f19f3200640 1 --2- 172.21.15.110:0/131194509 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f19f4103e30 0x7f19f419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:25.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.635+0000 7f19f3200640 1 -- 172.21.15.110:0/131194509 >> 172.21.15.110:0/131194509 conn(0x7f19f40ff910 msgr2=0x7f19f4100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:25.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.635+0000 7f19f3200640 1 -- 172.21.15.110:0/131194509 shutdown_connections 2024-09-12T02:14:25.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:25.635+0000 7f19f3200640 1 -- 172.21.15.110:0/131194509 wait complete. 2024-09-12T02:14:26.555 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:14:26.927 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:26.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:26 smithi110 ceph-mon[30548]: pgmap v377: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:26.960 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:26 smithi136 ceph-mon[35814]: pgmap v377: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:27.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:26 smithi115 ceph-mon[35351]: pgmap v377: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.469+0000 7faead200640 1 -- 172.21.15.110:0/1321310617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea8108f60 msgr2=0x7faea8110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.469+0000 7faead200640 1 --2- 172.21.15.110:0/1321310617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea8108f60 0x7faea8110ae0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faea0009ca0 tx=0x7faea002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.469+0000 7faead200640 1 -- 172.21.15.110:0/1321310617 shutdown_connections 2024-09-12T02:14:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.469+0000 7faead200640 1 --2- 172.21.15.110:0/1321310617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea8108f60 0x7faea8110ae0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.469+0000 7faead200640 1 --2- 172.21.15.110:0/1321310617 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea81047e0 0x7faea8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.469+0000 7faead200640 1 --2- 172.21.15.110:0/1321310617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faea8103e30 0x7faea8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.469+0000 7faead200640 1 -- 172.21.15.110:0/1321310617 >> 172.21.15.110:0/1321310617 conn(0x7faea80ff8d0 msgr2=0x7faea8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.469+0000 7faead200640 1 -- 172.21.15.110:0/1321310617 shutdown_connections 2024-09-12T02:14:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.469+0000 7faead200640 1 -- 172.21.15.110:0/1321310617 wait complete. 2024-09-12T02:14:27.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.470+0000 7faead200640 1 Processor -- start 2024-09-12T02:14:27.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.471+0000 7faead200640 1 -- start start 2024-09-12T02:14:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.471+0000 7faead200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea8103e30 0x7faea819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.471+0000 7faead200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faea81047e0 0x7faea819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.471+0000 7faead200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea8108f60 0x7faea819ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.471+0000 7faead200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7faea8114010 con 0x7faea8108f60 2024-09-12T02:14:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.471+0000 7faead200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faea8113e90 con 0x7faea8103e30 2024-09-12T02:14:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.471+0000 7faead200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7faea8114190 con 0x7faea81047e0 2024-09-12T02:14:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.471+0000 7faea7400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea8103e30 0x7faea819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.471+0000 7faea7400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea8103e30 0x7faea819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:53248/0 (socket says 172.21.15.110:53248) 2024-09-12T02:14:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.471+0000 7faea7400640 1 -- 172.21.15.110:0/4223654745 learned_addr learned my addr 172.21.15.110:0/4223654745 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.471+0000 7faea7e00640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea8108f60 0x7faea819ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.471+0000 7faea6a00640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faea81047e0 0x7faea819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.472+0000 7faea7400640 1 -- 172.21.15.110:0/4223654745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faea81047e0 msgr2=0x7faea819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.472+0000 7faea7400640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faea81047e0 0x7faea819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.472+0000 7faea7400640 1 -- 172.21.15.110:0/4223654745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea8108f60 msgr2=0x7faea819ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:27.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.472+0000 7faea7400640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea8108f60 0x7faea819ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.472+0000 7faea7400640 1 -- 172.21.15.110:0/4223654745 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea819f3c0 con 0x7faea8103e30 2024-09-12T02:14:27.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.472+0000 7faea6a00640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faea81047e0 0x7faea819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:27.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.472+0000 7faea7400640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea8103e30 0x7faea819a410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fae9800e9f0 tx=0x7fae9800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:27.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.472+0000 7fae9fe00640 1 -- 172.21.15.110:0/4223654745 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9800cd80 con 0x7faea8103e30 2024-09-12T02:14:27.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.473+0000 7faead200640 1 -- 172.21.15.110:0/4223654745 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea819f6b0 con 0x7faea8103e30 2024-09-12T02:14:27.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.473+0000 7fae9fe00640 1 -- 172.21.15.110:0/4223654745 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae98010910 con 0x7faea8103e30 2024-09-12T02:14:27.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.473+0000 7fae9fe00640 1 -- 172.21.15.110:0/4223654745 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae980188f0 con 0x7faea8103e30 2024-09-12T02:14:27.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.473+0000 7faead200640 1 -- 172.21.15.110:0/4223654745 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea81a6f90 con 0x7faea8103e30 2024-09-12T02:14:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.475+0000 7faeb1405740 1 Processor -- start 2024-09-12T02:14:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.476+0000 7faeb1405740 1 -- start start 2024-09-12T02:14:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.476+0000 7fae9fe00640 1 -- 172.21.15.110:0/4223654745 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fae98010ac0 con 0x7faea8103e30 2024-09-12T02:14:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.476+0000 7faeb1405740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b29177c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.476+0000 7faeb1405740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b291787180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.476+0000 7faeb1405740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291789ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.476+0000 7faeb1405740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b2916e20b0 con 0x55b29177ce00 2024-09-12T02:14:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.476+0000 7faeb1405740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b291689ab0 con 0x55b29177c4e0 2024-09-12T02:14:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.476+0000 7faeb1405740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b2916de070 con 0x55b2917876c0 2024-09-12T02:14:27.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.476+0000 7faea7e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b29177c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.476+0000 7faea7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b291787180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.476+0000 7faea7e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b29177c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:53252/0 (socket says 172.21.15.110:53252) 2024-09-12T02:14:27.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.476+0000 7faea7e00640 1 -- 172.21.15.110:0/2602601549 learned_addr learned my addr 172.21.15.110:0/2602601549 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:27.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.477+0000 7faea6a00640 1 --2- 172.21.15.110:0/2602601549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291789ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.477+0000 7faea7e00640 1 -- 172.21.15.110:0/2602601549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 msgr2=0x55b291789ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:27.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.477+0000 7faea7e00640 1 --2- 172.21.15.110:0/2602601549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291789ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.477+0000 7faea7e00640 1 -- 172.21.15.110:0/2602601549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 msgr2=0x55b291787180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:27.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.477+0000 7faea7e00640 1 --2- 172.21.15.110:0/2602601549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b291787180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.477+0000 7faea7e00640 1 -- 172.21.15.110:0/2602601549 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2916964a0 con 0x55b29177c4e0 2024-09-12T02:14:27.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.477+0000 7faea6a00640 1 --2- 172.21.15.110:0/2602601549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291789ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:27.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.477+0000 7faea7e00640 1 --2- 172.21.15.110:0/2602601549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b29177c8c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faea0009ca0 tx=0x7faea00093e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faef39f9f3d583cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:27.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.477+0000 7fae9cc00640 1 -- 172.21.15.110:0/2602601549 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0031db0 con 0x55b29177c4e0 2024-09-12T02:14:27.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.478+0000 7fae9cc00640 1 -- 172.21.15.110:0/2602601549 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faea0036030 con 0x55b29177c4e0 2024-09-12T02:14:27.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.478+0000 7fae9cc00640 1 -- 172.21.15.110:0/2602601549 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea00042a0 con 0x55b29177c4e0 2024-09-12T02:14:27.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.478+0000 7fae9fe00640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fae8c0a2c90 0x7fae8c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.478+0000 7fae9fe00640 1 -- 172.21.15.110:0/4223654745 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fae980cf8a0 con 0x7faea8103e30 2024-09-12T02:14:27.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.478+0000 7faea7400640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fae8c0a2c90 0x7fae8c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.478+0000 7faeb1405740 1 -- 172.21.15.110:0/2602601549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 msgr2=0x55b29177c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:27.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.478+0000 7faeb1405740 1 --2- 172.21.15.110:0/2602601549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b29177c8c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faea0009ca0 tx=0x7faea00093e0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.479+0000 7faeb1405740 1 -- 172.21.15.110:0/2602601549 shutdown_connections 2024-09-12T02:14:27.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.479+0000 7faeb1405740 1 --2- 172.21.15.110:0/2602601549 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291789ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.479+0000 7faeb1405740 1 --2- 172.21.15.110:0/2602601549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b291787180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.479+0000 7faeb1405740 1 --2- 172.21.15.110:0/2602601549 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b29177c8c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.479+0000 7faeb1405740 1 -- 172.21.15.110:0/2602601549 >> 172.21.15.110:0/2602601549 conn(0x55b291778a70 msgr2=0x55b291778e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:27.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.479+0000 7faeb1405740 1 -- 172.21.15.110:0/2602601549 shutdown_connections 2024-09-12T02:14:27.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.479+0000 7faeb1405740 1 -- 172.21.15.110:0/2602601549 wait complete. 2024-09-12T02:14:27.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.479+0000 7faea7400640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fae8c0a2c90 0x7fae8c0a5150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55b2917798d0 tx=0x7fae980d5550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:27.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.479+0000 7faeb1405740 1 -- start start 2024-09-12T02:14:27.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.479+0000 7faeb1405740 1 Processor -- start 2024-09-12T02:14:27.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.480+0000 7faeb1405740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177c4e0 0x55b291784530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.480+0000 7faeb1405740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177ce00 0x55b291784a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.480+0000 7faeb1405740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291784fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.480+0000 7faeb1405740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b29178a1b0 con 0x55b29177c4e0 2024-09-12T02:14:27.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.480+0000 7faeb1405740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b29166a920 con 0x55b29177ce00 2024-09-12T02:14:27.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.480+0000 7faeb1405740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b29178a330 con 0x55b2917876c0 2024-09-12T02:14:27.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.480+0000 7faeb1405740 10 client.0 _ll_register_callbacks cb 0x55b29168e8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:14:27.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.480+0000 7faea6a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177ce00 0x55b291784a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.480+0000 7faea6a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177ce00 0x55b291784a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:53266/0 (socket says 172.21.15.110:53266) 2024-09-12T02:14:27.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.480+0000 7faea6a00640 1 -- 172.21.15.110:0/1381600206 learned_addr learned my addr 172.21.15.110:0/1381600206 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:27.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.480+0000 7faea7e00640 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177c4e0 0x55b291784530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.480+0000 7faea7e00640 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291784fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.481+0000 7faea6a00640 1 -- 172.21.15.110:0/1381600206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 msgr2=0x55b291784fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:27.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.481+0000 7faea6a00640 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291784fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.481+0000 7faea6a00640 1 -- 172.21.15.110:0/1381600206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177c4e0 msgr2=0x55b291784530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:27.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.481+0000 7faea6a00640 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177c4e0 0x55b291784530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.481+0000 7faea6a00640 1 -- 172.21.15.110:0/1381600206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2914532b0 con 0x55b29177ce00 2024-09-12T02:14:27.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.481+0000 7faea7e00640 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291784fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:27.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.481+0000 7faea6a00640 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177ce00 0x55b291784a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fae940129b0 tx=0x7fae94012e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26cb737e52e98783 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:27.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.481+0000 7fae91600640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-12T02:14:27.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.481+0000 7fae91600640 1 -- 172.21.15.110:0/1381600206 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9400fa00 con 0x55b29177ce00 2024-09-12T02:14:27.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.481+0000 7faeb1405740 1 -- 172.21.15.110:0/1381600206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faea0036030 con 0x55b29177ce00 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.481+0000 7fae91600640 1 -- 172.21.15.110:0/1381600206 <== mon.2 v2:172.21.15.115:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fae9400fba0 con 0x55b29177ce00 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.482+0000 7fae91600640 1 -- 172.21.15.110:0/1381600206 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fae9400fda0 con 0x55b29177ce00 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.482+0000 7faeb1405740 10 client.25016 fetch_fsmap learned FSMap version 25 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.482+0000 7faeb1405740 1 -- 172.21.15.110:0/1381600206 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b291795ec0 con 0x55b29177ce00 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.482+0000 7fae91600640 1 -- 172.21.15.110:0/1381600206 <== mon.2 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faea0036030 con 0x55b29177ce00 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.482+0000 7fae91600640 1 -- 172.21.15.110:0/1381600206 <== mon.2 v2:172.21.15.115:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fae9401c4b0 con 0x55b29177ce00 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.483+0000 7faeb1405740 10 client.25016 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.483+0000 7faeb1405740 10 client.25016 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.483+0000 7faeb1405740 20 client.25016 populate_metadata read hostname 'smithi110' 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.483+0000 7faeb1405740 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55b291798540 0x55b2917999b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.483+0000 7faeb1405740 4 client.25016 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.483+0000 7faeb1405740 1 -- 172.21.15.110:0/1381600206 --> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2916ef620 con 0x55b291798540 2024-09-12T02:14:27.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.483+0000 7faea7e00640 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55b291798540 0x55b2917999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.484+0000 7faea7e00640 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55b291798540 0x55b2917999b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32ffd3f3276954da server_cookie=8dfd457925c55d2a in_seq=0 out_seq=0 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.484+0000 7fae91600640 10 client.25016 ms_handle_connect on v2:172.21.15.115:6838/1796624254 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.484+0000 7fae91600640 1 -- 172.21.15.110:0/1381600206 <== mds.0 v2:172.21.15.115:6838/1796624254 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2916ef620 con 0x55b291798540 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.484+0000 7fae91600640 10 client.25016 handle_command_reply: tid=0 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.484+0000 7faeb1405740 1 client.25016 shutdown 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.485+0000 7faeb1405740 1 -- 172.21.15.110:0/1381600206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177ce00 msgr2=0x55b291784a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.485+0000 7faeb1405740 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177ce00 0x55b291784a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fae940129b0 tx=0x7fae94012e70 comp rx=0 tx=0).stop 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.485+0000 7faeb1405740 1 -- 172.21.15.110:0/1381600206 shutdown_connections 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.485+0000 7faeb1405740 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55b291798540 0x55b2917999b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.485+0000 7faeb1405740 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291784fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.485+0000 7faeb1405740 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177ce00 0x55b291784a70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.485+0000 7faeb1405740 1 --2- 172.21.15.110:0/1381600206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177c4e0 0x55b291784530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.485+0000 7faeb1405740 1 -- 172.21.15.110:0/1381600206 >> 172.21.15.110:0/1381600206 conn(0x55b291778a70 msgr2=0x55b29177e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:27.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.485+0000 7fae91600640 0 client.25016 ms_handle_reset on v2:172.21.15.115:6838/1796624254 2024-09-12T02:14:27.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.485+0000 7faeb1405740 1 -- 172.21.15.110:0/1381600206 shutdown_connections 2024-09-12T02:14:27.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.485+0000 7faeb1405740 1 -- 172.21.15.110:0/1381600206 wait complete. 2024-09-12T02:14:27.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.485+0000 7faeb1405740 20 client.25016 trim_cache size 0 max 16384 2024-09-12T02:14:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.503+0000 7faeb1405740 1 Processor -- start 2024-09-12T02:14:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.503+0000 7faeb1405740 1 -- start start 2024-09-12T02:14:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faeb1405740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b291797e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faeb1405740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b29177ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faeb1405740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b2917737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faeb1405740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b291797cf0 con 0x55b29177ce00 2024-09-12T02:14:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faeb1405740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b2917983c0 con 0x55b29177c4e0 2024-09-12T02:14:27.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faeb1405740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b291798a90 con 0x55b2917876c0 2024-09-12T02:14:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faea6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b29177ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faea6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b29177ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42210/0 (socket says 172.21.15.110:42210) 2024-09-12T02:14:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faea6a00640 1 -- 172.21.15.110:0/2621819340 learned_addr learned my addr 172.21.15.110:0/2621819340 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faea7e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b291797e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faea7e00640 1 --2- 172.21.15.110:0/2621819340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b2917737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faea6a00640 1 -- 172.21.15.110:0/2621819340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 msgr2=0x55b2917737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:27.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faea6a00640 1 --2- 172.21.15.110:0/2621819340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b2917737a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faea6a00640 1 -- 172.21.15.110:0/2621819340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 msgr2=0x55b291797e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:27.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faea6a00640 1 --2- 172.21.15.110:0/2621819340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b291797e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.504+0000 7faea6a00640 1 -- 172.21.15.110:0/2621819340 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b29177cc30 con 0x55b29177ce00 2024-09-12T02:14:27.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.505+0000 7faea7e00640 1 --2- 172.21.15.110:0/2621819340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b291797e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:27.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.505+0000 7faea6a00640 1 --2- 172.21.15.110:0/2621819340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b29177ef40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae9401c8f0 tx=0x7fae94009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c4f650e2fc6255 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:27.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.505+0000 7fae93e00640 1 -- 172.21.15.110:0/2621819340 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9400fb00 con 0x55b29177ce00 2024-09-12T02:14:27.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.505+0000 7fae93e00640 1 -- 172.21.15.110:0/2621819340 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae940055c0 con 0x55b29177ce00 2024-09-12T02:14:27.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.505+0000 7fae93e00640 1 -- 172.21.15.110:0/2621819340 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae940035f0 con 0x55b29177ce00 2024-09-12T02:14:27.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.506+0000 7faeb1405740 1 -- 172.21.15.110:0/2621819340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 msgr2=0x55b29177ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:27.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.506+0000 7faeb1405740 1 --2- 172.21.15.110:0/2621819340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b29177ef40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae9401c8f0 tx=0x7fae94009240 comp rx=0 tx=0).stop 2024-09-12T02:14:27.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.506+0000 7faeb1405740 1 -- 172.21.15.110:0/2621819340 shutdown_connections 2024-09-12T02:14:27.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.506+0000 7faeb1405740 1 --2- 172.21.15.110:0/2621819340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b2917737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.506+0000 7faeb1405740 1 --2- 172.21.15.110:0/2621819340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b29177ef40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.506+0000 7faeb1405740 1 --2- 172.21.15.110:0/2621819340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b291797e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.506+0000 7faeb1405740 1 -- 172.21.15.110:0/2621819340 >> 172.21.15.110:0/2621819340 conn(0x55b291778a70 msgr2=0x55b291778e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:27.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.506+0000 7faeb1405740 1 -- 172.21.15.110:0/2621819340 shutdown_connections 2024-09-12T02:14:27.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.506+0000 7faeb1405740 1 -- 172.21.15.110:0/2621819340 wait complete. 2024-09-12T02:14:27.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.506+0000 7faeb1405740 1 -- start start 2024-09-12T02:14:27.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.506+0000 7faeb1405740 1 Processor -- start 2024-09-12T02:14:27.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.507+0000 7faeb1405740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b29179b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.507+0000 7faeb1405740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b29179b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.507+0000 7faeb1405740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291800c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.507+0000 7faeb1405740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55b291799830 con 0x55b29177ce00 2024-09-12T02:14:27.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.507+0000 7faeb1405740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55b291799160 con 0x55b29177c4e0 2024-09-12T02:14:27.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.507+0000 7faeb1405740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55b291799f00 con 0x55b2917876c0 2024-09-12T02:14:27.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.507+0000 7faeb1405740 10 client.0 _ll_register_callbacks cb 0x7fae94012590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:14:27.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.507+0000 7faea6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b29179b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.507+0000 7faea6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b29179b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42220/0 (socket says 172.21.15.110:42220) 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.507+0000 7faea6a00640 1 -- 172.21.15.110:0/1870572943 learned_addr learned my addr 172.21.15.110:0/1870572943 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.507+0000 7faea7e00640 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b29179b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.507+0000 7faea7e00640 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291800c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7faea6a00640 1 -- 172.21.15.110:0/1870572943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 msgr2=0x55b291800c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7faea6a00640 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291800c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7faea6a00640 1 -- 172.21.15.110:0/1870572943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 msgr2=0x55b29179b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7faea6a00640 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b29179b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7faea6a00640 1 -- 172.21.15.110:0/1870572943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2918011b0 con 0x55b29177ce00 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7faea7e00640 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291800c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7faea6a00640 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b29179b6e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae94000c00 tx=0x7fae9401cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c254f501a5f1eec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7fae91600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7fae91600640 1 -- 172.21.15.110:0/1870572943 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9400f790 con 0x55b29177ce00 2024-09-12T02:14:27.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7faeb1405740 1 -- 172.21.15.110:0/1870572943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae940055c0 con 0x55b29177ce00 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7fae91600640 1 -- 172.21.15.110:0/1870572943 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fae94005320 con 0x55b29177ce00 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7fae91600640 1 -- 172.21.15.110:0/1870572943 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fae940035f0 con 0x55b29177ce00 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7faeb1405740 10 client.15012 fetch_fsmap learned FSMap version 25 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.508+0000 7faeb1405740 1 -- 172.21.15.110:0/1870572943 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b291802430 con 0x55b29177ce00 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.509+0000 7fae91600640 1 -- 172.21.15.110:0/1870572943 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae940055c0 con 0x55b29177ce00 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.509+0000 7fae91600640 1 -- 172.21.15.110:0/1870572943 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fae9402a770 con 0x55b29177ce00 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.509+0000 7faeb1405740 10 client.15012 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.509+0000 7faeb1405740 10 client.15012 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.509+0000 7faeb1405740 20 client.15012 populate_metadata read hostname 'smithi110' 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.509+0000 7faeb1405740 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55b291806af0 0x55b291805800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.509+0000 7faeb1405740 4 client.15012 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.509+0000 7faeb1405740 1 -- 172.21.15.110:0/1870572943 --> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] -- command(tid 0: {"prefix": "status"}) -- 0x55b2916e9b30 con 0x55b291806af0 2024-09-12T02:14:27.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.509+0000 7faea7e00640 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55b291806af0 0x55b291805800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:27.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7faea7e00640 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55b291806af0 0x55b291805800 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d14bf92660781fce server_cookie=11c37c282b0aaf6f in_seq=0 out_seq=0 2024-09-12T02:14:27.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7fae91600640 10 client.15012 ms_handle_connect on v2:172.21.15.115:6838/1796624254 2024-09-12T02:14:27.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7fae91600640 1 -- 172.21.15.110:0/1870572943 <== mds.0 v2:172.21.15.115:6838/1796624254 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55b2916e9b30 con 0x55b291806af0 2024-09-12T02:14:27.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7fae91600640 10 client.15012 handle_command_reply: tid=0 2024-09-12T02:14:27.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7faeb1405740 1 client.15012 shutdown 2024-09-12T02:14:27.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7faeb1405740 1 -- 172.21.15.110:0/1870572943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 msgr2=0x55b29179b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:27.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7faeb1405740 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b29179b6e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae94000c00 tx=0x7fae9401cb60 comp rx=0 tx=0).stop 2024-09-12T02:14:27.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7faeb1405740 1 -- 172.21.15.110:0/1870572943 shutdown_connections 2024-09-12T02:14:27.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7faeb1405740 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55b291806af0 0x55b291805800 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7faeb1405740 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55b2917876c0 0x55b291800c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7faeb1405740 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b29177ce00 0x55b29179b6e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7faeb1405740 1 --2- 172.21.15.110:0/1870572943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55b29177c4e0 0x55b29179b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7faeb1405740 1 -- 172.21.15.110:0/1870572943 >> 172.21.15.110:0/1870572943 conn(0x55b291778a70 msgr2=0x55b2917737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:27.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.510+0000 7fae91600640 0 client.15012 ms_handle_reset on v2:172.21.15.115:6838/1796624254 2024-09-12T02:14:27.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faeb1405740 1 -- 172.21.15.110:0/1870572943 shutdown_connections 2024-09-12T02:14:27.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faeb1405740 1 -- 172.21.15.110:0/1870572943 wait complete. 2024-09-12T02:14:27.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faeb1405740 20 client.15012 trim_cache size 0 max 16384 2024-09-12T02:14:27.516 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:14:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "10ead734-70ab-11ef-bcea-c7b262605968", 2024-09-12T02:14:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 0, 2024-09-12T02:14:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24539, 2024-09-12T02:14:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-09-12T02:14:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-09-12T02:14:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-09-12T02:14:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 132.827280551, 2024-09-12T02:14:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 25, 2024-09-12T02:14:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 97, 2024-09-12T02:14:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 95, 2024-09-12T02:14:27.516 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 148.878853056 2024-09-12T02:14:27.517 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:14:27.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faead200640 1 -- 172.21.15.110:0/4223654745 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fae8c0a2c90 msgr2=0x7fae8c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:27.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faead200640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fae8c0a2c90 0x7fae8c0a5150 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55b2917798d0 tx=0x7fae980d5550 comp rx=0 tx=0).stop 2024-09-12T02:14:27.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faead200640 1 -- 172.21.15.110:0/4223654745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea8103e30 msgr2=0x7faea819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:27.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faead200640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea8103e30 0x7faea819a410 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fae9800e9f0 tx=0x7fae9800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faead200640 1 -- 172.21.15.110:0/4223654745 shutdown_connections 2024-09-12T02:14:27.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faead200640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fae8c0a2c90 0x7fae8c0a5150 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faead200640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faea8108f60 0x7faea819ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faead200640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faea81047e0 0x7faea819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faead200640 1 --2- 172.21.15.110:0/4223654745 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faea8103e30 0x7faea819a410 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:27.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.511+0000 7faead200640 1 -- 172.21.15.110:0/4223654745 >> 172.21.15.110:0/4223654745 conn(0x7faea80ff8d0 msgr2=0x7faea8100b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:27.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.512+0000 7faead200640 1 -- 172.21.15.110:0/4223654745 shutdown_connections 2024-09-12T02:14:27.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:27.512+0000 7faead200640 1 -- 172.21.15.110:0/4223654745 wait complete. 2024-09-12T02:14:28.445 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T02:14:28.445 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T02:14:28.456 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T02:14:28.456 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T02:14:28.825 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:28.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:28 smithi110 ceph-mon[30548]: pgmap v378: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:29.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:28 smithi115 ceph-mon[35351]: pgmap v378: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:29.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:28 smithi136 ceph-mon[35814]: pgmap v378: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:29.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.396+0000 7f5f39000640 1 -- 172.21.15.110:0/1759913956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f34101c00 msgr2=0x7f5f34102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.397+0000 7f5f39000640 1 --2- 172.21.15.110:0/1759913956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f34101c00 0x7f5f34102000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009900 tx=0x7f5f2402a410 comp rx=0 tx=0).stop 2024-09-12T02:14:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.397+0000 7f5f39000640 1 -- 172.21.15.110:0/1759913956 shutdown_connections 2024-09-12T02:14:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.397+0000 7f5f39000640 1 --2- 172.21.15.110:0/1759913956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f341037c0 0x7f5f3410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.397+0000 7f5f39000640 1 --2- 172.21.15.110:0/1759913956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f34102e00 0x7f5f34103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.397+0000 7f5f39000640 1 --2- 172.21.15.110:0/1759913956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f34101c00 0x7f5f34102000 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.397+0000 7f5f39000640 1 -- 172.21.15.110:0/1759913956 >> 172.21.15.110:0/1759913956 conn(0x7f5f340fd390 msgr2=0x7f5f340ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.397+0000 7f5f39000640 1 -- 172.21.15.110:0/1759913956 shutdown_connections 2024-09-12T02:14:29.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.397+0000 7f5f39000640 1 -- 172.21.15.110:0/1759913956 wait complete. 2024-09-12T02:14:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.398+0000 7f5f39000640 1 Processor -- start 2024-09-12T02:14:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.398+0000 7f5f39000640 1 -- start start 2024-09-12T02:14:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.398+0000 7f5f39000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f34101c00 0x7f5f3419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.398+0000 7f5f39000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f34102e00 0x7f5f3419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:29.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.398+0000 7f5f39000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f341037c0 0x7f5f341a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.398+0000 7f5f39000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3410d900 con 0x7f5f341037c0 2024-09-12T02:14:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.398+0000 7f5f39000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3410d780 con 0x7f5f34101c00 2024-09-12T02:14:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.398+0000 7f5f39000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3410da80 con 0x7f5f34102e00 2024-09-12T02:14:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.399+0000 7f5f31e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f34101c00 0x7f5f3419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.399+0000 7f5f31e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f34101c00 0x7f5f3419a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:53762/0 (socket says 172.21.15.110:53762) 2024-09-12T02:14:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.399+0000 7f5f31e00640 1 -- 172.21.15.110:0/2534977793 learned_addr learned my addr 172.21.15.110:0/2534977793 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.399+0000 7f5f31400640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f34102e00 0x7f5f3419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.399+0000 7f5f32800640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f341037c0 0x7f5f341a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.399+0000 7f5f31e00640 1 -- 172.21.15.110:0/2534977793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f34102e00 msgr2=0x7f5f3419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.399+0000 7f5f31e00640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f34102e00 0x7f5f3419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.399+0000 7f5f31e00640 1 -- 172.21.15.110:0/2534977793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f341037c0 msgr2=0x7f5f341a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:29.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.399+0000 7f5f31e00640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f341037c0 0x7f5f341a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.399+0000 7f5f31e00640 1 -- 172.21.15.110:0/2534977793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f341a1dc0 con 0x7f5f34101c00 2024-09-12T02:14:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.399+0000 7f5f31e00640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f34101c00 0x7f5f3419a190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5f24031440 tx=0x7f5f24032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.400+0000 7f5f2aa00640 1 -- 172.21.15.110:0/2534977793 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2403f030 con 0x7f5f34101c00 2024-09-12T02:14:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.400+0000 7f5f39000640 1 -- 172.21.15.110:0/2534977793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f341a2050 con 0x7f5f34101c00 2024-09-12T02:14:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.400+0000 7f5f2aa00640 1 -- 172.21.15.110:0/2534977793 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f24003ce0 con 0x7f5f34101c00 2024-09-12T02:14:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.400+0000 7f5f39000640 1 -- 172.21.15.110:0/2534977793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f341a2580 con 0x7f5f34101c00 2024-09-12T02:14:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.400+0000 7f5f2aa00640 1 -- 172.21.15.110:0/2534977793 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f24035070 con 0x7f5f34101c00 2024-09-12T02:14:29.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.401+0000 7f5f39000640 1 -- 172.21.15.110:0/2534977793 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f341a28f0 con 0x7f5f34101c00 2024-09-12T02:14:29.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.403+0000 7f5f2aa00640 1 -- 172.21.15.110:0/2534977793 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5f24042030 con 0x7f5f34101c00 2024-09-12T02:14:29.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.404+0000 7f5f2aa00640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5f180a2cc0 0x7f5f180a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:29.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.404+0000 7f5f2aa00640 1 -- 172.21.15.110:0/2534977793 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f5f240efd80 con 0x7f5f34101c00 2024-09-12T02:14:29.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.404+0000 7f5f31400640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5f180a2cc0 0x7f5f180a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:29.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.405+0000 7f5f31400640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5f180a2cc0 0x7f5f180a5180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5f3419b6b0 tx=0x7f5f20005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:29.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.406+0000 7f5f2aa00640 1 -- 172.21.15.110:0/2534977793 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f240bc130 con 0x7f5f34101c00 2024-09-12T02:14:29.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.596+0000 7f5f39000640 1 -- 172.21.15.110:0/2534977793 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f5f34075b40 con 0x7f5f180a2cc0 2024-09-12T02:14:29.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.597+0000 7f5f2aa00640 1 -- 172.21.15.110:0/2534977793 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f5f34075b40 con 0x7f5f180a2cc0 2024-09-12T02:14:29.596 INFO:teuthology.orchestra.run.smithi110.stdout:Backend: cephadm 2024-09-12T02:14:29.596 INFO:teuthology.orchestra.run.smithi110.stdout:Available: Yes 2024-09-12T02:14:29.597 INFO:teuthology.orchestra.run.smithi110.stdout:Paused: No 2024-09-12T02:14:29.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.599+0000 7f5f39000640 1 -- 172.21.15.110:0/2534977793 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5f180a2cc0 msgr2=0x7f5f180a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:29.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.600+0000 7f5f39000640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5f180a2cc0 0x7f5f180a5180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5f3419b6b0 tx=0x7f5f20005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:29.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.600+0000 7f5f39000640 1 -- 172.21.15.110:0/2534977793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f34101c00 msgr2=0x7f5f3419a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:29.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.600+0000 7f5f39000640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f34101c00 0x7f5f3419a190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5f24031440 tx=0x7f5f24032ce0 comp rx=0 tx=0).stop 2024-09-12T02:14:29.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.600+0000 7f5f39000640 1 -- 172.21.15.110:0/2534977793 shutdown_connections 2024-09-12T02:14:29.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.600+0000 7f5f39000640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f5f180a2cc0 0x7f5f180a5180 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:29.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.600+0000 7f5f39000640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f341037c0 0x7f5f341a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:29.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.600+0000 7f5f39000640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f34102e00 0x7f5f3419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:29.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.600+0000 7f5f39000640 1 --2- 172.21.15.110:0/2534977793 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5f34101c00 0x7f5f3419a190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:29.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.600+0000 7f5f39000640 1 -- 172.21.15.110:0/2534977793 >> 172.21.15.110:0/2534977793 conn(0x7f5f340fd390 msgr2=0x7f5f34074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:29.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.600+0000 7f5f39000640 1 -- 172.21.15.110:0/2534977793 shutdown_connections 2024-09-12T02:14:29.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:29.600+0000 7f5f39000640 1 -- 172.21.15.110:0/2534977793 wait complete. 2024-09-12T02:14:30.402 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T02:14:30.769 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:30.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:30 smithi110 ceph-mon[30548]: pgmap v379: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:30.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:30 smithi110 ceph-mon[30548]: from='client.25028 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:31.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:30 smithi115 ceph-mon[35351]: pgmap v379: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:31.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:30 smithi115 ceph-mon[35351]: from='client.25028 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:31.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:30 smithi136 ceph-mon[35814]: pgmap v379: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:31.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:30 smithi136 ceph-mon[35814]: from='client.25028 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:31.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.387+0000 7f36b2e00640 1 -- 172.21.15.110:0/1216421702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36ac102e00 msgr2=0x7f36ac103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:31.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.387+0000 7f36b2e00640 1 --2- 172.21.15.110:0/1216421702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36ac102e00 0x7f36ac103280 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3694009900 tx=0x7f369402a3f0 comp rx=0 tx=0).stop 2024-09-12T02:14:31.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.387+0000 7f36b2e00640 1 -- 172.21.15.110:0/1216421702 shutdown_connections 2024-09-12T02:14:31.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.387+0000 7f36b2e00640 1 --2- 172.21.15.110:0/1216421702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36ac1037c0 0x7f36ac10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:31.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.387+0000 7f36b2e00640 1 --2- 172.21.15.110:0/1216421702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36ac102e00 0x7f36ac103280 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:31.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.387+0000 7f36b2e00640 1 --2- 172.21.15.110:0/1216421702 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac101c00 0x7f36ac102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:31.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.387+0000 7f36b2e00640 1 -- 172.21.15.110:0/1216421702 >> 172.21.15.110:0/1216421702 conn(0x7f36ac0fd390 msgr2=0x7f36ac0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:31.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.387+0000 7f36b2e00640 1 -- 172.21.15.110:0/1216421702 shutdown_connections 2024-09-12T02:14:31.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.387+0000 7f36b2e00640 1 -- 172.21.15.110:0/1216421702 wait complete. 2024-09-12T02:14:31.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.388+0000 7f36b2e00640 1 Processor -- start 2024-09-12T02:14:31.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.388+0000 7f36b2e00640 1 -- start start 2024-09-12T02:14:31.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.388+0000 7f36b2e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36ac101c00 0x7f36ac19a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:31.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.388+0000 7f36b2e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac102e00 0x7f36ac19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:31.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.388+0000 7f36b2e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36ac1037c0 0x7f36ac1a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:31.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.388+0000 7f36b2e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac10d860 con 0x7f36ac1037c0 2024-09-12T02:14:31.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.388+0000 7f36b2e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac10d6e0 con 0x7f36ac101c00 2024-09-12T02:14:31.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.388+0000 7f36b2e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f36ac10d9e0 con 0x7f36ac102e00 2024-09-12T02:14:31.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36b0e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36ac1037c0 0x7f36ac1a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:31.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36a3e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac102e00 0x7f36ac19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:31.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36b0e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36ac1037c0 0x7f36ac1a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41300/0 (socket says 172.21.15.110:41300) 2024-09-12T02:14:31.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36b0e00640 1 -- 172.21.15.110:0/4097063424 learned_addr learned my addr 172.21.15.110:0/4097063424 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:31.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36abe00640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36ac101c00 0x7f36ac19a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:31.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36b0e00640 1 -- 172.21.15.110:0/4097063424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac102e00 msgr2=0x7f36ac19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:31.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36b0e00640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac102e00 0x7f36ac19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:31.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36b0e00640 1 -- 172.21.15.110:0/4097063424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36ac101c00 msgr2=0x7f36ac19a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36b0e00640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36ac101c00 0x7f36ac19a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36b0e00640 1 -- 172.21.15.110:0/4097063424 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ac1a1d30 con 0x7f36ac1037c0 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36b0e00640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36ac1037c0 0x7f36ac1a16c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f36a400eb10 tx=0x7f36a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36a9600640 1 -- 172.21.15.110:0/4097063424 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4004b20 con 0x7f36ac1037c0 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.389+0000 7f36a9600640 1 -- 172.21.15.110:0/4097063424 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36a4004cc0 con 0x7f36ac1037c0 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.390+0000 7f36b2e00640 1 -- 172.21.15.110:0/4097063424 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ac1a1fc0 con 0x7f36ac1037c0 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.390+0000 7f36a9600640 1 -- 172.21.15.110:0/4097063424 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4010760 con 0x7f36ac1037c0 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.390+0000 7f36b2e00640 1 -- 172.21.15.110:0/4097063424 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ac1a2480 con 0x7f36ac1037c0 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.391+0000 7f36b2e00640 1 -- 172.21.15.110:0/4097063424 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ac1a2710 con 0x7f36ac1037c0 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.393+0000 7f36a9600640 1 -- 172.21.15.110:0/4097063424 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f36a4004fe0 con 0x7f36ac1037c0 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.394+0000 7f36a9600640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f36900a2c40 0x7f36900a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.394+0000 7f36a9600640 1 -- 172.21.15.110:0/4097063424 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f36a40cfab0 con 0x7f36ac1037c0 2024-09-12T02:14:31.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.394+0000 7f36abe00640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f36900a2c40 0x7f36900a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:31.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.395+0000 7f36abe00640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f36900a2c40 0x7f36900a5100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f369c005fd0 tx=0x7f369c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:31.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.398+0000 7f36a9600640 1 -- 172.21.15.110:0/4097063424 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36a409c4b0 con 0x7f36ac1037c0 2024-09-12T02:14:31.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.583+0000 7f36b2e00640 1 -- 172.21.15.110:0/4097063424 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f36ac1a28e0 con 0x7f36900a2c40 2024-09-12T02:14:31.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.597+0000 7f36a9600640 1 -- 172.21.15.110:0/4097063424 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7f36ac1a28e0 con 0x7f36900a2c40 2024-09-12T02:14:31.598 INFO:teuthology.orchestra.run.smithi110.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T02:14:31.598 INFO:teuthology.orchestra.run.smithi110.stdout:mds.a smithi110 running (2m) 16s ago 2m 17.4M - 19.1.1-298-gb53b6d3e 54467abc55f8 d50551b60e6e 2024-09-12T02:14:31.598 INFO:teuthology.orchestra.run.smithi110.stdout:mds.b smithi115 running (2m) 19s ago 2m 26.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 190d421cfdda 2024-09-12T02:14:31.598 INFO:teuthology.orchestra.run.smithi110.stdout:mds.c smithi136 running (2m) 19s ago 2m 19.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 308a66ea38d9 2024-09-12T02:14:31.598 INFO:teuthology.orchestra.run.smithi110.stdout:mds.d smithi110 running (2m) 16s ago 2m 13.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 db5421d39bba 2024-09-12T02:14:31.598 INFO:teuthology.orchestra.run.smithi110.stdout:mds.e smithi115 running (2m) 19s ago 2m 14.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 98167f62abd0 2024-09-12T02:14:31.598 INFO:teuthology.orchestra.run.smithi110.stdout:mds.f smithi136 running (2m) 19s ago 2m 17.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 54f541aac006 2024-09-12T02:14:31.598 INFO:teuthology.orchestra.run.smithi110.stdout:mds.g smithi110 running (2m) 16s ago 2m 12.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 29b2fbabe8de 2024-09-12T02:14:31.598 INFO:teuthology.orchestra.run.smithi110.stdout:mds.h smithi115 running (2m) 19s ago 2m 20.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 d193662e59b2 2024-09-12T02:14:31.598 INFO:teuthology.orchestra.run.smithi110.stdout:mds.i smithi136 running (2m) 19s ago 2m 17.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 629083f990d1 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:mds.j smithi110 running (3m) 16s ago 3m 13.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 6db31af053e7 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:mds.k smithi115 running (3m) 19s ago 3m 14.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 fbc940a853b6 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:mds.l smithi136 running (3m) 19s ago 3m 16.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 68aeba1b67e7 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.x smithi110 *:9283,8765 running (10m) 16s ago 10m 510M - 19.1.1-298-gb53b6d3e 54467abc55f8 7a7d4d0c65ed 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.y smithi115 *:8443,8765 running (8m) 19s ago 8m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 838d5753ee4a 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:mgr.z smithi136 *:8443,8765 running (8m) 19s ago 8m 442M - 19.1.1-298-gb53b6d3e 54467abc55f8 2bbee3b27121 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:mon.a smithi110 running (10m) 16s ago 10m 49.6M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 dbfffbd8dcfa 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:mon.b smithi115 running (9m) 19s ago 9m 44.8M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 5908841400b3 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:mon.c smithi136 running (9m) 19s ago 9m 41.6M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 aa610fa44e5d 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 smithi110 running (8m) 16s ago 8m 52.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 5fe1d46bc1b8 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 smithi115 running (7m) 19s ago 7m 56.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 5aad3ac09f85 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 smithi136 running (7m) 19s ago 7m 46.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 866377aa256b 2024-09-12T02:14:31.599 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 smithi110 running (7m) 16s ago 7m 51.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 5de8ab4b14c3 2024-09-12T02:14:31.600 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 smithi115 running (6m) 19s ago 6m 54.4M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 d004fb5a1af1 2024-09-12T02:14:31.600 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 smithi136 running (6m) 19s ago 6m 45.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 9d4445cb38fe 2024-09-12T02:14:31.600 INFO:teuthology.orchestra.run.smithi110.stdout:osd.6 smithi110 running (5m) 16s ago 5m 42.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 f29a811d00af 2024-09-12T02:14:31.600 INFO:teuthology.orchestra.run.smithi110.stdout:osd.7 smithi115 running (5m) 19s ago 5m 48.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 4db81c9bbefe 2024-09-12T02:14:31.600 INFO:teuthology.orchestra.run.smithi110.stdout:osd.8 smithi136 running (4m) 19s ago 4m 52.8M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 e0dbe21701d8 2024-09-12T02:14:31.600 INFO:teuthology.orchestra.run.smithi110.stdout:osd.9 smithi110 running (4m) 16s ago 4m 50.5M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 562cb25adf6c 2024-09-12T02:14:31.600 INFO:teuthology.orchestra.run.smithi110.stdout:osd.10 smithi115 running (3m) 19s ago 3m 53.0M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 f9e78c20f1c7 2024-09-12T02:14:31.600 INFO:teuthology.orchestra.run.smithi110.stdout:osd.11 smithi136 running (3m) 19s ago 3m 43.2M 4272M 19.1.1-298-gb53b6d3e 54467abc55f8 01074c7a3b2f 2024-09-12T02:14:31.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.599+0000 7f36b2e00640 1 -- 172.21.15.110:0/4097063424 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f36900a2c40 msgr2=0x7f36900a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:31.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.599+0000 7f36b2e00640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f36900a2c40 0x7f36900a5100 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f369c005fd0 tx=0x7f369c00b410 comp rx=0 tx=0).stop 2024-09-12T02:14:31.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.599+0000 7f36b2e00640 1 -- 172.21.15.110:0/4097063424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36ac1037c0 msgr2=0x7f36ac1a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:31.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.599+0000 7f36b2e00640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36ac1037c0 0x7f36ac1a16c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f36a400eb10 tx=0x7f36a400c2d0 comp rx=0 tx=0).stop 2024-09-12T02:14:31.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.599+0000 7f36b2e00640 1 -- 172.21.15.110:0/4097063424 shutdown_connections 2024-09-12T02:14:31.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.599+0000 7f36b2e00640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f36900a2c40 0x7f36900a5100 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:31.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.599+0000 7f36b2e00640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36ac1037c0 0x7f36ac1a16c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:31.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.599+0000 7f36b2e00640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36ac102e00 0x7f36ac19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:31.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.599+0000 7f36b2e00640 1 --2- 172.21.15.110:0/4097063424 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f36ac101c00 0x7f36ac19a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:31.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.599+0000 7f36b2e00640 1 -- 172.21.15.110:0/4097063424 >> 172.21.15.110:0/4097063424 conn(0x7f36ac0fd390 msgr2=0x7f36ac1085c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:31.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.599+0000 7f36b2e00640 1 -- 172.21.15.110:0/4097063424 shutdown_connections 2024-09-12T02:14:31.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:31.599+0000 7f36b2e00640 1 -- 172.21.15.110:0/4097063424 wait complete. 2024-09-12T02:14:32.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T02:14:32.787 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:32.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:32 smithi110 ceph-mon[30548]: pgmap v380: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:32.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:32 smithi110 ceph-mon[30548]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:33.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:32 smithi115 ceph-mon[35351]: pgmap v380: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:33.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:32 smithi115 ceph-mon[35351]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:33.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:32 smithi136 ceph-mon[35814]: pgmap v380: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:33.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:32 smithi136 ceph-mon[35814]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:33.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.363+0000 7fd937a00640 1 -- 172.21.15.110:0/3987452750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd930107900 msgr2=0x7fd930109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:33.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.363+0000 7fd937a00640 1 --2- 172.21.15.110:0/3987452750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd930107900 0x7fd930109d50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd928009ca0 tx=0x7fd92802a8c0 comp rx=0 tx=0).stop 2024-09-12T02:14:33.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.363+0000 7fd937a00640 1 -- 172.21.15.110:0/3987452750 shutdown_connections 2024-09-12T02:14:33.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.363+0000 7fd937a00640 1 --2- 172.21.15.110:0/3987452750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd930107900 0x7fd930109d50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:33.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.363+0000 7fd937a00640 1 --2- 172.21.15.110:0/3987452750 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd930104fd0 0x7fd9301073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:33.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.363+0000 7fd937a00640 1 --2- 172.21.15.110:0/3987452750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9301026a0 0x7fd930104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:33.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.363+0000 7fd937a00640 1 -- 172.21.15.110:0/3987452750 >> 172.21.15.110:0/3987452750 conn(0x7fd9300fc2a0 msgr2=0x7fd9300fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:33.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.363+0000 7fd937a00640 1 -- 172.21.15.110:0/3987452750 shutdown_connections 2024-09-12T02:14:33.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.363+0000 7fd937a00640 1 -- 172.21.15.110:0/3987452750 wait complete. 2024-09-12T02:14:33.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.364+0000 7fd937a00640 1 Processor -- start 2024-09-12T02:14:33.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.364+0000 7fd937a00640 1 -- start start 2024-09-12T02:14:33.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.364+0000 7fd937a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9301026a0 0x7fd930197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:33.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd937a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd930104fd0 0x7fd9301984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:33.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd937a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd930107900 0x7fd93019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:33.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd937a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd93010d910 con 0x7fd930104fd0 2024-09-12T02:14:33.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd937a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd93010d790 con 0x7fd930107900 2024-09-12T02:14:33.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd937a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd93010da90 con 0x7fd9301026a0 2024-09-12T02:14:33.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd92fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd930104fd0 0x7fd9301984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:33.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd935000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9301026a0 0x7fd930197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:33.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd935000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9301026a0 0x7fd930197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:60110/0 (socket says 172.21.15.110:60110) 2024-09-12T02:14:33.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd935000640 1 -- 172.21.15.110:0/869261106 learned_addr learned my addr 172.21.15.110:0/869261106 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:33.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd935a00640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd930107900 0x7fd93019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:33.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd92fe00640 1 -- 172.21.15.110:0/869261106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9301026a0 msgr2=0x7fd930197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:33.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd92fe00640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9301026a0 0x7fd930197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:33.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd92fe00640 1 -- 172.21.15.110:0/869261106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd930107900 msgr2=0x7fd93019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:33.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd92fe00640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd930107900 0x7fd93019f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:33.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd92fe00640 1 -- 172.21.15.110:0/869261106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93019fba0 con 0x7fd930104fd0 2024-09-12T02:14:33.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.365+0000 7fd935000640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9301026a0 0x7fd930197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:33.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.366+0000 7fd92fe00640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd930104fd0 0x7fd9301984b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00e9c0 tx=0x7fd91c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:33.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.366+0000 7fd92d600640 1 -- 172.21.15.110:0/869261106 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c00ccc0 con 0x7fd930104fd0 2024-09-12T02:14:33.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.366+0000 7fd92d600640 1 -- 172.21.15.110:0/869261106 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd91c010910 con 0x7fd930104fd0 2024-09-12T02:14:33.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.366+0000 7fd937a00640 1 -- 172.21.15.110:0/869261106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93019fe90 con 0x7fd930104fd0 2024-09-12T02:14:33.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.366+0000 7fd92d600640 1 -- 172.21.15.110:0/869261106 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c0188c0 con 0x7fd930104fd0 2024-09-12T02:14:33.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.366+0000 7fd937a00640 1 -- 172.21.15.110:0/869261106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9301a0340 con 0x7fd930104fd0 2024-09-12T02:14:33.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.367+0000 7fd937a00640 1 -- 172.21.15.110:0/869261106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9300fdd90 con 0x7fd930104fd0 2024-09-12T02:14:33.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.369+0000 7fd92d600640 1 -- 172.21.15.110:0/869261106 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd91c010ac0 con 0x7fd930104fd0 2024-09-12T02:14:33.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.370+0000 7fd92d600640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd9180a2c40 0x7fd9180a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:33.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.370+0000 7fd92d600640 1 -- 172.21.15.110:0/869261106 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fd91c0cf8b0 con 0x7fd930104fd0 2024-09-12T02:14:33.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.371+0000 7fd935000640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd9180a2c40 0x7fd9180a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:33.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.371+0000 7fd935000640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd9180a2c40 0x7fd9180a5100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd924011500 tx=0x7fd924005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:33.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.374+0000 7fd92d600640 1 -- 172.21.15.110:0/869261106 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd91c09bc60 con 0x7fd930104fd0 2024-09-12T02:14:33.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.556+0000 7fd937a00640 1 -- 172.21.15.110:0/869261106 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fd930062630 con 0x7fd9180a2c40 2024-09-12T02:14:33.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.562+0000 7fd92d600640 1 -- 172.21.15.110:0/869261106 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fd930062630 con 0x7fd9180a2c40 2024-09-12T02:14:33.563 INFO:teuthology.orchestra.run.smithi110.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T02:14:33.563 INFO:teuthology.orchestra.run.smithi110.stdout:mds.all 12/12 21s ago 3m smithi110=a;smithi110=d;smithi110=g;smithi110=j;smithi115=b;smithi115=e;smithi115=h;smithi115=k;smithi136=c;smithi136=f;smithi136=i;smithi136=l;count:12 2024-09-12T02:14:33.563 INFO:teuthology.orchestra.run.smithi110.stdout:mgr 3/3 21s ago 8m smithi110=x;smithi115=y;smithi136=z;count:3 2024-09-12T02:14:33.563 INFO:teuthology.orchestra.run.smithi110.stdout:mon 3/3 21s ago 9m smithi110:172.21.15.110=a;smithi115:172.21.15.115=b;smithi136:172.21.15.136=c;count:3 2024-09-12T02:14:33.563 INFO:teuthology.orchestra.run.smithi110.stdout:osd 12 21s ago - 2024-09-12T02:14:33.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.564+0000 7fd937a00640 1 -- 172.21.15.110:0/869261106 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd9180a2c40 msgr2=0x7fd9180a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:33.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.564+0000 7fd937a00640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd9180a2c40 0x7fd9180a5100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd924011500 tx=0x7fd924005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:33.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.564+0000 7fd937a00640 1 -- 172.21.15.110:0/869261106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd930104fd0 msgr2=0x7fd9301984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:33.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.564+0000 7fd937a00640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd930104fd0 0x7fd9301984b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00e9c0 tx=0x7fd91c00ee80 comp rx=0 tx=0).stop 2024-09-12T02:14:33.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.564+0000 7fd937a00640 1 -- 172.21.15.110:0/869261106 shutdown_connections 2024-09-12T02:14:33.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.564+0000 7fd937a00640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd9180a2c40 0x7fd9180a5100 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:33.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.564+0000 7fd937a00640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd930107900 0x7fd93019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:33.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.564+0000 7fd937a00640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd930104fd0 0x7fd9301984b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:33.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.564+0000 7fd937a00640 1 --2- 172.21.15.110:0/869261106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd9301026a0 0x7fd930197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:33.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.564+0000 7fd937a00640 1 -- 172.21.15.110:0/869261106 >> 172.21.15.110:0/869261106 conn(0x7fd9300fc2a0 msgr2=0x7fd930103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:33.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.565+0000 7fd937a00640 1 -- 172.21.15.110:0/869261106 shutdown_connections 2024-09-12T02:14:33.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:33.565+0000 7fd937a00640 1 -- 172.21.15.110:0/869261106 wait complete. 2024-09-12T02:14:34.327 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T02:14:34.696 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:34.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:34 smithi110 ceph-mon[30548]: pgmap v381: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:34.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:34 smithi110 ceph-mon[30548]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:35.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:34 smithi115 ceph-mon[35351]: pgmap v381: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:35.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:34 smithi115 ceph-mon[35351]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:35.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:34 smithi136 ceph-mon[35814]: pgmap v381: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:35.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:34 smithi136 ceph-mon[35814]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:35.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.296+0000 7fd7d2600640 1 -- 172.21.15.110:0/1527612371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc1037c0 msgr2=0x7fd7cc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:35.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.296+0000 7fd7d2600640 1 --2- 172.21.15.110:0/1527612371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc1037c0 0x7fd7cc10a050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009ca0 tx=0x7fd7c402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:14:35.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.297+0000 7fd7d2600640 1 -- 172.21.15.110:0/1527612371 shutdown_connections 2024-09-12T02:14:35.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.297+0000 7fd7d2600640 1 --2- 172.21.15.110:0/1527612371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc1037c0 0x7fd7cc10a050 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:35.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.297+0000 7fd7d2600640 1 --2- 172.21.15.110:0/1527612371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7cc102e00 0x7fd7cc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:35.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.297+0000 7fd7d2600640 1 --2- 172.21.15.110:0/1527612371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7cc101c00 0x7fd7cc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:35.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.297+0000 7fd7d2600640 1 -- 172.21.15.110:0/1527612371 >> 172.21.15.110:0/1527612371 conn(0x7fd7cc0fd390 msgr2=0x7fd7cc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:35.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.297+0000 7fd7d2600640 1 -- 172.21.15.110:0/1527612371 shutdown_connections 2024-09-12T02:14:35.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.297+0000 7fd7d2600640 1 -- 172.21.15.110:0/1527612371 wait complete. 2024-09-12T02:14:35.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.298+0000 7fd7d2600640 1 Processor -- start 2024-09-12T02:14:35.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.298+0000 7fd7d2600640 1 -- start start 2024-09-12T02:14:35.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.298+0000 7fd7d2600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc101c00 0x7fd7cc19a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:35.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.298+0000 7fd7d2600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7cc102e00 0x7fd7cc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:35.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.298+0000 7fd7d2600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7cc1037c0 0x7fd7cc1a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:35.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.298+0000 7fd7d2600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc10d880 con 0x7fd7cc101c00 2024-09-12T02:14:35.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.298+0000 7fd7d2600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc10d700 con 0x7fd7cc1037c0 2024-09-12T02:14:35.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.298+0000 7fd7d2600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc10da00 con 0x7fd7cc102e00 2024-09-12T02:14:35.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.298+0000 7fd7cb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc101c00 0x7fd7cc19a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:35.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.298+0000 7fd7cb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc101c00 0x7fd7cc19a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41346/0 (socket says 172.21.15.110:41346) 2024-09-12T02:14:35.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.298+0000 7fd7cb400640 1 -- 172.21.15.110:0/3102026824 learned_addr learned my addr 172.21.15.110:0/3102026824 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:35.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.299+0000 7fd7cbe00640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7cc1037c0 0x7fd7cc1a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:35.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.299+0000 7fd7caa00640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7cc102e00 0x7fd7cc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:35.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.299+0000 7fd7cb400640 1 -- 172.21.15.110:0/3102026824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7cc102e00 msgr2=0x7fd7cc19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:35.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.299+0000 7fd7cb400640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7cc102e00 0x7fd7cc19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:35.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.299+0000 7fd7cb400640 1 -- 172.21.15.110:0/3102026824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7cc1037c0 msgr2=0x7fd7cc1a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:35.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.299+0000 7fd7cb400640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7cc1037c0 0x7fd7cc1a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:35.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.299+0000 7fd7cb400640 1 -- 172.21.15.110:0/3102026824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc1a1cd0 con 0x7fd7cc101c00 2024-09-12T02:14:35.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.299+0000 7fd7cb400640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc101c00 0x7fd7cc19a0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00d770 tx=0x7fd7bc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:35.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.299+0000 7fd7c3e00640 1 -- 172.21.15.110:0/3102026824 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc017070 con 0x7fd7cc101c00 2024-09-12T02:14:35.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.299+0000 7fd7c3e00640 1 -- 172.21.15.110:0/3102026824 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7bc009c30 con 0x7fd7cc101c00 2024-09-12T02:14:35.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.299+0000 7fd7d2600640 1 -- 172.21.15.110:0/3102026824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7cc1a1fc0 con 0x7fd7cc101c00 2024-09-12T02:14:35.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.299+0000 7fd7c3e00640 1 -- 172.21.15.110:0/3102026824 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc003dd0 con 0x7fd7cc101c00 2024-09-12T02:14:35.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.300+0000 7fd7d2600640 1 -- 172.21.15.110:0/3102026824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7cc1a2410 con 0x7fd7cc101c00 2024-09-12T02:14:35.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.301+0000 7fd7d2600640 1 -- 172.21.15.110:0/3102026824 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7cc1a2670 con 0x7fd7cc101c00 2024-09-12T02:14:35.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.303+0000 7fd7c3e00640 1 -- 172.21.15.110:0/3102026824 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fd7bc003f70 con 0x7fd7cc101c00 2024-09-12T02:14:35.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.304+0000 7fd7c3e00640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd7b00a2c40 0x7fd7b00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:35.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.304+0000 7fd7c3e00640 1 -- 172.21.15.110:0/3102026824 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fd7bc0cf290 con 0x7fd7cc101c00 2024-09-12T02:14:35.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.304+0000 7fd7caa00640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd7b00a2c40 0x7fd7b00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:35.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.305+0000 7fd7caa00640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd7b00a2c40 0x7fd7b00a5100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc19b5c0 tx=0x7fd7b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:35.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.311+0000 7fd7c3e00640 1 -- 172.21.15.110:0/3102026824 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7bc009de0 con 0x7fd7cc101c00 2024-09-12T02:14:35.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.490+0000 7fd7d2600640 1 -- 172.21.15.110:0/3102026824 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fd7cc1a2900 con 0x7fd7b00a2c40 2024-09-12T02:14:35.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.491+0000 7fd7c3e00640 1 -- 172.21.15.110:0/3102026824 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fd7cc1a2900 con 0x7fd7b00a2c40 2024-09-12T02:14:35.492 INFO:teuthology.orchestra.run.smithi110.stdout:HOST ADDR LABELS STATUS 2024-09-12T02:14:35.492 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110 172.21.15.110 2024-09-12T02:14:35.492 INFO:teuthology.orchestra.run.smithi110.stdout:smithi115 172.21.15.115 2024-09-12T02:14:35.492 INFO:teuthology.orchestra.run.smithi110.stdout:smithi136 172.21.15.136 2024-09-12T02:14:35.492 INFO:teuthology.orchestra.run.smithi110.stdout:3 hosts in cluster 2024-09-12T02:14:35.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.493+0000 7fd7d2600640 1 -- 172.21.15.110:0/3102026824 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd7b00a2c40 msgr2=0x7fd7b00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:35.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.493+0000 7fd7d2600640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd7b00a2c40 0x7fd7b00a5100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc19b5c0 tx=0x7fd7b8005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:35.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.493+0000 7fd7d2600640 1 -- 172.21.15.110:0/3102026824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc101c00 msgr2=0x7fd7cc19a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:35.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.494+0000 7fd7d2600640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc101c00 0x7fd7cc19a0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00d770 tx=0x7fd7bc00dc30 comp rx=0 tx=0).stop 2024-09-12T02:14:35.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.494+0000 7fd7d2600640 1 -- 172.21.15.110:0/3102026824 shutdown_connections 2024-09-12T02:14:35.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.494+0000 7fd7d2600640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fd7b00a2c40 0x7fd7b00a5100 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:35.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.494+0000 7fd7d2600640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd7cc1037c0 0x7fd7cc1a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:35.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.494+0000 7fd7d2600640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7cc102e00 0x7fd7cc19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:35.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.494+0000 7fd7d2600640 1 --2- 172.21.15.110:0/3102026824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc101c00 0x7fd7cc19a0a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:35.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.494+0000 7fd7d2600640 1 -- 172.21.15.110:0/3102026824 >> 172.21.15.110:0/3102026824 conn(0x7fd7cc0fd390 msgr2=0x7fd7cc074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:35.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.494+0000 7fd7d2600640 1 -- 172.21.15.110:0/3102026824 shutdown_connections 2024-09-12T02:14:35.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:35.494+0000 7fd7d2600640 1 -- 172.21.15.110:0/3102026824 wait complete. 2024-09-12T02:14:36.407 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T02:14:36.781 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:36.941 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:36 smithi110 ceph-mon[30548]: pgmap v382: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:36.941 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:36 smithi110 ceph-mon[30548]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:37.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:36 smithi115 ceph-mon[35351]: pgmap v382: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:37.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:36 smithi115 ceph-mon[35351]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:37.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:36 smithi136 ceph-mon[35814]: pgmap v382: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:37.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:36 smithi136 ceph-mon[35814]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:37.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.395+0000 7f547be00640 1 -- 172.21.15.110:0/497281937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c103600 msgr2=0x7f547c109e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:37.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.395+0000 7f547be00640 1 --2- 172.21.15.110:0/497281937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c103600 0x7f547c109e90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5474009ca0 tx=0x7f547402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:14:37.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.395+0000 7f547be00640 1 -- 172.21.15.110:0/497281937 shutdown_connections 2024-09-12T02:14:37.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.395+0000 7f547be00640 1 --2- 172.21.15.110:0/497281937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c103600 0x7f547c109e90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:37.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.395+0000 7f547be00640 1 --2- 172.21.15.110:0/497281937 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f547c102c40 0x7f547c1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:37.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.395+0000 7f547be00640 1 --2- 172.21.15.110:0/497281937 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f547c101a40 0x7f547c101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:37.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.395+0000 7f547be00640 1 -- 172.21.15.110:0/497281937 >> 172.21.15.110:0/497281937 conn(0x7f547c0fd1f0 msgr2=0x7f547c0ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:37.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.396+0000 7f547be00640 1 -- 172.21.15.110:0/497281937 shutdown_connections 2024-09-12T02:14:37.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.396+0000 7f547be00640 1 -- 172.21.15.110:0/497281937 wait complete. 2024-09-12T02:14:37.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.396+0000 7f547be00640 1 Processor -- start 2024-09-12T02:14:37.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547be00640 1 -- start start 2024-09-12T02:14:37.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f547c101a40 0x7f547c199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:37.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f547c102c40 0x7f547c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:37.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c103600 0x7f547c1a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:37.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547be00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f547c10d6f0 con 0x7f547c103600 2024-09-12T02:14:37.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547be00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f547c10d570 con 0x7f547c102c40 2024-09-12T02:14:37.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547be00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f547c10d870 con 0x7f547c101a40 2024-09-12T02:14:37.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c103600 0x7f547c1a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:37.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547aa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f547c101a40 0x7f547c199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:37.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547aa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f547c101a40 0x7f547c199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:60154/0 (socket says 172.21.15.110:60154) 2024-09-12T02:14:37.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547aa00640 1 -- 172.21.15.110:0/3163350571 learned_addr learned my addr 172.21.15.110:0/3163350571 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:37.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c103600 0x7f547c1a1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:41362/0 (socket says 172.21.15.110:41362) 2024-09-12T02:14:37.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.397+0000 7f547a000640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f547c102c40 0x7f547c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:37.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.398+0000 7f547aa00640 1 -- 172.21.15.110:0/3163350571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f547c102c40 msgr2=0x7f547c19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:37.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.398+0000 7f547aa00640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f547c102c40 0x7f547c19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:37.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.398+0000 7f547aa00640 1 -- 172.21.15.110:0/3163350571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c103600 msgr2=0x7f547c1a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:37.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.398+0000 7f547aa00640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c103600 0x7f547c1a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:37.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.398+0000 7f547aa00640 1 -- 172.21.15.110:0/3163350571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547c1a1ae0 con 0x7f547c101a40 2024-09-12T02:14:37.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.398+0000 7f547aa00640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f547c101a40 0x7f547c199eb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f546c00e9c0 tx=0x7f546c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:37.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.398+0000 7f5473400640 1 -- 172.21.15.110:0/3163350571 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c00cd80 con 0x7f547c101a40 2024-09-12T02:14:37.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.398+0000 7f547be00640 1 -- 172.21.15.110:0/3163350571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547c1a1dd0 con 0x7f547c101a40 2024-09-12T02:14:37.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.398+0000 7f5473400640 1 -- 172.21.15.110:0/3163350571 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546c0035f0 con 0x7f547c101a40 2024-09-12T02:14:37.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.398+0000 7f5473400640 1 -- 172.21.15.110:0/3163350571 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c010690 con 0x7f547c101a40 2024-09-12T02:14:37.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.398+0000 7f547be00640 1 -- 172.21.15.110:0/3163350571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f547c1a2220 con 0x7f547c101a40 2024-09-12T02:14:37.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.399+0000 7f547be00640 1 -- 172.21.15.110:0/3163350571 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f547c1a24e0 con 0x7f547c101a40 2024-09-12T02:14:37.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.401+0000 7f5473400640 1 -- 172.21.15.110:0/3163350571 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f546c0037a0 con 0x7f547c101a40 2024-09-12T02:14:37.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.403+0000 7f5473400640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f54600a2c40 0x7f54600a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:37.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.403+0000 7f5473400640 1 -- 172.21.15.110:0/3163350571 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f546c0cfa00 con 0x7f547c101a40 2024-09-12T02:14:37.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.403+0000 7f547a000640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f54600a2c40 0x7f54600a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:37.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.404+0000 7f547a000640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f54600a2c40 0x7f54600a5100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f547c19b3d0 tx=0x7f5468005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:37.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.405+0000 7f5473400640 1 -- 172.21.15.110:0/3163350571 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f546c09c490 con 0x7f547c101a40 2024-09-12T02:14:37.609 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.608+0000 7f547be00640 1 -- 172.21.15.110:0/3163350571 --> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f547c1a26b0 con 0x7f54600a2c40 2024-09-12T02:14:37.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.610+0000 7f5473400640 1 -- 172.21.15.110:0/3163350571 <== mgr.14150 v2:172.21.15.110:6800/511769794 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f547c1a26b0 con 0x7f54600a2c40 2024-09-12T02:14:37.611 INFO:teuthology.orchestra.run.smithi110.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T02:14:37.611 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002T480DGN 447G No 4m ago Has a FileSystem, LVM detected 2024-09-12T02:14:37.611 INFO:teuthology.orchestra.run.smithi110.stdout:smithi115 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UU400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-12T02:14:37.611 INFO:teuthology.orchestra.run.smithi110.stdout:smithi136 /dev/nvme0n1 ssd INTEL_SSDPEDMX020T4_CVPD514100122P0SGN 1863G No 3m ago Has a FileSystem, LVM detected 2024-09-12T02:14:37.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.613+0000 7f547be00640 1 -- 172.21.15.110:0/3163350571 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f54600a2c40 msgr2=0x7f54600a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:37.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.613+0000 7f547be00640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f54600a2c40 0x7f54600a5100 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f547c19b3d0 tx=0x7f5468005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:37.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.613+0000 7f547be00640 1 -- 172.21.15.110:0/3163350571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f547c101a40 msgr2=0x7f547c199eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:37.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.613+0000 7f547be00640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f547c101a40 0x7f547c199eb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f546c00e9c0 tx=0x7f546c00ee80 comp rx=0 tx=0).stop 2024-09-12T02:14:37.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.613+0000 7f547be00640 1 -- 172.21.15.110:0/3163350571 shutdown_connections 2024-09-12T02:14:37.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.613+0000 7f547be00640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f54600a2c40 0x7f54600a5100 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:37.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.613+0000 7f547be00640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f547c103600 0x7f547c1a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:37.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.613+0000 7f547be00640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f547c102c40 0x7f547c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:37.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.613+0000 7f547be00640 1 --2- 172.21.15.110:0/3163350571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f547c101a40 0x7f547c199eb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:37.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.613+0000 7f547be00640 1 -- 172.21.15.110:0/3163350571 >> 172.21.15.110:0/3163350571 conn(0x7f547c0fd1f0 msgr2=0x7f547c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:37.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.613+0000 7f547be00640 1 -- 172.21.15.110:0/3163350571 shutdown_connections 2024-09-12T02:14:37.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:37.613+0000 7f547be00640 1 -- 172.21.15.110:0/3163350571 wait complete. 2024-09-12T02:14:38.481 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T02:14:38.491 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T02:14:38.491 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T02:14:38.872 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:38.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:38 smithi110 ceph-mon[30548]: pgmap v383: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:38.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:38 smithi110 ceph-mon[30548]: from='client.25057 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:39.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:38 smithi115 ceph-mon[35351]: pgmap v383: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:39.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:38 smithi115 ceph-mon[35351]: from='client.25057 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:39.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:38 smithi136 ceph-mon[35814]: pgmap v383: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:39.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:38 smithi136 ceph-mon[35814]: from='client.25057 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:14:39.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.481+0000 7f728d400640 1 -- 172.21.15.110:0/2065325804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7288103c50 msgr2=0x7f7288104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:39.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.481+0000 7f728d400640 1 --2- 172.21.15.110:0/2065325804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7288103c50 0x7f7288104050 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7278009900 tx=0x7f727802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:14:39.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.481+0000 7f728d400640 1 -- 172.21.15.110:0/2065325804 shutdown_connections 2024-09-12T02:14:39.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.481+0000 7f728d400640 1 --2- 172.21.15.110:0/2065325804 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7288105810 0x7f728810c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:39.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.481+0000 7f728d400640 1 --2- 172.21.15.110:0/2065325804 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7288104e50 0x7f72881052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:39.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.481+0000 7f728d400640 1 --2- 172.21.15.110:0/2065325804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7288103c50 0x7f7288104050 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:39.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.481+0000 7f728d400640 1 -- 172.21.15.110:0/2065325804 >> 172.21.15.110:0/2065325804 conn(0x7f72880ff3e0 msgr2=0x7f7288101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:39.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.482+0000 7f728d400640 1 -- 172.21.15.110:0/2065325804 shutdown_connections 2024-09-12T02:14:39.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.482+0000 7f728d400640 1 -- 172.21.15.110:0/2065325804 wait complete. 2024-09-12T02:14:39.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.482+0000 7f728d400640 1 Processor -- start 2024-09-12T02:14:39.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.483+0000 7f728d400640 1 -- start start 2024-09-12T02:14:39.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.483+0000 7f728d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7288103c50 0x7f7288199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:39.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.483+0000 7f728d400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7288104e50 0x7f728819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:39.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.483+0000 7f728d400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7288105810 0x7f72881a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:39.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.483+0000 7f728d400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f728810f900 con 0x7f7288103c50 2024-09-12T02:14:39.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.483+0000 7f728d400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f728810f780 con 0x7f7288105810 2024-09-12T02:14:39.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.483+0000 7f728d400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f728810fa80 con 0x7f7288104e50 2024-09-12T02:14:39.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.483+0000 7f7287e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7288103c50 0x7f7288199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:39.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.483+0000 7f7287e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7288103c50 0x7f7288199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39808/0 (socket says 172.21.15.110:39808) 2024-09-12T02:14:39.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.483+0000 7f7287e00640 1 -- 172.21.15.110:0/1624665550 learned_addr learned my addr 172.21.15.110:0/1624665550 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:39.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.483+0000 7f7287400640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7288104e50 0x7f728819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:39.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.483+0000 7f728ca00640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7288105810 0x7f72881a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:39.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.484+0000 7f7287e00640 1 -- 172.21.15.110:0/1624665550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7288104e50 msgr2=0x7f728819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:39.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.484+0000 7f7287e00640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7288104e50 0x7f728819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:39.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.484+0000 7f7287e00640 1 -- 172.21.15.110:0/1624665550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7288105810 msgr2=0x7f72881a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:39.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.484+0000 7f7287e00640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7288105810 0x7f72881a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:39.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.484+0000 7f7287e00640 1 -- 172.21.15.110:0/1624665550 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72881a1b20 con 0x7f7288103c50 2024-09-12T02:14:39.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.484+0000 7f7287e00640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7288103c50 0x7f7288199ef0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7278031440 tx=0x7f7278032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:39.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.484+0000 7f7284c00640 1 -- 172.21.15.110:0/1624665550 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727803f030 con 0x7f7288103c50 2024-09-12T02:14:39.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.484+0000 7f7284c00640 1 -- 172.21.15.110:0/1624665550 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7278003ce0 con 0x7f7288103c50 2024-09-12T02:14:39.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.484+0000 7f728d400640 1 -- 172.21.15.110:0/1624665550 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72881a1db0 con 0x7f7288103c50 2024-09-12T02:14:39.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.484+0000 7f7284c00640 1 -- 172.21.15.110:0/1624665550 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278035070 con 0x7f7288103c50 2024-09-12T02:14:39.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.484+0000 7f728d400640 1 -- 172.21.15.110:0/1624665550 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72881a2200 con 0x7f7288103c50 2024-09-12T02:14:39.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.486+0000 7f728d400640 1 -- 172.21.15.110:0/1624665550 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f728810afa0 con 0x7f7288103c50 2024-09-12T02:14:39.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.487+0000 7f7284c00640 1 -- 172.21.15.110:0/1624665550 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7278042030 con 0x7f7288103c50 2024-09-12T02:14:39.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.489+0000 7f7284c00640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f726c0a2cc0 0x7f726c0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:39.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.490+0000 7f7284c00640 1 -- 172.21.15.110:0/1624665550 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f72780ef690 con 0x7f7288103c50 2024-09-12T02:14:39.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.490+0000 7f7287400640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f726c0a2cc0 0x7f726c0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:39.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.490+0000 7f7287400640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f726c0a2cc0 0x7f726c0a5180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f728819b410 tx=0x7f7274005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:39.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.494+0000 7f7284c00640 1 -- 172.21.15.110:0/1624665550 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72780bbaa0 con 0x7f7288103c50 2024-09-12T02:14:39.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.708+0000 7f728d400640 1 -- 172.21.15.110:0/1624665550 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f728802da10 con 0x7f7288103c50 2024-09-12T02:14:39.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.708+0000 7f7284c00640 1 -- 172.21.15.110:0/1624665550 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3102 (secure 0 0 0) 0x7f72780bfda0 con 0x7f7288103c50 2024-09-12T02:14:39.709 INFO:teuthology.orchestra.run.smithi110.stdout:e25 2024-09-12T02:14:39.709 INFO:teuthology.orchestra.run.smithi110.stdout:btime 2024-09-12T02:13:05:600095+0000 2024-09-12T02:14:39.709 INFO:teuthology.orchestra.run.smithi110.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T02:14:39.709 INFO:teuthology.orchestra.run.smithi110.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:14:39.709 INFO:teuthology.orchestra.run.smithi110.stdout:legacy client fscid: 1 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem 'cephfs' (1) 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout:fs_name cephfs 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 25 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-12T02:12:13.698489+0000 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-12T02:13:04.635785+0000 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout:tableserver 0 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout:root 0 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout:session_timeout 300 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout:session_autoclose 300 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout:max_file_size 1099511627776 2024-09-12T02:14:39.710 INFO:teuthology.orchestra.run.smithi110.stdout:max_xattr_size 65536 2024-09-12T02:14:39.711 INFO:teuthology.orchestra.run.smithi110.stdout:required_client_features {} 2024-09-12T02:14:39.711 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure 0 2024-09-12T02:14:39.711 INFO:teuthology.orchestra.run.smithi110.stdout:last_failure_osd_epoch 0 2024-09-12T02:14:39.711 INFO:teuthology.orchestra.run.smithi110.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T02:14:39.711 INFO:teuthology.orchestra.run.smithi110.stdout:max_mds 3 2024-09-12T02:14:39.711 INFO:teuthology.orchestra.run.smithi110.stdout:in 0,1,2 2024-09-12T02:14:39.711 INFO:teuthology.orchestra.run.smithi110.stdout:up {0=24539,1=24538,2=24517} 2024-09-12T02:14:39.711 INFO:teuthology.orchestra.run.smithi110.stdout:failed 2024-09-12T02:14:39.711 INFO:teuthology.orchestra.run.smithi110.stdout:damaged 2024-09-12T02:14:39.711 INFO:teuthology.orchestra.run.smithi110.stdout:stopped 2024-09-12T02:14:39.711 INFO:teuthology.orchestra.run.smithi110.stdout:data_pools [3,4] 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout:metadata_pool 2 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout:inline_data disabled 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout:balancer 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout:bal_rank_mask -1 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout:standby_count_wanted 0 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout:qdb_cluster leader: 24539 members: 24539,24538,24517 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b{0:24539} state up:active seq 6 addr [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c{0:24505} state up:standby-replay seq 1 addr [v2:172.21.15.136:6836/3503120492,v1:172.21.15.136:6837/3503120492] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a{1:24538} state up:active seq 17 addr [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.h{1:24497} state up:standby-replay seq 1 addr [v2:172.21.15.115:6836/1922841773,v1:172.21.15.115:6837/1922841773] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.i{2:24517} state up:active seq 20 addr [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.f{2:24493} state up:standby-replay seq 1 addr [v2:172.21.15.136:6834/2205978549,v1:172.21.15.136:6835/2205978549] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:14:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:39.713 INFO:teuthology.orchestra.run.smithi110.stdout:Standby daemons: 2024-09-12T02:14:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:39.713 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.j{-1:14448} state up:standby seq 1 addr [v2:172.21.15.110:6834/1116222673,v1:172.21.15.110:6835/1116222673] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:14:39.713 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d{-1:14460} state up:standby seq 1 addr [v2:172.21.15.110:6836/574606945,v1:172.21.15.110:6837/574606945] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:14:39.713 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.g{-1:14502} state up:standby seq 1 addr [v2:172.21.15.110:6838/647319477,v1:172.21.15.110:6839/647319477] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:14:39.713 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.k{-1:24446} state up:standby seq 1 addr [v2:172.21.15.115:6832/2767472507,v1:172.21.15.115:6833/2767472507] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:14:39.713 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.l{-1:24454} state up:standby seq 1 addr [v2:172.21.15.136:6832/701119527,v1:172.21.15.136:6833/701119527] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:14:39.714 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.e{-1:24476} state up:standby seq 1 addr [v2:172.21.15.115:6834/3409231586,v1:172.21.15.115:6835/3409231586] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T02:14:39.715 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-09-12T02:14:39.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.711+0000 7f728d400640 1 -- 172.21.15.110:0/1624665550 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f726c0a2cc0 msgr2=0x7f726c0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:39.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.711+0000 7f728d400640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f726c0a2cc0 0x7f726c0a5180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f728819b410 tx=0x7f7274005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:39.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.711+0000 7f728d400640 1 -- 172.21.15.110:0/1624665550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7288103c50 msgr2=0x7f7288199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:39.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.711+0000 7f728d400640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7288103c50 0x7f7288199ef0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7278031440 tx=0x7f7278032ce0 comp rx=0 tx=0).stop 2024-09-12T02:14:39.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.711+0000 7f728d400640 1 -- 172.21.15.110:0/1624665550 shutdown_connections 2024-09-12T02:14:39.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.711+0000 7f728d400640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f726c0a2cc0 0x7f726c0a5180 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:39.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.711+0000 7f728d400640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7288105810 0x7f72881a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:39.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.711+0000 7f728d400640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7288104e50 0x7f728819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:39.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.711+0000 7f728d400640 1 --2- 172.21.15.110:0/1624665550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7288103c50 0x7f7288199ef0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:39.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.711+0000 7f728d400640 1 -- 172.21.15.110:0/1624665550 >> 172.21.15.110:0/1624665550 conn(0x7f72880ff3e0 msgr2=0x7f7288108170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:39.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.711+0000 7f728d400640 1 -- 172.21.15.110:0/1624665550 shutdown_connections 2024-09-12T02:14:39.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:39.711+0000 7f728d400640 1 -- 172.21.15.110:0/1624665550 wait complete. 2024-09-12T02:14:40.567 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-12T02:14:40.935 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:40.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:40 smithi110 ceph-mon[30548]: pgmap v384: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:40.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:40 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1624665550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:14:41.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:40 smithi115 ceph-mon[35351]: pgmap v384: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:41.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:40 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1624665550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:14:41.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:40 smithi136 ceph-mon[35814]: pgmap v384: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:41.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:40 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1624665550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T02:14:41.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.487+0000 7fe9dde00640 1 -- 172.21.15.110:0/572721874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d8078790 msgr2=0x7fe9d8079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:41.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.487+0000 7fe9dde00640 1 --2- 172.21.15.110:0/572721874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d8078790 0x7fe9d8079030 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009ca0 tx=0x7fe9d002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:14:41.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.488+0000 7fe9dde00640 1 -- 172.21.15.110:0/572721874 shutdown_connections 2024-09-12T02:14:41.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.488+0000 7fe9dde00640 1 --2- 172.21.15.110:0/572721874 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d8078790 0x7fe9d8079030 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:41.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.488+0000 7fe9dde00640 1 --2- 172.21.15.110:0/572721874 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d8077df0 0x7fe9d8078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:41.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.488+0000 7fe9dde00640 1 --2- 172.21.15.110:0/572721874 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9d8076ba0 0x7fe9d8076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:41.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.488+0000 7fe9dde00640 1 -- 172.21.15.110:0/572721874 >> 172.21.15.110:0/572721874 conn(0x7fe9d80ff3e0 msgr2=0x7fe9d8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:41.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.488+0000 7fe9dde00640 1 -- 172.21.15.110:0/572721874 shutdown_connections 2024-09-12T02:14:41.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.488+0000 7fe9dde00640 1 -- 172.21.15.110:0/572721874 wait complete. 2024-09-12T02:14:41.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.488+0000 7fe9dde00640 1 Processor -- start 2024-09-12T02:14:41.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9dde00640 1 -- start start 2024-09-12T02:14:41.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9dde00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d8076ba0 0x7fe9d819e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:41.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9dde00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9d8077df0 0x7fe9d819e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:41.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9dde00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d8078790 0x7fe9d81a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:41.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9dde00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d8113d60 con 0x7fe9d8076ba0 2024-09-12T02:14:41.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9dde00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d8113be0 con 0x7fe9d8077df0 2024-09-12T02:14:41.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9dde00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d8113ee0 con 0x7fe9d8078790 2024-09-12T02:14:41.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9dca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d8076ba0 0x7fe9d819e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:41.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9d8077df0 0x7fe9d819e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:41.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9dd400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d8078790 0x7fe9d81a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:41.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9d8077df0 0x7fe9d819e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:48984/0 (socket says 172.21.15.110:48984) 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9dca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d8076ba0 0x7fe9d819e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39824/0 (socket says 172.21.15.110:39824) 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.489+0000 7fe9d7e00640 1 -- 172.21.15.110:0/663667017 learned_addr learned my addr 172.21.15.110:0/663667017 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.490+0000 7fe9d7e00640 1 -- 172.21.15.110:0/663667017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d8078790 msgr2=0x7fe9d81a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.490+0000 7fe9d7e00640 1 --2- 172.21.15.110:0/663667017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d8078790 0x7fe9d81a5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.490+0000 7fe9d7e00640 1 -- 172.21.15.110:0/663667017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d8076ba0 msgr2=0x7fe9d819e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.490+0000 7fe9d7e00640 1 --2- 172.21.15.110:0/663667017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d8076ba0 0x7fe9d819e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.490+0000 7fe9d7e00640 1 -- 172.21.15.110:0/663667017 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d81a5ee0 con 0x7fe9d8077df0 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.490+0000 7fe9d7e00640 1 --2- 172.21.15.110:0/663667017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9d8077df0 0x7fe9d819e7f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400e9f0 tx=0x7fe9c400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.490+0000 7fe9d5600640 1 -- 172.21.15.110:0/663667017 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400cd80 con 0x7fe9d8077df0 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.490+0000 7fe9dde00640 1 -- 172.21.15.110:0/663667017 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d81a61d0 con 0x7fe9d8077df0 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.490+0000 7fe9d5600640 1 -- 172.21.15.110:0/663667017 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9c4005500 con 0x7fe9d8077df0 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.490+0000 7fe9d5600640 1 -- 172.21.15.110:0/663667017 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4010690 con 0x7fe9d8077df0 2024-09-12T02:14:41.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.490+0000 7fe9dde00640 1 -- 172.21.15.110:0/663667017 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d81a66c0 con 0x7fe9d8077df0 2024-09-12T02:14:41.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.491+0000 7fe9dde00640 1 -- 172.21.15.110:0/663667017 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d81105d0 con 0x7fe9d8077df0 2024-09-12T02:14:41.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.494+0000 7fe9d5600640 1 -- 172.21.15.110:0/663667017 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe9c40046c0 con 0x7fe9d8077df0 2024-09-12T02:14:41.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.495+0000 7fe9d5600640 1 --2- 172.21.15.110:0/663667017 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe9c00a2c40 0x7fe9c00a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:41.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.495+0000 7fe9d5600640 1 -- 172.21.15.110:0/663667017 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fe9c40cfb80 con 0x7fe9d8077df0 2024-09-12T02:14:41.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.495+0000 7fe9dca00640 1 --2- 172.21.15.110:0/663667017 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe9c00a2c40 0x7fe9c00a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:41.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.496+0000 7fe9dca00640 1 --2- 172.21.15.110:0/663667017 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe9c00a2c40 0x7fe9c00a5100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009bd0 tx=0x7fe9cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:41.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.497+0000 7fe9d5600640 1 -- 172.21.15.110:0/663667017 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe9c40541b0 con 0x7fe9d8077df0 2024-09-12T02:14:41.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.675+0000 7fe9dde00640 1 -- 172.21.15.110:0/663667017 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fe9d802da10 con 0x7fe9d8077df0 2024-09-12T02:14:41.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.676+0000 7fe9d5600640 1 -- 172.21.15.110:0/663667017 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v97) ==== 56+0+5691 (secure 0 0 0) 0x7fe9c409c580 con 0x7fe9d8077df0 2024-09-12T02:14:41.677 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 97 2024-09-12T02:14:41.677 INFO:teuthology.orchestra.run.smithi110.stdout:fsid 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:14:41.677 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-09-12T02:03:43.877844+0000 2024-09-12T02:14:41.677 INFO:teuthology.orchestra.run.smithi110.stdout:modified 2024-09-12T02:13:46.686934+0000 2024-09-12T02:14:41.677 INFO:teuthology.orchestra.run.smithi110.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T02:14:41.678 INFO:teuthology.orchestra.run.smithi110.stdout:crush_version 27 2024-09-12T02:14:41.678 INFO:teuthology.orchestra.run.smithi110.stdout:full_ratio 0.95 2024-09-12T02:14:41.678 INFO:teuthology.orchestra.run.smithi110.stdout:backfillfull_ratio 0.9 2024-09-12T02:14:41.678 INFO:teuthology.orchestra.run.smithi110.stdout:nearfull_ratio 0.85 2024-09-12T02:14:41.678 INFO:teuthology.orchestra.run.smithi110.stdout:require_min_compat_client luminous 2024-09-12T02:14:41.678 INFO:teuthology.orchestra.run.smithi110.stdout:min_compat_client luminous 2024-09-12T02:14:41.678 INFO:teuthology.orchestra.run.smithi110.stdout:require_osd_release squid 2024-09-12T02:14:41.678 INFO:teuthology.orchestra.run.smithi110.stdout:stretch_mode_enabled false 2024-09-12T02:14:41.678 INFO:teuthology.orchestra.run.smithi110.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-12T02:14:41.678 INFO:teuthology.orchestra.run.smithi110.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-12T02:14:41.678 INFO:teuthology.orchestra.run.smithi110.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-12T02:14:41.679 INFO:teuthology.orchestra.run.smithi110.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 93 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-12T02:14:41.679 INFO:teuthology.orchestra.run.smithi110.stdout:max_osd 12 2024-09-12T02:14:41.679 INFO:teuthology.orchestra.run.smithi110.stdout:osd.0 up in weight 1 up_from 8 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6802/1183571640,v1:172.21.15.110:6803/1183571640] [v2:172.21.15.110:6804/1183571640,v1:172.21.15.110:6805/1183571640] exists,up a36656f3-7a9c-4a0d-a44e-95a4791d8f54 2024-09-12T02:14:41.679 INFO:teuthology.orchestra.run.smithi110.stdout:osd.1 up in weight 1 up_from 13 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6800/4233466070,v1:172.21.15.115:6801/4233466070] [v2:172.21.15.115:6802/4233466070,v1:172.21.15.115:6803/4233466070] exists,up e9b02030-b19e-481a-9b91-4f7cb561b6b4 2024-09-12T02:14:41.679 INFO:teuthology.orchestra.run.smithi110.stdout:osd.2 up in weight 1 up_from 18 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6800/1988990192,v1:172.21.15.136:6801/1988990192] [v2:172.21.15.136:6802/1988990192,v1:172.21.15.136:6803/1988990192] exists,up 5383e300-6d1a-419d-ac6c-a918c7541c7a 2024-09-12T02:14:41.679 INFO:teuthology.orchestra.run.smithi110.stdout:osd.3 up in weight 1 up_from 26 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6810/938081925,v1:172.21.15.110:6811/938081925] [v2:172.21.15.110:6812/938081925,v1:172.21.15.110:6813/938081925] exists,up f22237a9-ac1e-47a9-8092-d54dbf752521 2024-09-12T02:14:41.679 INFO:teuthology.orchestra.run.smithi110.stdout:osd.4 up in weight 1 up_from 33 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6808/3669727119,v1:172.21.15.115:6809/3669727119] [v2:172.21.15.115:6810/3669727119,v1:172.21.15.115:6811/3669727119] exists,up e70c0a05-336f-4ace-8f41-682059272b1a 2024-09-12T02:14:41.679 INFO:teuthology.orchestra.run.smithi110.stdout:osd.5 up in weight 1 up_from 38 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6808/3847045265,v1:172.21.15.136:6809/3847045265] [v2:172.21.15.136:6810/3847045265,v1:172.21.15.136:6811/3847045265] exists,up 9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca 2024-09-12T02:14:41.679 INFO:teuthology.orchestra.run.smithi110.stdout:osd.6 up in weight 1 up_from 46 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6818/2221895141,v1:172.21.15.110:6819/2221895141] [v2:172.21.15.110:6820/2221895141,v1:172.21.15.110:6821/2221895141] exists,up 2e5987bb-997f-4503-9b12-f6de1c456e69 2024-09-12T02:14:41.679 INFO:teuthology.orchestra.run.smithi110.stdout:osd.7 up in weight 1 up_from 51 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6816/2297193086,v1:172.21.15.115:6817/2297193086] [v2:172.21.15.115:6818/2297193086,v1:172.21.15.115:6819/2297193086] exists,up 0736750a-3ed6-4092-8e11-5951827b7810 2024-09-12T02:14:41.679 INFO:teuthology.orchestra.run.smithi110.stdout:osd.8 up in weight 1 up_from 58 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6816/3872859118,v1:172.21.15.136:6817/3872859118] [v2:172.21.15.136:6818/3872859118,v1:172.21.15.136:6819/3872859118] exists,up cf7a657a-cbdd-4b88-b71c-d98a74ffec5d 2024-09-12T02:14:41.679 INFO:teuthology.orchestra.run.smithi110.stdout:osd.9 up in weight 1 up_from 66 up_thru 96 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6826/558612753,v1:172.21.15.110:6827/558612753] [v2:172.21.15.110:6828/558612753,v1:172.21.15.110:6829/558612753] exists,up ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4 2024-09-12T02:14:41.680 INFO:teuthology.orchestra.run.smithi110.stdout:osd.10 up in weight 1 up_from 71 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.115:6824/4061070814,v1:172.21.15.115:6825/4061070814] [v2:172.21.15.115:6826/4061070814,v1:172.21.15.115:6827/4061070814] exists,up 9409f555-8139-4a02-9fe2-446f30072aca 2024-09-12T02:14:41.680 INFO:teuthology.orchestra.run.smithi110.stdout:osd.11 up in weight 1 up_from 78 up_thru 94 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6824/1064088671,v1:172.21.15.136:6825/1064088671] [v2:172.21.15.136:6826/1064088671,v1:172.21.15.136:6827/1064088671] exists,up a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16 2024-09-12T02:14:41.680 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 2.b [2,1,8,11] 2024-09-12T02:14:41.680 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 2.10 [8,11] 2024-09-12T02:14:41.680 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 2.16 [2,4] 2024-09-12T02:14:41.680 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.1d [4,8] 2024-09-12T02:14:41.680 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.24 [4,9] 2024-09-12T02:14:41.680 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.27 [3,9] 2024-09-12T02:14:41.680 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.2c [4,9] 2024-09-12T02:14:41.680 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 3.37 [5,6] 2024-09-12T02:14:41.680 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 4.e [5,8] 2024-09-12T02:14:41.680 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 4.10 [9,8] 2024-09-12T02:14:41.681 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 4.12 [9,10] 2024-09-12T02:14:41.681 INFO:teuthology.orchestra.run.smithi110.stdout:pg_upmap_items 4.13 [9,8] 2024-09-12T02:14:41.681 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:0/3490929121 expires 2024-09-13T02:04:45.356605+0000 2024-09-12T02:14:41.682 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:0/2826731707 expires 2024-09-13T02:04:45.356605+0000 2024-09-12T02:14:41.682 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:0/2413734786 expires 2024-09-13T02:04:45.356605+0000 2024-09-12T02:14:41.682 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:6801/3137576010 expires 2024-09-13T02:04:45.356605+0000 2024-09-12T02:14:41.682 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:6800/3137576010 expires 2024-09-13T02:04:45.356605+0000 2024-09-12T02:14:41.682 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:6801/3368055532 expires 2024-09-13T02:04:17.987172+0000 2024-09-12T02:14:41.682 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:0/667674244 expires 2024-09-13T02:04:17.987172+0000 2024-09-12T02:14:41.682 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:6800/3368055532 expires 2024-09-13T02:04:17.987172+0000 2024-09-12T02:14:41.682 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:0/3644360562 expires 2024-09-13T02:04:17.987172+0000 2024-09-12T02:14:41.682 INFO:teuthology.orchestra.run.smithi110.stdout:blocklist 172.21.15.110:0/3947837481 expires 2024-09-13T02:04:17.987172+0000 2024-09-12T02:14:41.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.678+0000 7fe9dde00640 1 -- 172.21.15.110:0/663667017 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe9c00a2c40 msgr2=0x7fe9c00a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:41.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.678+0000 7fe9dde00640 1 --2- 172.21.15.110:0/663667017 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe9c00a2c40 0x7fe9c00a5100 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc009bd0 tx=0x7fe9cc005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:41.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.678+0000 7fe9dde00640 1 -- 172.21.15.110:0/663667017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9d8077df0 msgr2=0x7fe9d819e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:41.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.678+0000 7fe9dde00640 1 --2- 172.21.15.110:0/663667017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9d8077df0 0x7fe9d819e7f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400e9f0 tx=0x7fe9c400edf0 comp rx=0 tx=0).stop 2024-09-12T02:14:41.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.678+0000 7fe9dde00640 1 -- 172.21.15.110:0/663667017 shutdown_connections 2024-09-12T02:14:41.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.678+0000 7fe9dde00640 1 --2- 172.21.15.110:0/663667017 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fe9c00a2c40 0x7fe9c00a5100 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:41.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.678+0000 7fe9dde00640 1 --2- 172.21.15.110:0/663667017 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe9d8078790 0x7fe9d81a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:41.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.678+0000 7fe9dde00640 1 --2- 172.21.15.110:0/663667017 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe9d8077df0 0x7fe9d819e7f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:41.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.678+0000 7fe9dde00640 1 --2- 172.21.15.110:0/663667017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9d8076ba0 0x7fe9d819e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:41.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.678+0000 7fe9dde00640 1 -- 172.21.15.110:0/663667017 >> 172.21.15.110:0/663667017 conn(0x7fe9d80ff3e0 msgr2=0x7fe9d8100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:41.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.679+0000 7fe9dde00640 1 -- 172.21.15.110:0/663667017 shutdown_connections 2024-09-12T02:14:41.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:41.679+0000 7fe9dde00640 1 -- 172.21.15.110:0/663667017 wait complete. 2024-09-12T02:14:41.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:41 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/663667017' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:14:42.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:41 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/663667017' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:14:42.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:41 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/663667017' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-12T02:14:42.501 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-12T02:14:42.512 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:14:42.884 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:42.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:42 smithi110 ceph-mon[30548]: pgmap v385: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:43.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:42 smithi115 ceph-mon[35351]: pgmap v385: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:43.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:42 smithi136 ceph-mon[35814]: pgmap v385: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:43.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.485+0000 7f7c39400640 1 -- 172.21.15.110:0/894146261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c34109120 msgr2=0x7f7c34110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:43.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.485+0000 7f7c39400640 1 --2- 172.21.15.110:0/894146261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c34109120 0x7f7c34110ca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009ca0 tx=0x7f7c2c02a8c0 comp rx=0 tx=0).stop 2024-09-12T02:14:43.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.485+0000 7f7c39400640 1 -- 172.21.15.110:0/894146261 shutdown_connections 2024-09-12T02:14:43.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.485+0000 7f7c39400640 1 --2- 172.21.15.110:0/894146261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c34109120 0x7f7c34110ca0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:43.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.485+0000 7f7c39400640 1 --2- 172.21.15.110:0/894146261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c341049a0 0x7f7c341089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.485+0000 7f7c39400640 1 --2- 172.21.15.110:0/894146261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c34103ff0 0x7f7c341043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.485+0000 7f7c39400640 1 -- 172.21.15.110:0/894146261 >> 172.21.15.110:0/894146261 conn(0x7f7c340ffa90 msgr2=0x7f7c34101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.485+0000 7f7c39400640 1 -- 172.21.15.110:0/894146261 shutdown_connections 2024-09-12T02:14:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.485+0000 7f7c39400640 1 -- 172.21.15.110:0/894146261 wait complete. 2024-09-12T02:14:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.486+0000 7f7c39400640 1 Processor -- start 2024-09-12T02:14:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.486+0000 7f7c39400640 1 -- start start 2024-09-12T02:14:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c39400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c34103ff0 0x7f7c3419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c39400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c341049a0 0x7f7c3419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c39400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c34109120 0x7f7c3419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c39400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7c341141a0 con 0x7f7c34109120 2024-09-12T02:14:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c39400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7c34114020 con 0x7f7c34103ff0 2024-09-12T02:14:43.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c39400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7c34114320 con 0x7f7c341049a0 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c33200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c34109120 0x7f7c3419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c31e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c341049a0 0x7f7c3419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c33200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c34109120 0x7f7c3419eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39846/0 (socket says 172.21.15.110:39846) 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c33200640 1 -- 172.21.15.110:0/2359563435 learned_addr learned my addr 172.21.15.110:0/2359563435 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c32800640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c34103ff0 0x7f7c3419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c33200640 1 -- 172.21.15.110:0/2359563435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c341049a0 msgr2=0x7f7c3419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c33200640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c341049a0 0x7f7c3419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c33200640 1 -- 172.21.15.110:0/2359563435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c34103ff0 msgr2=0x7f7c3419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c33200640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c34103ff0 0x7f7c3419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c33200640 1 -- 172.21.15.110:0/2359563435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3419f590 con 0x7f7c34109120 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.487+0000 7f7c32800640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c34103ff0 0x7f7c3419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.488+0000 7f7c33200640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c34109120 0x7f7c3419eeb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c005e30 tx=0x7f7c2c003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:43.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.488+0000 7f7c2b400640 1 -- 172.21.15.110:0/2359563435 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c031650 con 0x7f7c34109120 2024-09-12T02:14:43.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.488+0000 7f7c2b400640 1 -- 172.21.15.110:0/2359563435 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c2c0317f0 con 0x7f7c34109120 2024-09-12T02:14:43.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.488+0000 7f7c39400640 1 -- 172.21.15.110:0/2359563435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3419f820 con 0x7f7c34109120 2024-09-12T02:14:43.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.488+0000 7f7c2b400640 1 -- 172.21.15.110:0/2359563435 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c02f9d0 con 0x7f7c34109120 2024-09-12T02:14:43.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.488+0000 7f7c39400640 1 -- 172.21.15.110:0/2359563435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c341a7160 con 0x7f7c34109120 2024-09-12T02:14:43.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.489+0000 7f7c39400640 1 -- 172.21.15.110:0/2359563435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c341043d0 con 0x7f7c34109120 2024-09-12T02:14:43.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.491+0000 7f7c2b400640 1 -- 172.21.15.110:0/2359563435 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7c2c02fbf0 con 0x7f7c34109120 2024-09-12T02:14:43.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.492+0000 7f7c2b400640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f7c180a2c90 0x7f7c180a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:43.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.492+0000 7f7c2b400640 1 -- 172.21.15.110:0/2359563435 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f7c2c0f0760 con 0x7f7c34109120 2024-09-12T02:14:43.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.493+0000 7f7c32800640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f7c180a2c90 0x7f7c180a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:43.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.493+0000 7f7c32800640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f7c180a2c90 0x7f7c180a5150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7c240095f0 tx=0x7f7c24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:43.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.496+0000 7f7c2b400640 1 -- 172.21.15.110:0/2359563435 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c2c0bd270 con 0x7f7c34109120 2024-09-12T02:14:43.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.715+0000 7f7c39400640 1 -- 172.21.15.110:0/2359563435 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c341a73c0 con 0x7f7c34109120 2024-09-12T02:14:43.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.715+0000 7f7c2b400640 1 -- 172.21.15.110:0/2359563435 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11932 (secure 0 0 0) 0x7f7c2c0bcb70 con 0x7f7c34109120 2024-09-12T02:14:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:43.716 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"btime":"2024-09-12T02:13:05:600095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:12:13.698489+0000","modified":"2024-09-12T02:13:04.635785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.110:6841/4021694968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":4021694968},{"type":"v1","addr":"172.21.15.110:6841","nonce":4021694968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6839/1796624254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1796624254},{"type":"v1","addr":"172.21.15.115:6839","nonce":1796624254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24538,24517]},"id":1}]} 2024-09-12T02:14:43.717 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-09-12T02:14:43.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.718+0000 7f7c39400640 1 -- 172.21.15.110:0/2359563435 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f7c180a2c90 msgr2=0x7f7c180a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:43.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.718+0000 7f7c39400640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f7c180a2c90 0x7f7c180a5150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7c240095f0 tx=0x7f7c24005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.718+0000 7f7c39400640 1 -- 172.21.15.110:0/2359563435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c34109120 msgr2=0x7f7c3419eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.718+0000 7f7c39400640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c34109120 0x7f7c3419eeb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c005e30 tx=0x7f7c2c003d00 comp rx=0 tx=0).stop 2024-09-12T02:14:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.718+0000 7f7c39400640 1 -- 172.21.15.110:0/2359563435 shutdown_connections 2024-09-12T02:14:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.718+0000 7f7c39400640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f7c180a2c90 0x7f7c180a5150 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.718+0000 7f7c39400640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c34109120 0x7f7c3419eeb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.718+0000 7f7c39400640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c341049a0 0x7f7c3419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.718+0000 7f7c39400640 1 --2- 172.21.15.110:0/2359563435 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7c34103ff0 0x7f7c3419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.718+0000 7f7c39400640 1 -- 172.21.15.110:0/2359563435 >> 172.21.15.110:0/2359563435 conn(0x7f7c340ffa90 msgr2=0x7f7c341005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.718+0000 7f7c39400640 1 -- 172.21.15.110:0/2359563435 shutdown_connections 2024-09-12T02:14:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:43.718+0000 7f7c39400640 1 -- 172.21.15.110:0/2359563435 wait complete. 2024-09-12T02:14:44.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:43 smithi115 ceph-mon[35351]: pgmap v386: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:44.137 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:43 smithi110 ceph-mon[30548]: pgmap v386: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:44.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:43 smithi136 ceph-mon[35814]: pgmap v386: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-12T02:14:44.605 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:14:44.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:44 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2359563435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:44.978 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:45.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:44 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2359563435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:45.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:44 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2359563435' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:45.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.555+0000 7f40e3400640 1 -- 172.21.15.110:0/940277075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40dc106f10 msgr2=0x7f40dc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:45.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.555+0000 7f40e3400640 1 --2- 172.21.15.110:0/940277075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40dc106f10 0x7f40dc10ea90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009ca0 tx=0x7f40d402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:14:45.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.555+0000 7f40e3400640 1 -- 172.21.15.110:0/940277075 shutdown_connections 2024-09-12T02:14:45.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.555+0000 7f40e3400640 1 --2- 172.21.15.110:0/940277075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40dc106f10 0x7f40dc10ea90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:45.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.555+0000 7f40e3400640 1 --2- 172.21.15.110:0/940277075 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40dc102790 0x7f40dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:45.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.555+0000 7f40e3400640 1 --2- 172.21.15.110:0/940277075 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40dc101de0 0x7f40dc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:45.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.555+0000 7f40e3400640 1 -- 172.21.15.110:0/940277075 >> 172.21.15.110:0/940277075 conn(0x7f40dc0fd8c0 msgr2=0x7f40dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:45.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.555+0000 7f40e3400640 1 -- 172.21.15.110:0/940277075 shutdown_connections 2024-09-12T02:14:45.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.555+0000 7f40e3400640 1 -- 172.21.15.110:0/940277075 wait complete. 2024-09-12T02:14:45.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.556+0000 7f40e3400640 1 Processor -- start 2024-09-12T02:14:45.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.556+0000 7f40e3400640 1 -- start start 2024-09-12T02:14:45.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.557+0000 7f40e3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40dc101de0 0x7f40dc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:45.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.557+0000 7f40e3400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40dc102790 0x7f40dc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:45.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.557+0000 7f40e3400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40dc106f10 0x7f40dc19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:45.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.557+0000 7f40e3400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc111fc0 con 0x7f40dc101de0 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.557+0000 7f40e3400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc111e40 con 0x7f40dc102790 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.557+0000 7f40e3400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f40dc112140 con 0x7f40dc106f10 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.557+0000 7f40e0a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40dc101de0 0x7f40dc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.557+0000 7f40e0a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40dc101de0 0x7f40dc19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:39858/0 (socket says 172.21.15.110:39858) 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.557+0000 7f40e0a00640 1 -- 172.21.15.110:0/923314493 learned_addr learned my addr 172.21.15.110:0/923314493 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.557+0000 7f40dbe00640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40dc102790 0x7f40dc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.557+0000 7f40e1400640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40dc106f10 0x7f40dc19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.558+0000 7f40dbe00640 1 -- 172.21.15.110:0/923314493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40dc106f10 msgr2=0x7f40dc19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.558+0000 7f40dbe00640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40dc106f10 0x7f40dc19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.558+0000 7f40dbe00640 1 -- 172.21.15.110:0/923314493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40dc101de0 msgr2=0x7f40dc19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.558+0000 7f40dbe00640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40dc101de0 0x7f40dc19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.558+0000 7f40dbe00640 1 -- 172.21.15.110:0/923314493 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40dc19f590 con 0x7f40dc102790 2024-09-12T02:14:45.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.558+0000 7f40dbe00640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40dc102790 0x7f40dc19ab20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40c800e9f0 tx=0x7f40c800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:45.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.558+0000 7f40d9600640 1 -- 172.21.15.110:0/923314493 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c800ccc0 con 0x7f40dc102790 2024-09-12T02:14:45.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.558+0000 7f40e3400640 1 -- 172.21.15.110:0/923314493 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40dc19f880 con 0x7f40dc102790 2024-09-12T02:14:45.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.558+0000 7f40d9600640 1 -- 172.21.15.110:0/923314493 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40c8010910 con 0x7f40dc102790 2024-09-12T02:14:45.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.558+0000 7f40d9600640 1 -- 172.21.15.110:0/923314493 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8018960 con 0x7f40dc102790 2024-09-12T02:14:45.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.558+0000 7f40e3400640 1 -- 172.21.15.110:0/923314493 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40dc1a7160 con 0x7f40dc102790 2024-09-12T02:14:45.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.559+0000 7f40e3400640 1 -- 172.21.15.110:0/923314493 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40dc1021c0 con 0x7f40dc102790 2024-09-12T02:14:45.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.561+0000 7f40d9600640 1 -- 172.21.15.110:0/923314493 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f40c8010ac0 con 0x7f40dc102790 2024-09-12T02:14:45.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.563+0000 7f40d9600640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f40c40a2c10 0x7f40c40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:45.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.563+0000 7f40d9600640 1 -- 172.21.15.110:0/923314493 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f40c80cfd80 con 0x7f40dc102790 2024-09-12T02:14:45.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.563+0000 7f40e0a00640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f40c40a2c10 0x7f40c40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:45.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.563+0000 7f40e0a00640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f40c40a2c10 0x7f40c40a50d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009c90 tx=0x7f40d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:45.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.565+0000 7f40d9600640 1 -- 172.21.15.110:0/923314493 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f40c809c130 con 0x7f40dc102790 2024-09-12T02:14:45.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.726+0000 7f40d9600640 1 -- 172.21.15.110:0/923314493 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f40c80987a0 con 0x7f40dc102790 2024-09-12T02:14:45.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.797+0000 7f40e3400640 1 -- 172.21.15.110:0/923314493 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40dc19b940 con 0x7f40dc102790 2024-09-12T02:14:45.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.799+0000 7f40d9600640 1 -- 172.21.15.110:0/923314493 <== mon.2 v2:172.21.15.115:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11932 (secure 0 0 0) 0x7f40dc19b940 con 0x7f40dc102790 2024-09-12T02:14:45.799 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:45.799 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"btime":"2024-09-12T02:13:05:600095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:12:13.698489+0000","modified":"2024-09-12T02:13:04.635785+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.110:6841/4021694968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":4021694968},{"type":"v1","addr":"172.21.15.110:6841","nonce":4021694968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6839/1796624254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1796624254},{"type":"v1","addr":"172.21.15.115:6839","nonce":1796624254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24539,24538,24517]},"id":1}]} 2024-09-12T02:14:45.800 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-09-12T02:14:45.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.801+0000 7f40e3400640 1 -- 172.21.15.110:0/923314493 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f40c40a2c10 msgr2=0x7f40c40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:45.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.801+0000 7f40e3400640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f40c40a2c10 0x7f40c40a50d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009c90 tx=0x7f40d0005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:45.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.801+0000 7f40e3400640 1 -- 172.21.15.110:0/923314493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40dc102790 msgr2=0x7f40dc19ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:45.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.801+0000 7f40e3400640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40dc102790 0x7f40dc19ab20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40c800e9f0 tx=0x7f40c800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:14:45.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.801+0000 7f40e3400640 1 -- 172.21.15.110:0/923314493 shutdown_connections 2024-09-12T02:14:45.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.801+0000 7f40e3400640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f40c40a2c10 0x7f40c40a50d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:45.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.801+0000 7f40e3400640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40dc106f10 0x7f40dc19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:45.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.801+0000 7f40e3400640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f40dc102790 0x7f40dc19ab20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:45.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.801+0000 7f40e3400640 1 --2- 172.21.15.110:0/923314493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40dc101de0 0x7f40dc19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:45.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.801+0000 7f40e3400640 1 -- 172.21.15.110:0/923314493 >> 172.21.15.110:0/923314493 conn(0x7f40dc0fd8c0 msgr2=0x7f40dc0fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:45.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.801+0000 7f40e3400640 1 -- 172.21.15.110:0/923314493 shutdown_connections 2024-09-12T02:14:45.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:45.801+0000 7f40e3400640 1 -- 172.21.15.110:0/923314493 wait complete. 2024-09-12T02:14:46.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:45 smithi115 ceph-mon[35351]: pgmap v387: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:46.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:45 smithi136 ceph-mon[35814]: pgmap v387: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:46.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:45 smithi110 ceph-mon[30548]: pgmap v387: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-12T02:14:46.714 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:14:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:46 smithi110 ceph-mon[30548]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-12T02:14:46.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:46 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/923314493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:47.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:46 smithi115 ceph-mon[35351]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-12T02:14:47.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:46 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/923314493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:47.083 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:47.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:46 smithi136 ceph-mon[35814]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-12T02:14:47.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:46 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/923314493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:14:47.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.728+0000 7f1dd9400640 1 -- 172.21.15.110:0/1746870640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dd4106f10 msgr2=0x7f1dd410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:47.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.728+0000 7f1dd9400640 1 --2- 172.21.15.110:0/1746870640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dd4106f10 0x7f1dd410ea90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009ca0 tx=0x7f1dcc02a8b0 comp rx=0 tx=0).stop 2024-09-12T02:14:47.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.728+0000 7f1dd9400640 1 -- 172.21.15.110:0/1746870640 shutdown_connections 2024-09-12T02:14:47.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.728+0000 7f1dd9400640 1 --2- 172.21.15.110:0/1746870640 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dd4106f10 0x7f1dd410ea90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:47.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.728+0000 7f1dd9400640 1 --2- 172.21.15.110:0/1746870640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd4102790 0x7f1dd41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:47.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.728+0000 7f1dd9400640 1 --2- 172.21.15.110:0/1746870640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dd4101de0 0x7f1dd41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:47.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.728+0000 7f1dd9400640 1 -- 172.21.15.110:0/1746870640 >> 172.21.15.110:0/1746870640 conn(0x7f1dd40fd8c0 msgr2=0x7f1dd40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:47.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.728+0000 7f1dd9400640 1 -- 172.21.15.110:0/1746870640 shutdown_connections 2024-09-12T02:14:47.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.728+0000 7f1dd9400640 1 -- 172.21.15.110:0/1746870640 wait complete. 2024-09-12T02:14:47.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.729+0000 7f1dd9400640 1 Processor -- start 2024-09-12T02:14:47.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.729+0000 7f1dd9400640 1 -- start start 2024-09-12T02:14:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd9400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dd4101de0 0x7f1dd419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd9400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dd4102790 0x7f1dd419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd4106f10 0x7f1dd419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd9400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd4111f70 con 0x7f1dd4106f10 2024-09-12T02:14:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd9400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd4111df0 con 0x7f1dd4101de0 2024-09-12T02:14:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd9400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd41120f0 con 0x7f1dd4102790 2024-09-12T02:14:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd2800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dd4101de0 0x7f1dd419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd2800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dd4101de0 0x7f1dd419a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:49024/0 (socket says 172.21.15.110:49024) 2024-09-12T02:14:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd2800640 1 -- 172.21.15.110:0/556269683 learned_addr learned my addr 172.21.15.110:0/556269683 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd3200640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd4106f10 0x7f1dd419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:47.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd1e00640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dd4102790 0x7f1dd419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:47.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd2800640 1 -- 172.21.15.110:0/556269683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dd4102790 msgr2=0x7f1dd419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:47.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd2800640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dd4102790 0x7f1dd419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:47.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd2800640 1 -- 172.21.15.110:0/556269683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd4106f10 msgr2=0x7f1dd419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:47.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd2800640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd4106f10 0x7f1dd419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:47.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.730+0000 7f1dd2800640 1 -- 172.21.15.110:0/556269683 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd419f5e0 con 0x7f1dd4101de0 2024-09-12T02:14:47.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.731+0000 7f1dd2800640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dd4101de0 0x7f1dd419a630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400e9f0 tx=0x7f1dc400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:47.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.731+0000 7f1dcb400640 1 -- 172.21.15.110:0/556269683 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400cd80 con 0x7f1dd4101de0 2024-09-12T02:14:47.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.731+0000 7f1dcb400640 1 -- 172.21.15.110:0/556269683 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc4005500 con 0x7f1dd4101de0 2024-09-12T02:14:47.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.731+0000 7f1dd9400640 1 -- 172.21.15.110:0/556269683 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd419f8d0 con 0x7f1dd4101de0 2024-09-12T02:14:47.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.731+0000 7f1dcb400640 1 -- 172.21.15.110:0/556269683 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4010690 con 0x7f1dd4101de0 2024-09-12T02:14:47.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.731+0000 7f1dd9400640 1 -- 172.21.15.110:0/556269683 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd41a71b0 con 0x7f1dd4101de0 2024-09-12T02:14:47.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.732+0000 7f1dd9400640 1 -- 172.21.15.110:0/556269683 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dd41021c0 con 0x7f1dd4101de0 2024-09-12T02:14:47.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.734+0000 7f1dcb400640 1 -- 172.21.15.110:0/556269683 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f1dc40046c0 con 0x7f1dd4101de0 2024-09-12T02:14:47.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.735+0000 7f1dcb400640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1db80a2c40 0x7f1db80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:47.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.735+0000 7f1dcb400640 1 -- 172.21.15.110:0/556269683 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f1dc40cf760 con 0x7f1dd4101de0 2024-09-12T02:14:47.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.735+0000 7f1dd1e00640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1db80a2c40 0x7f1db80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:47.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.736+0000 7f1dd1e00640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1db80a2c40 0x7f1db80a5100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40fddc0 tx=0x7f1dc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:47.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.740+0000 7f1dcb400640 1 -- 172.21.15.110:0/556269683 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1dc409c2c0 con 0x7f1dd4101de0 2024-09-12T02:14:47.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.916+0000 7f1dd9400640 1 -- 172.21.15.110:0/556269683 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1dd41a7380 con 0x7f1dd4101de0 2024-09-12T02:14:47.917 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:47 smithi110 ceph-mon[30548]: pgmap v388: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:47.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.917+0000 7f1dcb400640 1 -- 172.21.15.110:0/556269683 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+24936 (secure 0 0 0) 0x7f1dc409bbc0 con 0x7f1dd4101de0 2024-09-12T02:14:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:14:47.919 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":97,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:13:46.686934+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:12:08.596125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:12:11.312393+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:12:21.215161+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:14:47.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.920+0000 7f1dd9400640 1 -- 172.21.15.110:0/556269683 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1db80a2c40 msgr2=0x7f1db80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:47.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.920+0000 7f1dd9400640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1db80a2c40 0x7f1db80a5100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40fddc0 tx=0x7f1dc0005f90 comp rx=0 tx=0).stop 2024-09-12T02:14:47.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.920+0000 7f1dd9400640 1 -- 172.21.15.110:0/556269683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dd4101de0 msgr2=0x7f1dd419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:47.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.920+0000 7f1dd9400640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dd4101de0 0x7f1dd419a630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400e9f0 tx=0x7f1dc400edf0 comp rx=0 tx=0).stop 2024-09-12T02:14:47.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.920+0000 7f1dd9400640 1 -- 172.21.15.110:0/556269683 shutdown_connections 2024-09-12T02:14:47.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.920+0000 7f1dd9400640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f1db80a2c40 0x7f1db80a5100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:47.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.920+0000 7f1dd9400640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dd4106f10 0x7f1dd419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:47.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.920+0000 7f1dd9400640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dd4102790 0x7f1dd419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:47.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.920+0000 7f1dd9400640 1 --2- 172.21.15.110:0/556269683 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1dd4101de0 0x7f1dd419a630 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:47.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.920+0000 7f1dd9400640 1 -- 172.21.15.110:0/556269683 >> 172.21.15.110:0/556269683 conn(0x7f1dd40fd8c0 msgr2=0x7f1dd40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:47.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.920+0000 7f1dd9400640 1 -- 172.21.15.110:0/556269683 shutdown_connections 2024-09-12T02:14:47.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:47.920+0000 7f1dd9400640 1 -- 172.21.15.110:0/556269683 wait complete. 2024-09-12T02:14:48.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:47 smithi115 ceph-mon[35351]: pgmap v388: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:48.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:47 smithi136 ceph-mon[35814]: pgmap v388: 129 pgs: 129 active+clean; 643 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-12T02:14:48.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-12T02:12:13.698489+0000', 'modified': '2024-09-12T02:13:04.635785+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24539, 'mds_1': 24538, 'mds_2': 24517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24493': {'gid': 24493, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6835/2205978549', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 2205978549}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 2205978549}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.115:6837/1922841773', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 1922841773}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 1922841773}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24505': {'gid': 24505, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6837/3503120492', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 3503120492}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 3503120492}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.136:6839/3572987086', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 3572987086}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 3572987086}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.110:6841/4021694968', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6840', 'nonce': 4021694968}, {'type': 'v1', 'addr': '172.21.15.110:6841', 'nonce': 4021694968}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24539': {'gid': 24539, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.115:6839/1796624254', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6838', 'nonce': 1796624254}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 1796624254}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24539, 'qdb_cluster': [24539, 24538, 24517]} 2024-09-12T02:14:48.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-12T02:14:48.821 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-12T02:14:49.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:48 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/556269683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:14:49.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:48 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/556269683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:14:49.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:48 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/556269683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:14:49.189 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:49.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.796+0000 7fdd56600640 1 -- 172.21.15.110:0/2702810371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd50104010 msgr2=0x7fdd501043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:49.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.796+0000 7fdd56600640 1 --2- 172.21.15.110:0/2702810371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd50104010 0x7fdd501043f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009900 tx=0x7fdd4002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.796+0000 7fdd56600640 1 -- 172.21.15.110:0/2702810371 shutdown_connections 2024-09-12T02:14:49.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.796+0000 7fdd56600640 1 --2- 172.21.15.110:0/2702810371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd50109140 0x7fdd50110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.796+0000 7fdd56600640 1 --2- 172.21.15.110:0/2702810371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd501049c0 0x7fdd50108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.796+0000 7fdd56600640 1 --2- 172.21.15.110:0/2702810371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd50104010 0x7fdd501043f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.796+0000 7fdd56600640 1 -- 172.21.15.110:0/2702810371 >> 172.21.15.110:0/2702810371 conn(0x7fdd500ffa50 msgr2=0x7fdd50101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:49.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.796+0000 7fdd56600640 1 -- 172.21.15.110:0/2702810371 shutdown_connections 2024-09-12T02:14:49.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.796+0000 7fdd56600640 1 -- 172.21.15.110:0/2702810371 wait complete. 2024-09-12T02:14:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.797+0000 7fdd56600640 1 Processor -- start 2024-09-12T02:14:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.797+0000 7fdd56600640 1 -- start start 2024-09-12T02:14:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.797+0000 7fdd56600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd50104010 0x7fdd5019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.797+0000 7fdd56600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd501049c0 0x7fdd5019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.797+0000 7fdd56600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd50109140 0x7fdd5019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.797+0000 7fdd56600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdd50114160 con 0x7fdd50109140 2024-09-12T02:14:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.797+0000 7fdd56600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdd50113fe0 con 0x7fdd50104010 2024-09-12T02:14:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.797+0000 7fdd56600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdd501142e0 con 0x7fdd501049c0 2024-09-12T02:14:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.797+0000 7fdd4f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd50104010 0x7fdd5019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.797+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd50109140 0x7fdd5019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.797+0000 7fdd4f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd50104010 0x7fdd5019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:59130/0 (socket says 172.21.15.110:59130) 2024-09-12T02:14:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.797+0000 7fdd4f400640 1 -- 172.21.15.110:0/3555114235 learned_addr learned my addr 172.21.15.110:0/3555114235 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.798+0000 7fdd47e00640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd501049c0 0x7fdd5019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.798+0000 7fdd4f400640 1 -- 172.21.15.110:0/3555114235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd501049c0 msgr2=0x7fdd5019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.798+0000 7fdd4f400640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd501049c0 0x7fdd5019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.798+0000 7fdd4f400640 1 -- 172.21.15.110:0/3555114235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd50109140 msgr2=0x7fdd5019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.798+0000 7fdd4f400640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd50109140 0x7fdd5019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.798+0000 7fdd4f400640 1 -- 172.21.15.110:0/3555114235 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5019f610 con 0x7fdd50104010 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.798+0000 7fdd4f400640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd50104010 0x7fdd5019a660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd40006010 tx=0x7fdd400042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.798+0000 7fdd4cc00640 1 -- 172.21.15.110:0/3555114235 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4003f030 con 0x7fdd50104010 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.798+0000 7fdd56600640 1 -- 172.21.15.110:0/3555114235 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5019f8a0 con 0x7fdd50104010 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.799+0000 7fdd4cc00640 1 -- 172.21.15.110:0/3555114235 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd40003ce0 con 0x7fdd50104010 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.799+0000 7fdd4cc00640 1 -- 172.21.15.110:0/3555114235 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40035070 con 0x7fdd50104010 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.799+0000 7fdd56600640 1 -- 172.21.15.110:0/3555114235 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd501a71e0 con 0x7fdd50104010 2024-09-12T02:14:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.801+0000 7fdd590cf740 1 Processor -- start 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd4cc00640 1 -- 172.21.15.110:0/3555114235 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fdd40042030 con 0x7fdd50104010 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd590cf740 1 -- start start 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd590cf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64330 0x564cc1d64710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd590cf740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d6efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd590cf740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d71900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd590cf740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564cc1cca0b0 con 0x564cc1d6f510 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd590cf740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564cc1c71ab0 con 0x564cc1d64c50 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd590cf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564cc1cc6070 con 0x564cc1d64330 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd4f400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d6efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd47e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d71900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64330 0x564cc1d64710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd47e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d71900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49484/0 (socket says 172.21.15.110:49484) 2024-09-12T02:14:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.802+0000 7fdd47e00640 1 -- 172.21.15.110:0/4107249649 learned_addr learned my addr 172.21.15.110:0/4107249649 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.803+0000 7fdd4fe00640 1 -- 172.21.15.110:0/4107249649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 msgr2=0x564cc1d6efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.803+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/4107249649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d6efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.803+0000 7fdd4fe00640 1 -- 172.21.15.110:0/4107249649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 msgr2=0x564cc1d71900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.803+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/4107249649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d71900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.803+0000 7fdd4fe00640 1 -- 172.21.15.110:0/4107249649 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cc1c7e4a0 con 0x564cc1d64330 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.803+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/4107249649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64330 0x564cc1d64710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009eb0 tx=0x7fdd48010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29f1b2444e1701fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.803+0000 7fdd4cc00640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdd340a2c00 0x7fdd340a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.803+0000 7fdd44c00640 1 -- 172.21.15.110:0/4107249649 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48016070 con 0x564cc1d64330 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.803+0000 7fdd44c00640 1 -- 172.21.15.110:0/4107249649 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd48004d20 con 0x564cc1d64330 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.803+0000 7fdd44c00640 1 -- 172.21.15.110:0/4107249649 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480127b0 con 0x564cc1d64330 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.803+0000 7fdd4cc00640 1 -- 172.21.15.110:0/3555114235 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fdd400ef8f0 con 0x7fdd50104010 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.804+0000 7fdd4f400640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdd340a2c00 0x7fdd340a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.804+0000 7fdd4f400640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdd340a2c00 0x7fdd340a50c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdd400efb90 tx=0x7fdd400f5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.804+0000 7fdd590cf740 1 -- 172.21.15.110:0/4107249649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64330 msgr2=0x564cc1d64710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.804+0000 7fdd590cf740 1 --2- 172.21.15.110:0/4107249649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64330 0x564cc1d64710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009eb0 tx=0x7fdd48010740 comp rx=0 tx=0).stop 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.804+0000 7fdd590cf740 1 -- 172.21.15.110:0/4107249649 shutdown_connections 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.804+0000 7fdd590cf740 1 --2- 172.21.15.110:0/4107249649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d71900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.804+0000 7fdd590cf740 1 --2- 172.21.15.110:0/4107249649 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d6efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.804+0000 7fdd590cf740 1 --2- 172.21.15.110:0/4107249649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64330 0x564cc1d64710 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.804+0000 7fdd590cf740 1 -- 172.21.15.110:0/4107249649 >> 172.21.15.110:0/4107249649 conn(0x564cc1d608c0 msgr2=0x564cc1d60ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.804+0000 7fdd590cf740 1 -- 172.21.15.110:0/4107249649 shutdown_connections 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.804+0000 7fdd590cf740 1 -- 172.21.15.110:0/4107249649 wait complete. 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.805+0000 7fdd590cf740 1 -- start start 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.805+0000 7fdd590cf740 1 Processor -- start 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.805+0000 7fdd590cf740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d64330 0x564cc1d6c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.805+0000 7fdd590cf740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d6caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.805+0000 7fdd590cf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d6f510 0x564cc1d6d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.805+0000 7fdd590cf740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564cc1d72060 con 0x564cc1d64330 2024-09-12T02:14:49.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.805+0000 7fdd590cf740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564cc1c52920 con 0x564cc1d64c50 2024-09-12T02:14:49.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.805+0000 7fdd590cf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564cc1d721e0 con 0x564cc1d6f510 2024-09-12T02:14:49.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.805+0000 7fdd590cf740 10 client.0 _ll_register_callbacks cb 0x564cc1c768a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:14:49.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d64330 0x564cc1d6c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d64330 0x564cc1d6c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49486/0 (socket says 172.21.15.110:49486) 2024-09-12T02:14:49.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd4fe00640 1 -- 172.21.15.110:0/2889784666 learned_addr learned my addr 172.21.15.110:0/2889784666 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:49.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd47e00640 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d6caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d6f510 0x564cc1d6d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd47e00640 1 -- 172.21.15.110:0/2889784666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d6f510 msgr2=0x564cc1d6d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:49.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd47e00640 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d6f510 0x564cc1d6d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd47e00640 1 -- 172.21.15.110:0/2889784666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d64330 msgr2=0x564cc1d6c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd47e00640 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d64330 0x564cc1d6c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd47e00640 1 -- 172.21.15.110:0/2889784666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cc1a3b2b0 con 0x564cc1d64c50 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d64330 0x564cc1d6c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd47e00640 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d6caf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd380126d0 tx=0x7fdd38012b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=628165c4b07d28f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.806+0000 7fdd3d600640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.807+0000 7fdd3d600640 1 -- 172.21.15.110:0/2889784666 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38004050 con 0x564cc1d64c50 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.807+0000 7fdd3d600640 1 -- 172.21.15.110:0/2889784666 <== mon.2 v2:172.21.15.115:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fdd380041f0 con 0x564cc1d64c50 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.807+0000 7fdd590cf740 1 -- 172.21.15.110:0/2889784666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd48004d20 con 0x564cc1d64c50 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.807+0000 7fdd3d600640 1 -- 172.21.15.110:0/2889784666 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdd38025050 con 0x564cc1d64c50 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.807+0000 7fdd590cf740 10 client.25094 fetch_fsmap learned FSMap version 25 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.807+0000 7fdd590cf740 1 -- 172.21.15.110:0/2889784666 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564cc1d7ded0 con 0x564cc1d64c50 2024-09-12T02:14:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.807+0000 7fdd3d600640 1 -- 172.21.15.110:0/2889784666 <== mon.2 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd48004d20 con 0x564cc1d64c50 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.808+0000 7fdd3d600640 1 -- 172.21.15.110:0/2889784666 <== mon.2 v2:172.21.15.115:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fdd38003a40 con 0x564cc1d64c50 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.808+0000 7fdd590cf740 10 client.25094 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.808+0000 7fdd590cf740 10 client.25094 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.808+0000 7fdd590cf740 20 client.25094 populate_metadata read hostname 'smithi110' 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.808+0000 7fdd590cf740 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x564cc1d80500 0x564cc1d81970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.808+0000 7fdd590cf740 4 client.25094 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.808+0000 7fdd590cf740 1 -- 172.21.15.110:0/2889784666 --> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cc1cd7620 con 0x564cc1d80500 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.808+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x564cc1d80500 0x564cc1d81970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.809+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x564cc1d80500 0x564cc1d81970 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=996f25e7ba8915fe server_cookie=947403a3c7685d3a in_seq=0 out_seq=0 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.809+0000 7fdd3d600640 10 client.25094 ms_handle_connect on v2:172.21.15.136:6838/3572987086 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.809+0000 7fdd3d600640 1 -- 172.21.15.110:0/2889784666 <== mds.2 v2:172.21.15.136:6838/3572987086 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564cc1cd7620 con 0x564cc1d80500 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.809+0000 7fdd3d600640 10 client.25094 handle_command_reply: tid=0 2024-09-12T02:14:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd590cf740 1 client.25094 shutdown 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd590cf740 1 -- 172.21.15.110:0/2889784666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 msgr2=0x564cc1d6caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd590cf740 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d6caf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd380126d0 tx=0x7fdd38012b90 comp rx=0 tx=0).stop 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd590cf740 1 -- 172.21.15.110:0/2889784666 shutdown_connections 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd590cf740 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x564cc1d80500 0x564cc1d81970 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd590cf740 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d6f510 0x564cc1d6d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd590cf740 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d6caf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd590cf740 1 --2- 172.21.15.110:0/2889784666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d64330 0x564cc1d6c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd3d600640 0 client.25094 ms_handle_reset on v2:172.21.15.136:6838/3572987086 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd590cf740 1 -- 172.21.15.110:0/2889784666 >> 172.21.15.110:0/2889784666 conn(0x564cc1d608c0 msgr2=0x564cc1d665a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd590cf740 1 -- 172.21.15.110:0/2889784666 shutdown_connections 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd590cf740 1 -- 172.21.15.110:0/2889784666 wait complete. 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.810+0000 7fdd590cf740 20 client.25094 trim_cache size 0 max 16384 2024-09-12T02:14:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.828+0000 7fdd590cf740 1 Processor -- start 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd590cf740 1 -- start start 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd590cf740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64330 0x564cc1d69830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd590cf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64c50 0x564cc1d69d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd590cf740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d6ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd590cf740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564cc1d7fcb0 con 0x564cc1d6f510 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd590cf740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564cc1d80380 con 0x564cc1d64330 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd590cf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564cc1d80a50 con 0x564cc1d64c50 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64330 0x564cc1d69830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64330 0x564cc1d69830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:59148/0 (socket says 172.21.15.110:59148) 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd4fe00640 1 -- 172.21.15.110:0/677612565 learned_addr learned my addr 172.21.15.110:0/677612565 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/677612565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d6ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd47e00640 1 --2- 172.21.15.110:0/677612565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64c50 0x564cc1d69d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd4fe00640 1 -- 172.21.15.110:0/677612565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64c50 msgr2=0x564cc1d69d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/677612565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64c50 0x564cc1d69d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd4fe00640 1 -- 172.21.15.110:0/677612565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 msgr2=0x564cc1d6ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/677612565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d6ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.829+0000 7fdd4fe00640 1 -- 172.21.15.110:0/677612565 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cc1d64120 con 0x564cc1d64330 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.830+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/677612565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64330 0x564cc1d69830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdd48011010 tx=0x7fdd48005860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53d1d8441c54ac3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.830+0000 7fdd3fe00640 1 -- 172.21.15.110:0/677612565 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48016070 con 0x564cc1d64330 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.830+0000 7fdd3fe00640 1 -- 172.21.15.110:0/677612565 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd48025040 con 0x564cc1d64330 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.830+0000 7fdd3fe00640 1 -- 172.21.15.110:0/677612565 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48005540 con 0x564cc1d64330 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.831+0000 7fdd590cf740 1 -- 172.21.15.110:0/677612565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64330 msgr2=0x564cc1d69830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.831+0000 7fdd590cf740 1 --2- 172.21.15.110:0/677612565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64330 0x564cc1d69830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdd48011010 tx=0x7fdd48005860 comp rx=0 tx=0).stop 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.831+0000 7fdd590cf740 1 -- 172.21.15.110:0/677612565 shutdown_connections 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.831+0000 7fdd590cf740 1 --2- 172.21.15.110:0/677612565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d6ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.831+0000 7fdd590cf740 1 --2- 172.21.15.110:0/677612565 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64c50 0x564cc1d69d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.831+0000 7fdd590cf740 1 --2- 172.21.15.110:0/677612565 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64330 0x564cc1d69830 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.831+0000 7fdd590cf740 1 -- 172.21.15.110:0/677612565 >> 172.21.15.110:0/677612565 conn(0x564cc1d608c0 msgr2=0x564cc1d60ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.831+0000 7fdd590cf740 1 -- 172.21.15.110:0/677612565 shutdown_connections 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.831+0000 7fdd590cf740 1 -- 172.21.15.110:0/677612565 wait complete. 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.831+0000 7fdd590cf740 1 -- start start 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.831+0000 7fdd590cf740 1 Processor -- start 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.832+0000 7fdd590cf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64330 0x564cc1d69640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.832+0000 7fdd590cf740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d69b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.832+0000 7fdd590cf740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d6a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.832+0000 7fdd590cf740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x564cc1d817f0 con 0x564cc1d6f510 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.832+0000 7fdd590cf740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564cc1d81120 con 0x564cc1d64c50 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.832+0000 7fdd590cf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x564cc1d81ec0 con 0x564cc1d64330 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.832+0000 7fdd590cf740 10 client.0 _ll_register_callbacks cb 0x7fdd38009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:14:49.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.832+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d6a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.832+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d6a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49498/0 (socket says 172.21.15.110:49498) 2024-09-12T02:14:49.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.832+0000 7fdd4fe00640 1 -- 172.21.15.110:0/3698399098 learned_addr learned my addr 172.21.15.110:0/3698399098 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:49.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.832+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64330 0x564cc1d69640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.832+0000 7fdd47e00640 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d69b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.833+0000 7fdd4fe00640 1 -- 172.21.15.110:0/3698399098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64330 msgr2=0x564cc1d69640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:49.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.833+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64330 0x564cc1d69640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.833+0000 7fdd4fe00640 1 -- 172.21.15.110:0/3698399098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 msgr2=0x564cc1d69b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:49.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.833+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d69b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.833+0000 7fdd4fe00640 1 -- 172.21.15.110:0/3698399098 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cc1d88190 con 0x564cc1d6f510 2024-09-12T02:14:49.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.833+0000 7fdd47e00640 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d69b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:49.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.833+0000 7fdd4fe00640 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d6a0c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdd48005090 tx=0x7fdd48009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92b1a5394f121c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:49.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.833+0000 7fdd3d600640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.833+0000 7fdd3d600640 1 -- 172.21.15.110:0/3698399098 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48016070 con 0x564cc1d6f510 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.833+0000 7fdd590cf740 1 -- 172.21.15.110:0/3698399098 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd48025040 con 0x564cc1d6f510 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.833+0000 7fdd3d600640 1 -- 172.21.15.110:0/3698399098 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fdd48003b80 con 0x564cc1d6f510 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.833+0000 7fdd3d600640 1 -- 172.21.15.110:0/3698399098 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdd48003d80 con 0x564cc1d6f510 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.834+0000 7fdd590cf740 10 client.15090 fetch_fsmap learned FSMap version 25 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.834+0000 7fdd590cf740 1 -- 172.21.15.110:0/3698399098 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564cc1df3710 con 0x564cc1d6f510 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.834+0000 7fdd3d600640 1 -- 172.21.15.110:0/3698399098 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd48025040 con 0x564cc1d6f510 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.834+0000 7fdd3d600640 1 -- 172.21.15.110:0/3698399098 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fdd4800f040 con 0x564cc1d6f510 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.834+0000 7fdd590cf740 10 client.15090 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.834+0000 7fdd590cf740 10 client.15090 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.834+0000 7fdd590cf740 20 client.15090 populate_metadata read hostname 'smithi110' 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.834+0000 7fdd590cf740 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x564cc1df7af0 0x564cc1df6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.834+0000 7fdd590cf740 4 client.15090 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:14:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.834+0000 7fdd590cf740 1 -- 172.21.15.110:0/3698399098 --> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] -- command(tid 0: {"prefix": "status"}) -- 0x564cc1cd1b30 con 0x564cc1df7af0 2024-09-12T02:14:49.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.834+0000 7fdd47e00640 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x564cc1df7af0 0x564cc1df6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:49.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.835+0000 7fdd3d600640 10 client.15090 ms_handle_connect on v2:172.21.15.136:6838/3572987086 2024-09-12T02:14:49.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.835+0000 7fdd47e00640 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x564cc1df7af0 0x564cc1df6800 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8994f7177f82cbf6 server_cookie=a5b42c0998a04e68 in_seq=0 out_seq=0 2024-09-12T02:14:49.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.835+0000 7fdd3d600640 1 -- 172.21.15.110:0/3698399098 <== mds.2 v2:172.21.15.136:6838/3572987086 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x564cc1cd1b30 con 0x564cc1df7af0 2024-09-12T02:14:49.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.835+0000 7fdd3d600640 10 client.15090 handle_command_reply: tid=0 2024-09-12T02:14:49.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.835+0000 7fdd590cf740 1 client.15090 shutdown 2024-09-12T02:14:49.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.835+0000 7fdd590cf740 1 -- 172.21.15.110:0/3698399098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 msgr2=0x564cc1d6a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:49.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.835+0000 7fdd590cf740 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d6a0c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdd48005090 tx=0x7fdd48009600 comp rx=0 tx=0).stop 2024-09-12T02:14:49.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd590cf740 1 -- 172.21.15.110:0/3698399098 shutdown_connections 2024-09-12T02:14:49.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd590cf740 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.136:6838/3572987086,v1:172.21.15.136:6839/3572987086] conn(0x564cc1df7af0 0x564cc1df6800 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd590cf740 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564cc1d6f510 0x564cc1d6a0c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd590cf740 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564cc1d64c50 0x564cc1d69b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd590cf740 1 --2- 172.21.15.110:0/3698399098 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564cc1d64330 0x564cc1d69640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd590cf740 1 -- 172.21.15.110:0/3698399098 >> 172.21.15.110:0/3698399098 conn(0x564cc1d608c0 msgr2=0x564cc1d6ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:49.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd3d600640 0 client.15090 ms_handle_reset on v2:172.21.15.136:6838/3572987086 2024-09-12T02:14:49.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd590cf740 1 -- 172.21.15.110:0/3698399098 shutdown_connections 2024-09-12T02:14:49.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd590cf740 1 -- 172.21.15.110:0/3698399098 wait complete. 2024-09-12T02:14:49.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd590cf740 20 client.15090 trim_cache size 0 max 16384 2024-09-12T02:14:49.852 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:14:49.852 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "10ead734-70ab-11ef-bcea-c7b262605968", 2024-09-12T02:14:49.852 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 2, 2024-09-12T02:14:49.852 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24517, 2024-09-12T02:14:49.853 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-09-12T02:14:49.853 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-09-12T02:14:49.853 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-09-12T02:14:49.853 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 109.256266256, 2024-09-12T02:14:49.853 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 25, 2024-09-12T02:14:49.853 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 97, 2024-09-12T02:14:49.853 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 95, 2024-09-12T02:14:49.853 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 182.540006812 2024-09-12T02:14:49.853 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:14:49.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd56600640 1 -- 172.21.15.110:0/3555114235 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdd340a2c00 msgr2=0x7fdd340a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:49.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd56600640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdd340a2c00 0x7fdd340a50c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdd400efb90 tx=0x7fdd400f5530 comp rx=0 tx=0).stop 2024-09-12T02:14:49.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd56600640 1 -- 172.21.15.110:0/3555114235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd50104010 msgr2=0x7fdd5019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:49.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.836+0000 7fdd56600640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd50104010 0x7fdd5019a660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdd40006010 tx=0x7fdd400042f0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.837+0000 7fdd56600640 1 -- 172.21.15.110:0/3555114235 shutdown_connections 2024-09-12T02:14:49.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.837+0000 7fdd56600640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fdd340a2c00 0x7fdd340a50c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.837+0000 7fdd56600640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd50109140 0x7fdd5019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.837+0000 7fdd56600640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd501049c0 0x7fdd5019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.837+0000 7fdd56600640 1 --2- 172.21.15.110:0/3555114235 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdd50104010 0x7fdd5019a660 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:49.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.837+0000 7fdd56600640 1 -- 172.21.15.110:0/3555114235 >> 172.21.15.110:0/3555114235 conn(0x7fdd500ffa50 msgr2=0x7fdd50100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:49.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.837+0000 7fdd56600640 1 -- 172.21.15.110:0/3555114235 shutdown_connections 2024-09-12T02:14:49.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:49.837+0000 7fdd56600640 1 -- 172.21.15.110:0/3555114235 wait complete. 2024-09-12T02:14:49.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:49 smithi110 ceph-mon[30548]: pgmap v389: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T02:14:50.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:49 smithi115 ceph-mon[35351]: pgmap v389: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T02:14:50.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:49 smithi136 ceph-mon[35814]: pgmap v389: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-12T02:14:50.790 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell mds.a status 2024-09-12T02:14:51.156 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:51.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.801+0000 7fc9ace00640 1 -- 172.21.15.110:0/644290284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9a8101de0 msgr2=0x7fc9a81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:51.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.801+0000 7fc9ace00640 1 --2- 172.21.15.110:0/644290284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9a8101de0 0x7fc9a81021c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc998009900 tx=0x7fc99802a410 comp rx=0 tx=0).stop 2024-09-12T02:14:51.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.801+0000 7fc9ace00640 1 -- 172.21.15.110:0/644290284 shutdown_connections 2024-09-12T02:14:51.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.801+0000 7fc9ace00640 1 --2- 172.21.15.110:0/644290284 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a8106f10 0x7fc9a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.801+0000 7fc9ace00640 1 --2- 172.21.15.110:0/644290284 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9a8102790 0x7fc9a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.801+0000 7fc9ace00640 1 --2- 172.21.15.110:0/644290284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9a8101de0 0x7fc9a81021c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.801+0000 7fc9ace00640 1 -- 172.21.15.110:0/644290284 >> 172.21.15.110:0/644290284 conn(0x7fc9a80fd8c0 msgr2=0x7fc9a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:51.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.801+0000 7fc9ace00640 1 -- 172.21.15.110:0/644290284 shutdown_connections 2024-09-12T02:14:51.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.801+0000 7fc9ace00640 1 -- 172.21.15.110:0/644290284 wait complete. 2024-09-12T02:14:51.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.802+0000 7fc9ace00640 1 Processor -- start 2024-09-12T02:14:51.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.802+0000 7fc9ace00640 1 -- start start 2024-09-12T02:14:51.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.802+0000 7fc9ace00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9a8101de0 0x7fc9a8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.802+0000 7fc9ace00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a8102790 0x7fc9a81989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.802+0000 7fc9ace00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9a8106f10 0x7fc9a819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.802+0000 7fc9ace00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8111f70 con 0x7fc9a8106f10 2024-09-12T02:14:51.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.802+0000 7fc9ace00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a8111df0 con 0x7fc9a8102790 2024-09-12T02:14:51.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.802+0000 7fc9ace00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a81120f0 con 0x7fc9a8101de0 2024-09-12T02:14:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.802+0000 7fc9a5e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9a8101de0 0x7fc9a8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.803+0000 7fc9a6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9a8106f10 0x7fc9a819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.803+0000 7fc9a5e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9a8101de0 0x7fc9a8198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:38776/0 (socket says 172.21.15.110:38776) 2024-09-12T02:14:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.803+0000 7fc9a5e00640 1 -- 172.21.15.110:0/2304027132 learned_addr learned my addr 172.21.15.110:0/2304027132 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:51.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.803+0000 7fc9a5400640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a8102790 0x7fc9a81989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.803+0000 7fc9a5400640 1 -- 172.21.15.110:0/2304027132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9a8101de0 msgr2=0x7fc9a8198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.803+0000 7fc9a5400640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9a8101de0 0x7fc9a8198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.803+0000 7fc9a5400640 1 -- 172.21.15.110:0/2304027132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9a8106f10 msgr2=0x7fc9a819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.803+0000 7fc9a5400640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9a8106f10 0x7fc9a819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.803+0000 7fc9a5400640 1 -- 172.21.15.110:0/2304027132 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a819d440 con 0x7fc9a8102790 2024-09-12T02:14:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.803+0000 7fc9a6800640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9a8106f10 0x7fc9a819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.803+0000 7fc9a5e00640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9a8101de0 0x7fc9a8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.803+0000 7fc9a5400640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a8102790 0x7fc9a81989d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc99400e9f0 tx=0x7fc99400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.804+0000 7fc99ea00640 1 -- 172.21.15.110:0/2304027132 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99400ccc0 con 0x7fc9a8102790 2024-09-12T02:14:51.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.804+0000 7fc9ace00640 1 -- 172.21.15.110:0/2304027132 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a819d730 con 0x7fc9a8102790 2024-09-12T02:14:51.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.804+0000 7fc9ace00640 1 -- 172.21.15.110:0/2304027132 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a81a5010 con 0x7fc9a8102790 2024-09-12T02:14:51.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.804+0000 7fc99ea00640 1 -- 172.21.15.110:0/2304027132 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc994010910 con 0x7fc9a8102790 2024-09-12T02:14:51.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.804+0000 7fc99ea00640 1 -- 172.21.15.110:0/2304027132 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994018960 con 0x7fc9a8102790 2024-09-12T02:14:51.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.807+0000 7fc9afa15740 1 Processor -- start 2024-09-12T02:14:51.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.807+0000 7fc9afa15740 1 -- start start 2024-09-12T02:14:51.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.807+0000 7fc99ea00640 1 -- 172.21.15.110:0/2304027132 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7fc994010ac0 con 0x7fc9a8102790 2024-09-12T02:14:51.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.807+0000 7fc9afa15740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4330 0x55f2e6af4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.807+0000 7fc9afa15740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4c50 0x55f2e6afefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.807+0000 7fc9afa15740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6aff510 0x55f2e6b01900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.807+0000 7fc9afa15740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f2e6a5a0b0 con 0x55f2e6aff510 2024-09-12T02:14:51.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.807+0000 7fc9afa15740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f2e6a01ab0 con 0x55f2e6af4c50 2024-09-12T02:14:51.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.807+0000 7fc9afa15740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f2e6a56070 con 0x55f2e6af4330 2024-09-12T02:14:51.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.808+0000 7fc9a6800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4330 0x55f2e6af4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.808+0000 7fc9a5e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4c50 0x55f2e6afefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.808+0000 7fc9a5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6aff510 0x55f2e6b01900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.808+0000 7fc9a6800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4330 0x55f2e6af4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:38790/0 (socket says 172.21.15.110:38790) 2024-09-12T02:14:51.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.808+0000 7fc9a6800640 1 -- 172.21.15.110:0/2803846513 learned_addr learned my addr 172.21.15.110:0/2803846513 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:51.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.808+0000 7fc9a5e00640 1 -- 172.21.15.110:0/2803846513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4330 msgr2=0x55f2e6af4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:51.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.808+0000 7fc9a5e00640 1 --2- 172.21.15.110:0/2803846513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4330 0x55f2e6af4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.808+0000 7fc9a5e00640 1 -- 172.21.15.110:0/2803846513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6aff510 msgr2=0x55f2e6b01900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:51.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.808+0000 7fc9a5e00640 1 --2- 172.21.15.110:0/2803846513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6aff510 0x55f2e6b01900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.808+0000 7fc9a5e00640 1 -- 172.21.15.110:0/2803846513 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2e6a0e4a0 con 0x55f2e6af4c50 2024-09-12T02:14:51.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.808+0000 7fc9a5e00640 1 --2- 172.21.15.110:0/2803846513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4c50 0x55f2e6afefd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc998009230 tx=0x7fc998005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff17b1bcdcd0ef6e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:51.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.809+0000 7fc993400640 1 -- 172.21.15.110:0/2803846513 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998040070 con 0x55f2e6af4c50 2024-09-12T02:14:51.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.809+0000 7fc993400640 1 -- 172.21.15.110:0/2803846513 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc998031970 con 0x55f2e6af4c50 2024-09-12T02:14:51.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.809+0000 7fc993400640 1 -- 172.21.15.110:0/2803846513 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc998035040 con 0x55f2e6af4c50 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.809+0000 7fc99ea00640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc98c0a2c00 0x7fc98c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.809+0000 7fc99ea00640 1 -- 172.21.15.110:0/2304027132 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fc9940cf570 con 0x7fc9a8102790 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.809+0000 7fc9a6800640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc98c0a2c00 0x7fc98c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.809+0000 7fc9afa15740 1 -- 172.21.15.110:0/2803846513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4c50 msgr2=0x55f2e6afefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.809+0000 7fc9afa15740 1 --2- 172.21.15.110:0/2803846513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4c50 0x55f2e6afefd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc998009230 tx=0x7fc998005dd0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.810+0000 7fc9afa15740 1 -- 172.21.15.110:0/2803846513 shutdown_connections 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.810+0000 7fc9afa15740 1 --2- 172.21.15.110:0/2803846513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6aff510 0x55f2e6b01900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.810+0000 7fc9afa15740 1 --2- 172.21.15.110:0/2803846513 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4c50 0x55f2e6afefd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.810+0000 7fc9afa15740 1 --2- 172.21.15.110:0/2803846513 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4330 0x55f2e6af4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.810+0000 7fc9afa15740 1 -- 172.21.15.110:0/2803846513 >> 172.21.15.110:0/2803846513 conn(0x55f2e6af08c0 msgr2=0x55f2e6af0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.810+0000 7fc9afa15740 1 -- 172.21.15.110:0/2803846513 shutdown_connections 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.810+0000 7fc9afa15740 1 -- 172.21.15.110:0/2803846513 wait complete. 2024-09-12T02:14:51.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.810+0000 7fc9a6800640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc98c0a2c00 0x7fc98c0a50c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009fd0 tx=0x7fc9a0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:51.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.810+0000 7fc9afa15740 1 -- start start 2024-09-12T02:14:51.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9afa15740 1 Processor -- start 2024-09-12T02:14:51.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9afa15740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4330 0x55f2e6afc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9afa15740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 0x55f2e6afc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9afa15740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6aff510 0x55f2e6afcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9afa15740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f2e6b02060 con 0x55f2e6af4c50 2024-09-12T02:14:51.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9afa15740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f2e69e2920 con 0x55f2e6af4330 2024-09-12T02:14:51.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9afa15740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f2e6b021e0 con 0x55f2e6aff510 2024-09-12T02:14:51.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9afa15740 10 client.0 _ll_register_callbacks cb 0x55f2e6a068a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:14:51.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9a5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 0x55f2e6afc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9a6800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6aff510 0x55f2e6afcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9a5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 0x55f2e6afc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49524/0 (socket says 172.21.15.110:49524) 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9a5400640 1 -- 172.21.15.110:0/563308391 learned_addr learned my addr 172.21.15.110:0/563308391 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.811+0000 7fc9a5e00640 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4330 0x55f2e6afc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.812+0000 7fc9a5400640 1 -- 172.21.15.110:0/563308391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6aff510 msgr2=0x55f2e6afcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.812+0000 7fc9a5400640 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6aff510 0x55f2e6afcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.812+0000 7fc9a5400640 1 -- 172.21.15.110:0/563308391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4330 msgr2=0x55f2e6afc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.812+0000 7fc9a5400640 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4330 0x55f2e6afc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.812+0000 7fc9a5400640 1 -- 172.21.15.110:0/563308391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2e67cb2b0 con 0x55f2e6af4c50 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.812+0000 7fc9a5e00640 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4330 0x55f2e6afc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.812+0000 7fc9a5400640 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 0x55f2e6afc9b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc994018530 tx=0x7fc994099f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddbb2af8df21728 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.812+0000 7fc987e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.812+0000 7fc987e00640 1 -- 172.21.15.110:0/563308391 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99400ce60 con 0x55f2e6af4c50 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.812+0000 7fc987e00640 1 -- 172.21.15.110:0/563308391 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fc99409aed0 con 0x55f2e6af4c50 2024-09-12T02:14:51.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.812+0000 7fc9afa15740 1 -- 172.21.15.110:0/563308391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc998031970 con 0x55f2e6af4c50 2024-09-12T02:14:51.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.813+0000 7fc987e00640 1 -- 172.21.15.110:0/563308391 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc994010db0 con 0x55f2e6af4c50 2024-09-12T02:14:51.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.813+0000 7fc9afa15740 10 client.15102 fetch_fsmap learned FSMap version 25 2024-09-12T02:14:51.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.813+0000 7fc9afa15740 1 -- 172.21.15.110:0/563308391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f2e6b0de80 con 0x55f2e6af4c50 2024-09-12T02:14:51.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.813+0000 7fc987e00640 1 -- 172.21.15.110:0/563308391 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc998031970 con 0x55f2e6af4c50 2024-09-12T02:14:51.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.813+0000 7fc987e00640 1 -- 172.21.15.110:0/563308391 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fc994018b00 con 0x55f2e6af4c50 2024-09-12T02:14:51.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.813+0000 7fc9afa15740 10 client.15102 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:14:51.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.813+0000 7fc9afa15740 10 client.15102 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:14:51.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.813+0000 7fc9afa15740 20 client.15102 populate_metadata read hostname 'smithi110' 2024-09-12T02:14:51.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.813+0000 7fc9afa15740 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x55f2e6b10540 0x55f2e6b119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.813+0000 7fc9afa15740 4 client.15102 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:14:51.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.813+0000 7fc9afa15740 1 -- 172.21.15.110:0/563308391 --> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2e6a67620 con 0x55f2e6b10540 2024-09-12T02:14:51.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.814+0000 7fc9a5e00640 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x55f2e6b10540 0x55f2e6b119b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.814+0000 7fc9a5e00640 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x55f2e6b10540 0x55f2e6b119b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e04c58ef6797ba4b server_cookie=60c5ce2131aa240c in_seq=0 out_seq=0 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.814+0000 7fc987e00640 10 client.15102 ms_handle_connect on v2:172.21.15.110:6840/4021694968 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.815+0000 7fc987e00640 1 -- 172.21.15.110:0/563308391 <== mds.1 v2:172.21.15.110:6840/4021694968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f2e6a67620 con 0x55f2e6b10540 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.815+0000 7fc987e00640 10 client.15102 handle_command_reply: tid=0 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.815+0000 7fc9afa15740 1 client.15102 shutdown 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.815+0000 7fc9afa15740 1 -- 172.21.15.110:0/563308391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 msgr2=0x55f2e6afc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.815+0000 7fc9afa15740 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 0x55f2e6afc9b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc994018530 tx=0x7fc994099f90 comp rx=0 tx=0).stop 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.815+0000 7fc9afa15740 1 -- 172.21.15.110:0/563308391 shutdown_connections 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.815+0000 7fc9afa15740 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6aff510 0x55f2e6afcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.815+0000 7fc9afa15740 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 0x55f2e6afc9b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.815+0000 7fc9afa15740 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x55f2e6b10540 0x55f2e6b119b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.815+0000 7fc9afa15740 1 --2- 172.21.15.110:0/563308391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4330 0x55f2e6afc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.815+0000 7fc9afa15740 1 -- 172.21.15.110:0/563308391 >> 172.21.15.110:0/563308391 conn(0x55f2e6af08c0 msgr2=0x55f2e6af65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:51.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.815+0000 7fc987e00640 0 client.15102 ms_handle_reset on v2:172.21.15.110:6840/4021694968 2024-09-12T02:14:51.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.816+0000 7fc9afa15740 1 -- 172.21.15.110:0/563308391 shutdown_connections 2024-09-12T02:14:51.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.816+0000 7fc9afa15740 1 -- 172.21.15.110:0/563308391 wait complete. 2024-09-12T02:14:51.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.816+0000 7fc9afa15740 20 client.15102 trim_cache size 0 max 16384 2024-09-12T02:14:51.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.834+0000 7fc9afa15740 1 Processor -- start 2024-09-12T02:14:51.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.834+0000 7fc9afa15740 1 -- start start 2024-09-12T02:14:51.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.834+0000 7fc9afa15740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4330 0x55f2e6afad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.834+0000 7fc9afa15740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4c50 0x55f2e6afb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.834+0000 7fc9afa15740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6aff510 0x55f2e6af96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.834+0000 7fc9afa15740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f2e6b0fcf0 con 0x55f2e6aff510 2024-09-12T02:14:51.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.834+0000 7fc9afa15740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f2e6b103c0 con 0x55f2e6af4330 2024-09-12T02:14:51.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.834+0000 7fc9afa15740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f2e6b10a90 con 0x55f2e6af4c50 2024-09-12T02:14:51.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.835+0000 7fc9a5400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4c50 0x55f2e6afb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.835+0000 7fc9a5400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4c50 0x55f2e6afb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:38820/0 (socket says 172.21.15.110:38820) 2024-09-12T02:14:51.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.835+0000 7fc9a5400640 1 -- 172.21.15.110:0/21270386 learned_addr learned my addr 172.21.15.110:0/21270386 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:51.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.835+0000 7fc9a5e00640 1 --2- 172.21.15.110:0/21270386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4330 0x55f2e6afad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.835+0000 7fc9a6800640 1 --2- 172.21.15.110:0/21270386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6aff510 0x55f2e6af96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.835+0000 7fc9a5400640 1 -- 172.21.15.110:0/21270386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4330 msgr2=0x55f2e6afad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:51.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.835+0000 7fc9a5400640 1 --2- 172.21.15.110:0/21270386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4330 0x55f2e6afad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.835+0000 7fc9a5400640 1 -- 172.21.15.110:0/21270386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6aff510 msgr2=0x55f2e6af96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:51.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.835+0000 7fc9a5400640 1 --2- 172.21.15.110:0/21270386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6aff510 0x55f2e6af96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.835+0000 7fc9a5400640 1 -- 172.21.15.110:0/21270386 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2e6afede0 con 0x55f2e6af4c50 2024-09-12T02:14:51.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.835+0000 7fc9a6800640 1 --2- 172.21.15.110:0/21270386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6aff510 0x55f2e6af96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:51.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.835+0000 7fc9a5400640 1 --2- 172.21.15.110:0/21270386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4c50 0x55f2e6afb280 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc9940a4110 tx=0x7fc994018420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae7a8f4aa6c34b32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:51.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.836+0000 7fc992a00640 1 -- 172.21.15.110:0/21270386 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99400ce60 con 0x55f2e6af4c50 2024-09-12T02:14:51.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.836+0000 7fc992a00640 1 -- 172.21.15.110:0/21270386 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9940cf030 con 0x55f2e6af4c50 2024-09-12T02:14:51.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.836+0000 7fc992a00640 1 -- 172.21.15.110:0/21270386 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99409aed0 con 0x55f2e6af4c50 2024-09-12T02:14:51.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.836+0000 7fc9afa15740 1 -- 172.21.15.110:0/21270386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4c50 msgr2=0x55f2e6afb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:51.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.836+0000 7fc9afa15740 1 --2- 172.21.15.110:0/21270386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4c50 0x55f2e6afb280 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc9940a4110 tx=0x7fc994018420 comp rx=0 tx=0).stop 2024-09-12T02:14:51.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.836+0000 7fc9afa15740 1 -- 172.21.15.110:0/21270386 shutdown_connections 2024-09-12T02:14:51.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.836+0000 7fc9afa15740 1 --2- 172.21.15.110:0/21270386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6aff510 0x55f2e6af96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.836+0000 7fc9afa15740 1 --2- 172.21.15.110:0/21270386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4c50 0x55f2e6afb280 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.836+0000 7fc9afa15740 1 --2- 172.21.15.110:0/21270386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6af4330 0x55f2e6afad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.836+0000 7fc9afa15740 1 -- 172.21.15.110:0/21270386 >> 172.21.15.110:0/21270386 conn(0x55f2e6af08c0 msgr2=0x55f2e6af7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:51.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.836+0000 7fc9afa15740 1 -- 172.21.15.110:0/21270386 shutdown_connections 2024-09-12T02:14:51.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.837+0000 7fc9afa15740 1 -- 172.21.15.110:0/21270386 wait complete. 2024-09-12T02:14:51.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.837+0000 7fc9afa15740 1 -- start start 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.837+0000 7fc9afa15740 1 Processor -- start 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9afa15740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4330 0x55f2e6b1a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9afa15740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 0x55f2e6b134d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9afa15740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6aff510 0x55f2e6b13a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9afa15740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55f2e6b11830 con 0x55f2e6af4c50 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9afa15740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f2e6b11160 con 0x55f2e6aff510 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9afa15740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55f2e6b11f00 con 0x55f2e6af4330 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9afa15740 10 client.0 _ll_register_callbacks cb 0x7fc9940d2ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9a5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 0x55f2e6b134d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9a6800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6aff510 0x55f2e6b13a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9a5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 0x55f2e6b134d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49540/0 (socket says 172.21.15.110:49540) 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9a5400640 1 -- 172.21.15.110:0/2766534927 learned_addr learned my addr 172.21.15.110:0/2766534927 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:51.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9a5e00640 1 --2- 172.21.15.110:0/2766534927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4330 0x55f2e6b1a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9a5400640 1 -- 172.21.15.110:0/2766534927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4330 msgr2=0x55f2e6b1a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9a5400640 1 --2- 172.21.15.110:0/2766534927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4330 0x55f2e6b1a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9a5400640 1 -- 172.21.15.110:0/2766534927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6aff510 msgr2=0x55f2e6b13a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9a5400640 1 --2- 172.21.15.110:0/2766534927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6aff510 0x55f2e6b13a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.838+0000 7fc9a5400640 1 -- 172.21.15.110:0/2766534927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2e6b14050 con 0x55f2e6af4c50 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.839+0000 7fc9a5400640 1 --2- 172.21.15.110:0/2766534927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 0x55f2e6b134d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc994018530 tx=0x7fc99409b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d3f5a125f8b85b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.839+0000 7fc987e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.839+0000 7fc987e00640 1 -- 172.21.15.110:0/2766534927 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99400ce60 con 0x55f2e6af4c50 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.839+0000 7fc987e00640 1 -- 172.21.15.110:0/2766534927 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7fc994010430 con 0x55f2e6af4c50 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.839+0000 7fc9afa15740 1 -- 172.21.15.110:0/2766534927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9940cf030 con 0x55f2e6af4c50 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.839+0000 7fc987e00640 1 -- 172.21.15.110:0/2766534927 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc99409ba80 con 0x55f2e6af4c50 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.839+0000 7fc9afa15740 10 client.15108 fetch_fsmap learned FSMap version 25 2024-09-12T02:14:51.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.839+0000 7fc9afa15740 1 -- 172.21.15.110:0/2766534927 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f2e6b7ac50 con 0x55f2e6af4c50 2024-09-12T02:14:51.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.840+0000 7fc987e00640 1 -- 172.21.15.110:0/2766534927 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9940cf030 con 0x55f2e6af4c50 2024-09-12T02:14:51.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.840+0000 7fc987e00640 1 -- 172.21.15.110:0/2766534927 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fc9940ba120 con 0x55f2e6af4c50 2024-09-12T02:14:51.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.840+0000 7fc9afa15740 10 client.15108 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:14:51.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.840+0000 7fc9afa15740 10 client.15108 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-12T02:14:51.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.840+0000 7fc9afa15740 20 client.15108 populate_metadata read hostname 'smithi110' 2024-09-12T02:14:51.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.840+0000 7fc9afa15740 1 --2- 172.21.15.110:0/2766534927 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x55f2e6b7f240 0x55f2e6b7df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:51.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.840+0000 7fc9afa15740 4 client.15108 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:14:51.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.840+0000 7fc9afa15740 1 -- 172.21.15.110:0/2766534927 --> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] -- command(tid 0: {"prefix": "status"}) -- 0x55f2e6a61b30 con 0x55f2e6b7f240 2024-09-12T02:14:51.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.840+0000 7fc9a5e00640 1 --2- 172.21.15.110:0/2766534927 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x55f2e6b7f240 0x55f2e6b7df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:51.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc9a5e00640 1 --2- 172.21.15.110:0/2766534927 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x55f2e6b7f240 0x55f2e6b7df50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=89adcfba3d8c9288 server_cookie=22ab4e2c2e85c394 in_seq=0 out_seq=0 2024-09-12T02:14:51.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc987e00640 10 client.15108 ms_handle_connect on v2:172.21.15.110:6840/4021694968 2024-09-12T02:14:51.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc987e00640 1 -- 172.21.15.110:0/2766534927 <== mds.1 v2:172.21.15.110:6840/4021694968 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f2e6a61b30 con 0x55f2e6b7f240 2024-09-12T02:14:51.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc987e00640 10 client.15108 handle_command_reply: tid=0 2024-09-12T02:14:51.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc9afa15740 1 client.15108 shutdown 2024-09-12T02:14:51.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc9afa15740 1 -- 172.21.15.110:0/2766534927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 msgr2=0x55f2e6b134d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:51.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc9afa15740 1 --2- 172.21.15.110:0/2766534927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 0x55f2e6b134d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc994018530 tx=0x7fc99409b510 comp rx=0 tx=0).stop 2024-09-12T02:14:51.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc9afa15740 1 -- 172.21.15.110:0/2766534927 shutdown_connections 2024-09-12T02:14:51.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc9afa15740 1 --2- 172.21.15.110:0/2766534927 >> [v2:172.21.15.110:6840/4021694968,v1:172.21.15.110:6841/4021694968] conn(0x55f2e6b7f240 0x55f2e6b7df50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc9afa15740 1 --2- 172.21.15.110:0/2766534927 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f2e6aff510 0x55f2e6b13a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc9afa15740 1 --2- 172.21.15.110:0/2766534927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f2e6af4c50 0x55f2e6b134d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc9afa15740 1 --2- 172.21.15.110:0/2766534927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55f2e6af4330 0x55f2e6b1a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc987e00640 0 client.15108 ms_handle_reset on v2:172.21.15.110:6840/4021694968 2024-09-12T02:14:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc9afa15740 1 -- 172.21.15.110:0/2766534927 >> 172.21.15.110:0/2766534927 conn(0x55f2e6af08c0 msgr2=0x55f2e6afa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.841+0000 7fc9afa15740 1 -- 172.21.15.110:0/2766534927 shutdown_connections 2024-09-12T02:14:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.842+0000 7fc9afa15740 1 -- 172.21.15.110:0/2766534927 wait complete. 2024-09-12T02:14:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.842+0000 7fc9afa15740 20 client.15108 trim_cache size 0 max 16384 2024-09-12T02:14:51.846 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:14:51.846 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "10ead734-70ab-11ef-bcea-c7b262605968", 2024-09-12T02:14:51.847 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 1, 2024-09-12T02:14:51.847 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24538, 2024-09-12T02:14:51.847 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-09-12T02:14:51.847 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-09-12T02:14:51.847 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-09-12T02:14:51.847 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 112.267288315, 2024-09-12T02:14:51.847 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 25, 2024-09-12T02:14:51.847 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 97, 2024-09-12T02:14:51.847 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 95, 2024-09-12T02:14:51.847 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 175.76087663000001 2024-09-12T02:14:51.847 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:14:51.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.842+0000 7fc9ace00640 1 -- 172.21.15.110:0/2304027132 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc98c0a2c00 msgr2=0x7fc98c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:51.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.842+0000 7fc9ace00640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc98c0a2c00 0x7fc98c0a50c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009fd0 tx=0x7fc9a0009500 comp rx=0 tx=0).stop 2024-09-12T02:14:51.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.842+0000 7fc9ace00640 1 -- 172.21.15.110:0/2304027132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a8102790 msgr2=0x7fc9a81989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:51.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.842+0000 7fc9ace00640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a8102790 0x7fc9a81989d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc99400e9f0 tx=0x7fc99400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.842+0000 7fc9ace00640 1 -- 172.21.15.110:0/2304027132 shutdown_connections 2024-09-12T02:14:51.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.842+0000 7fc9ace00640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7fc98c0a2c00 0x7fc98c0a50c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.842+0000 7fc9ace00640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9a8106f10 0x7fc9a819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.842+0000 7fc9ace00640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc9a8102790 0x7fc9a81989d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.842+0000 7fc9ace00640 1 --2- 172.21.15.110:0/2304027132 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc9a8101de0 0x7fc9a8198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.842+0000 7fc9ace00640 1 -- 172.21.15.110:0/2304027132 >> 172.21.15.110:0/2304027132 conn(0x7fc9a80fd8c0 msgr2=0x7fc9a80fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.843+0000 7fc9ace00640 1 -- 172.21.15.110:0/2304027132 shutdown_connections 2024-09-12T02:14:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:51.843+0000 7fc9ace00640 1 -- 172.21.15.110:0/2304027132 wait complete. 2024-09-12T02:14:52.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:52 smithi110 ceph-mon[30548]: pgmap v390: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-12T02:14:52.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:52 smithi115 ceph-mon[35351]: pgmap v390: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-12T02:14:52.896 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-12T02:14:52.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:52 smithi136 ceph-mon[35814]: pgmap v390: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-12T02:14:53.263 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:53.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.869+0000 7f6738800640 1 -- 172.21.15.110:0/1509816865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67300ffb60 msgr2=0x7f67300fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:53.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.869+0000 7f6738800640 1 --2- 172.21.15.110:0/1509816865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67300ffb60 0x7f67300fffc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6720009900 tx=0x7f672002a410 comp rx=0 tx=0).stop 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.869+0000 7f6738800640 1 -- 172.21.15.110:0/1509816865 shutdown_connections 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.869+0000 7f6738800640 1 --2- 172.21.15.110:0/1509816865 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6730100500 0x7f673010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.869+0000 7f6738800640 1 --2- 172.21.15.110:0/1509816865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67300ffb60 0x7f67300fffc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.869+0000 7f6738800640 1 --2- 172.21.15.110:0/1509816865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6730106b80 0x7f6730106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.869+0000 7f6738800640 1 -- 172.21.15.110:0/1509816865 >> 172.21.15.110:0/1509816865 conn(0x7f67300fba90 msgr2=0x7f67300fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.869+0000 7f6738800640 1 -- 172.21.15.110:0/1509816865 shutdown_connections 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.870+0000 7f6738800640 1 -- 172.21.15.110:0/1509816865 wait complete. 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.870+0000 7f6738800640 1 Processor -- start 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.870+0000 7f6738800640 1 -- start start 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6738800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67300ffb60 0x7f6730198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6738800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6730100500 0x7f67301989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6738800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6730106b80 0x7f673019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6738800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6730111ff0 con 0x7f67300ffb60 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6738800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6730111e70 con 0x7f6730106b80 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6738800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6730112170 con 0x7f6730100500 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6735e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67300ffb60 0x7f6730198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6735e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67300ffb60 0x7f6730198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49554/0 (socket says 172.21.15.110:49554) 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6735e00640 1 -- 172.21.15.110:0/2940864857 learned_addr learned my addr 172.21.15.110:0/2940864857 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6735400640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6730100500 0x7f67301989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6736800640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6730106b80 0x7f673019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6735e00640 1 -- 172.21.15.110:0/2940864857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6730100500 msgr2=0x7f67301989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.871+0000 7f6735e00640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6730100500 0x7f67301989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.872+0000 7f6735e00640 1 -- 172.21.15.110:0/2940864857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6730106b80 msgr2=0x7f673019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.872+0000 7f6735e00640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6730106b80 0x7f673019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.872+0000 7f6735e00640 1 -- 172.21.15.110:0/2940864857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673019d420 con 0x7f67300ffb60 2024-09-12T02:14:53.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.872+0000 7f6736800640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6730106b80 0x7f673019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.872+0000 7f6735e00640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67300ffb60 0x7f6730198470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f672400e9f0 tx=0x7f672400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.872+0000 7f672aa00640 1 -- 172.21.15.110:0/2940864857 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672400cd80 con 0x7f67300ffb60 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.872+0000 7f672aa00640 1 -- 172.21.15.110:0/2940864857 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6724010910 con 0x7f67300ffb60 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.872+0000 7f672aa00640 1 -- 172.21.15.110:0/2940864857 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6724018990 con 0x7f67300ffb60 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.872+0000 7f6738800640 1 -- 172.21.15.110:0/2940864857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f673019d710 con 0x7f67300ffb60 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.872+0000 7f6738800640 1 -- 172.21.15.110:0/2940864857 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67301a4ff0 con 0x7f67300ffb60 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.875+0000 7f672aa00640 1 -- 172.21.15.110:0/2940864857 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f6724010ac0 con 0x7f67300ffb60 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.875+0000 7f673b406740 1 Processor -- start 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.875+0000 7f673b406740 1 -- start start 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f673b406740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c709371710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f673b406740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371c50 0x55c70937bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f673b406740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c70937c510 0x55c70937e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f673b406740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c7092d70b0 con 0x55c70937c510 2024-09-12T02:14:53.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f673b406740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c70927eab0 con 0x55c709371c50 2024-09-12T02:14:53.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f673b406740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c7092d3070 con 0x55c709371330 2024-09-12T02:14:53.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f6736800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c709371710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f6736800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c709371710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:38864/0 (socket says 172.21.15.110:38864) 2024-09-12T02:14:53.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f6736800640 1 -- 172.21.15.110:0/360308085 learned_addr learned my addr 172.21.15.110:0/360308085 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:53.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f6735400640 1 --2- 172.21.15.110:0/360308085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c70937c510 0x55c70937e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f6735e00640 1 --2- 172.21.15.110:0/360308085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371c50 0x55c70937bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f6736800640 1 -- 172.21.15.110:0/360308085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371c50 msgr2=0x55c70937bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:53.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f6736800640 1 --2- 172.21.15.110:0/360308085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371c50 0x55c70937bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f6736800640 1 -- 172.21.15.110:0/360308085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c70937c510 msgr2=0x55c70937e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:53.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.876+0000 7f6736800640 1 --2- 172.21.15.110:0/360308085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c70937c510 0x55c70937e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.877+0000 7f6736800640 1 -- 172.21.15.110:0/360308085 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c70928b4a0 con 0x55c709371330 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.877+0000 7f6735e00640 1 --2- 172.21.15.110:0/360308085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371c50 0x55c70937bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.877+0000 7f672aa00640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f67180a2c00 0x7f67180a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.877+0000 7f6736800640 1 --2- 172.21.15.110:0/360308085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c709371710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f672c009f60 tx=0x7f672c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=957bd53993ebfdf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.877+0000 7f671f000640 1 -- 172.21.15.110:0/360308085 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c016070 con 0x55c709371330 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.877+0000 7f671f000640 1 -- 172.21.15.110:0/360308085 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f672c01bb40 con 0x55c709371330 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.877+0000 7f6735e00640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f67180a2c00 0x7f67180a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.877+0000 7f671f000640 1 -- 172.21.15.110:0/360308085 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c012c50 con 0x55c709371330 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.877+0000 7f672aa00640 1 -- 172.21.15.110:0/2940864857 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f67240cf760 con 0x7f67300ffb60 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.878+0000 7f673b406740 1 -- 172.21.15.110:0/360308085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 msgr2=0x55c709371710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.878+0000 7f6735e00640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f67180a2c00 0x7f67180a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6724098020 tx=0x7f6724000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.878+0000 7f673b406740 1 --2- 172.21.15.110:0/360308085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c709371710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f672c009f60 tx=0x7f672c009f90 comp rx=0 tx=0).stop 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.878+0000 7f673b406740 1 -- 172.21.15.110:0/360308085 shutdown_connections 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.878+0000 7f673b406740 1 --2- 172.21.15.110:0/360308085 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c70937c510 0x55c70937e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.878+0000 7f673b406740 1 --2- 172.21.15.110:0/360308085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371c50 0x55c70937bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.878+0000 7f673b406740 1 --2- 172.21.15.110:0/360308085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c709371710 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.878+0000 7f673b406740 1 -- 172.21.15.110:0/360308085 >> 172.21.15.110:0/360308085 conn(0x55c70936d8c0 msgr2=0x55c70936dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:53.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.878+0000 7f673b406740 1 -- 172.21.15.110:0/360308085 shutdown_connections 2024-09-12T02:14:53.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.878+0000 7f673b406740 1 -- 172.21.15.110:0/360308085 wait complete. 2024-09-12T02:14:53.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.879+0000 7f673b406740 1 -- start start 2024-09-12T02:14:53.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.879+0000 7f673b406740 1 Processor -- start 2024-09-12T02:14:53.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.879+0000 7f673b406740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c709379600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.879+0000 7f673b406740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371c50 0x55c709379b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.879+0000 7f673b406740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c70937c510 0x55c70937a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.879+0000 7f673b406740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c70937f060 con 0x55c70937c510 2024-09-12T02:14:53.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.879+0000 7f673b406740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c70925f920 con 0x55c709371c50 2024-09-12T02:14:53.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.879+0000 7f673b406740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c70937f1e0 con 0x55c709371330 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f673b406740 10 client.0 _ll_register_callbacks cb 0x55c7092838a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f6736800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c709379600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f6736800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c70937c510 0x55c70937a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f6735400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371c50 0x55c709379b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f6736800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c70937c510 0x55c70937a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49580/0 (socket says 172.21.15.110:49580) 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f6736800640 1 -- 172.21.15.110:0/214420231 learned_addr learned my addr 172.21.15.110:0/214420231 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f6736800640 1 -- 172.21.15.110:0/214420231 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 msgr2=0x55c709379600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f6736800640 1 --2- 172.21.15.110:0/214420231 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c709379600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f6736800640 1 -- 172.21.15.110:0/214420231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371c50 msgr2=0x55c709379b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f6736800640 1 --2- 172.21.15.110:0/214420231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371c50 0x55c709379b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f6736800640 1 -- 172.21.15.110:0/214420231 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7090482b0 con 0x55c70937c510 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f6735400640 1 --2- 172.21.15.110:0/214420231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371c50 0x55c709379b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:53.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.880+0000 7f6736800640 1 --2- 172.21.15.110:0/214420231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c70937c510 0x55c70937a080 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f672c010c90 tx=0x7f672c0127f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414f868f92d99d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:53.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.881+0000 7f6713400640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-09-12T02:14:53.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.881+0000 7f6713400640 1 -- 172.21.15.110:0/214420231 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c022050 con 0x55c70937c510 2024-09-12T02:14:53.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.881+0000 7f673b406740 1 -- 172.21.15.110:0/214420231 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f672c01bb40 con 0x55c70937c510 2024-09-12T02:14:53.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.881+0000 7f6713400640 1 -- 172.21.15.110:0/214420231 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f672c01b660 con 0x55c70937c510 2024-09-12T02:14:53.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.881+0000 7f6713400640 1 -- 172.21.15.110:0/214420231 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f672c025040 con 0x55c70937c510 2024-09-12T02:14:53.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.881+0000 7f673b406740 10 client.15120 fetch_fsmap learned FSMap version 25 2024-09-12T02:14:53.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.881+0000 7f673b406740 1 -- 172.21.15.110:0/214420231 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c70938f220 con 0x55c70937c510 2024-09-12T02:14:53.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.881+0000 7f6713400640 1 -- 172.21.15.110:0/214420231 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f672c01bb40 con 0x55c70937c510 2024-09-12T02:14:53.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.882+0000 7f6713400640 1 -- 172.21.15.110:0/214420231 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f672c00f040 con 0x55c70937c510 2024-09-12T02:14:53.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.882+0000 7f673b406740 10 client.15120 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:14:53.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.882+0000 7f673b406740 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:14:53.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.882+0000 7f673b406740 20 client.15120 populate_metadata read hostname 'smithi110' 2024-09-12T02:14:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.882+0000 7f673b406740 1 --2- 172.21.15.110:0/214420231 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55c709391600 0x55c709392a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.882+0000 7f673b406740 4 client.15120 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T02:14:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.882+0000 7f673b406740 1 -- 172.21.15.110:0/214420231 --> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7092e4620 con 0x55c709391600 2024-09-12T02:14:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.882+0000 7f6735400640 1 --2- 172.21.15.110:0/214420231 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55c709391600 0x55c709392a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.883+0000 7f6713400640 10 client.15120 ms_handle_connect on v2:172.21.15.115:6838/1796624254 2024-09-12T02:14:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.883+0000 7f6735400640 1 --2- 172.21.15.110:0/214420231 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55c709391600 0x55c709392a70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91ff40c751f13178 server_cookie=9ba0806a9e1e4b1c in_seq=0 out_seq=0 2024-09-12T02:14:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f6713400640 1 -- 172.21.15.110:0/214420231 <== mds.0 v2:172.21.15.115:6838/1796624254 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c7092e4620 con 0x55c709391600 2024-09-12T02:14:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f6713400640 10 client.15120 handle_command_reply: tid=0 2024-09-12T02:14:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f673b406740 1 client.15120 shutdown 2024-09-12T02:14:53.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f673b406740 1 -- 172.21.15.110:0/214420231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c70937c510 msgr2=0x55c70937a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f673b406740 1 --2- 172.21.15.110:0/214420231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c70937c510 0x55c70937a080 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f672c010c90 tx=0x7f672c0127f0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f673b406740 1 -- 172.21.15.110:0/214420231 shutdown_connections 2024-09-12T02:14:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f673b406740 1 --2- 172.21.15.110:0/214420231 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c70937c510 0x55c70937a080 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f673b406740 1 --2- 172.21.15.110:0/214420231 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371c50 0x55c709379b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f673b406740 1 --2- 172.21.15.110:0/214420231 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55c709391600 0x55c709392a70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f673b406740 1 --2- 172.21.15.110:0/214420231 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c709379600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f6713400640 0 client.15120 ms_handle_reset on v2:172.21.15.115:6838/1796624254 2024-09-12T02:14:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f673b406740 1 -- 172.21.15.110:0/214420231 >> 172.21.15.110:0/214420231 conn(0x55c70936d8c0 msgr2=0x55c7093735a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f673b406740 1 -- 172.21.15.110:0/214420231 shutdown_connections 2024-09-12T02:14:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f673b406740 1 -- 172.21.15.110:0/214420231 wait complete. 2024-09-12T02:14:53.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.884+0000 7f673b406740 20 client.15120 trim_cache size 0 max 16384 2024-09-12T02:14:53.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.903+0000 7f673b406740 1 Processor -- start 2024-09-12T02:14:53.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.903+0000 7f673b406740 1 -- start start 2024-09-12T02:14:53.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.903+0000 7f673b406740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c70936d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.903+0000 7f673b406740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 0x55c7093768c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.903+0000 7f673b406740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c70937c510 0x55c709376e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.903+0000 7f673b406740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c709390db0 con 0x55c709371c50 2024-09-12T02:14:53.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.903+0000 7f673b406740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c709391480 con 0x55c70937c510 2024-09-12T02:14:53.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.903+0000 7f673b406740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c709391b50 con 0x55c709371330 2024-09-12T02:14:53.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.903+0000 7f6735400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 0x55c7093768c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.903+0000 7f6735400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 0x55c7093768c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49588/0 (socket says 172.21.15.110:49588) 2024-09-12T02:14:53.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.903+0000 7f6735400640 1 -- 172.21.15.110:0/2835202471 learned_addr learned my addr 172.21.15.110:0/2835202471 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:53.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.904+0000 7f6736800640 1 --2- 172.21.15.110:0/2835202471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c70936d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.904+0000 7f6736800640 1 --2- 172.21.15.110:0/2835202471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c70937c510 0x55c709376e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.904+0000 7f6735400640 1 -- 172.21.15.110:0/2835202471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 msgr2=0x55c70936d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:53.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.904+0000 7f6735400640 1 --2- 172.21.15.110:0/2835202471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c70936d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.904+0000 7f6735400640 1 -- 172.21.15.110:0/2835202471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c70937c510 msgr2=0x55c709376e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:53.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.904+0000 7f6735400640 1 --2- 172.21.15.110:0/2835202471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c70937c510 0x55c709376e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.904+0000 7f6735400640 1 -- 172.21.15.110:0/2835202471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c70938c870 con 0x55c709371c50 2024-09-12T02:14:53.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.904+0000 7f6736800640 1 --2- 172.21.15.110:0/2835202471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c70937c510 0x55c709376e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:14:53.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.904+0000 7f6735400640 1 --2- 172.21.15.110:0/2835202471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 0x55c7093768c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6720009230 tx=0x7f6720005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3d29ffd42d8c4a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.904+0000 7f671e600640 1 -- 172.21.15.110:0/2835202471 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720035040 con 0x55c709371c50 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.904+0000 7f671e600640 1 -- 172.21.15.110:0/2835202471 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67200046c0 con 0x55c709371c50 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.904+0000 7f671e600640 1 -- 172.21.15.110:0/2835202471 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67200038e0 con 0x55c709371c50 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.905+0000 7f673b406740 1 -- 172.21.15.110:0/2835202471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 msgr2=0x55c7093768c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.905+0000 7f673b406740 1 --2- 172.21.15.110:0/2835202471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 0x55c7093768c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6720009230 tx=0x7f6720005d70 comp rx=0 tx=0).stop 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.905+0000 7f673b406740 1 -- 172.21.15.110:0/2835202471 shutdown_connections 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.905+0000 7f673b406740 1 --2- 172.21.15.110:0/2835202471 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c70937c510 0x55c709376e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.905+0000 7f673b406740 1 --2- 172.21.15.110:0/2835202471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 0x55c7093768c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.905+0000 7f673b406740 1 --2- 172.21.15.110:0/2835202471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c709371330 0x55c70936d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.905+0000 7f673b406740 1 -- 172.21.15.110:0/2835202471 >> 172.21.15.110:0/2835202471 conn(0x55c70936d8c0 msgr2=0x55c709377f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.905+0000 7f673b406740 1 -- 172.21.15.110:0/2835202471 shutdown_connections 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.905+0000 7f673b406740 1 -- 172.21.15.110:0/2835202471 wait complete. 2024-09-12T02:14:53.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.906+0000 7f673b406740 1 -- start start 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.906+0000 7f673b406740 1 Processor -- start 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.906+0000 7f673b406740 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371330 0x55c70939b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.906+0000 7f673b406740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 0x55c7093763d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.906+0000 7f673b406740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c70937c510 0x55c709376910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.906+0000 7f673b406740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x55c7093928f0 con 0x55c709371c50 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.906+0000 7f673b406740 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55c709392220 con 0x55c709371330 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.906+0000 7f673b406740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55c709392fc0 con 0x55c70937c510 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.906+0000 7f673b406740 10 client.0 _ll_register_callbacks cb 0x7f672c013b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.907+0000 7f6735400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 0x55c7093763d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.907+0000 7f6735400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 0x55c7093763d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49598/0 (socket says 172.21.15.110:49598) 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.907+0000 7f6735400640 1 -- 172.21.15.110:0/2789306592 learned_addr learned my addr 172.21.15.110:0/2789306592 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.907+0000 7f6736800640 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371330 0x55c70939b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.907+0000 7f6736800640 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c70937c510 0x55c709376910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.907+0000 7f6736800640 1 -- 172.21.15.110:0/2789306592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c70937c510 msgr2=0x55c709376910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.907+0000 7f6736800640 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c70937c510 0x55c709376910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.907+0000 7f6736800640 1 -- 172.21.15.110:0/2789306592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 msgr2=0x55c7093763d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.907+0000 7f6736800640 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 0x55c7093763d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.907+0000 7f6736800640 1 -- 172.21.15.110:0/2789306592 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c709377140 con 0x55c709371330 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.907+0000 7f6736800640 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371330 0x55c70939b460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f672c009eb0 tx=0x7f672c0127f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3afef2140392f598 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.907+0000 7f6713400640 10 client.0 ms_handle_connect on v2:172.21.15.115:3300/0 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.908+0000 7f6713400640 1 -- 172.21.15.110:0/2789306592 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c022070 con 0x55c709371330 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.908+0000 7f673b406740 1 -- 172.21.15.110:0/2789306592 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67200046c0 con 0x55c709371330 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.908+0000 7f6713400640 1 -- 172.21.15.110:0/2789306592 <== mon.2 v2:172.21.15.115:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f672c012d10 con 0x55c709371330 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.908+0000 7f6713400640 1 -- 172.21.15.110:0/2789306592 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f672c016040 con 0x55c709371330 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.908+0000 7f673b406740 10 client.25136 fetch_fsmap learned FSMap version 25 2024-09-12T02:14:53.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.908+0000 7f673b406740 1 -- 172.21.15.110:0/2789306592 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c7093fbd70 con 0x55c709371330 2024-09-12T02:14:53.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.908+0000 7f6713400640 1 -- 172.21.15.110:0/2789306592 <== mon.2 v2:172.21.15.115:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67200046c0 con 0x55c709371330 2024-09-12T02:14:53.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.908+0000 7f6713400640 1 -- 172.21.15.110:0/2789306592 <== mon.2 v2:172.21.15.115:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f672c02a6e0 con 0x55c709371330 2024-09-12T02:14:53.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.909+0000 7f673b406740 10 client.25136 fetch_fsmap finished waiting for FSMap version 25 2024-09-12T02:14:53.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.909+0000 7f673b406740 10 client.25136 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T02:14:53.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.909+0000 7f673b406740 20 client.25136 populate_metadata read hostname 'smithi110' 2024-09-12T02:14:53.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.909+0000 7f673b406740 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55c7094007f0 0x55c7093ff500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:53.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.909+0000 7f673b406740 4 client.25136 mds_command: new command op to 24539 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T02:14:53.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.909+0000 7f673b406740 1 -- 172.21.15.110:0/2789306592 --> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] -- command(tid 0: {"prefix": "status"}) -- 0x55c7092deb30 con 0x55c7094007f0 2024-09-12T02:14:53.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.909+0000 7f6735400640 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55c7094007f0 0x55c7093ff500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:53.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.909+0000 7f6735400640 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55c7094007f0 0x55c7093ff500 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=867500633d071b14 server_cookie=c5606c60e5581057 in_seq=0 out_seq=0 2024-09-12T02:14:53.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.909+0000 7f6713400640 10 client.25136 ms_handle_connect on v2:172.21.15.115:6838/1796624254 2024-09-12T02:14:53.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f6713400640 1 -- 172.21.15.110:0/2789306592 <== mds.0 v2:172.21.15.115:6838/1796624254 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c7092deb30 con 0x55c7094007f0 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f6713400640 10 client.25136 handle_command_reply: tid=0 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f673b406740 1 client.25136 shutdown 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f673b406740 1 -- 172.21.15.110:0/2789306592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371330 msgr2=0x55c70939b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f673b406740 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371330 0x55c70939b460 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f672c009eb0 tx=0x7f672c0127f0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f673b406740 1 -- 172.21.15.110:0/2789306592 shutdown_connections 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f673b406740 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.115:6838/1796624254,v1:172.21.15.115:6839/1796624254] conn(0x55c7094007f0 0x55c7093ff500 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f673b406740 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55c70937c510 0x55c709376910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f6713400640 0 client.25136 ms_handle_reset on v2:172.21.15.115:6838/1796624254 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f673b406740 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c709371c50 0x55c7093763d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f673b406740 1 --2- 172.21.15.110:0/2789306592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55c709371330 0x55c70939b460 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f673b406740 1 -- 172.21.15.110:0/2789306592 >> 172.21.15.110:0/2789306592 conn(0x55c70936d8c0 msgr2=0x55c7093795c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f673b406740 1 -- 172.21.15.110:0/2789306592 shutdown_connections 2024-09-12T02:14:53.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f673b406740 1 -- 172.21.15.110:0/2789306592 wait complete. 2024-09-12T02:14:53.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.910+0000 7f673b406740 20 client.25136 trim_cache size 0 max 16384 2024-09-12T02:14:53.923 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:14:53.923 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "10ead734-70ab-11ef-bcea-c7b262605968", 2024-09-12T02:14:53.923 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 0, 2024-09-12T02:14:53.923 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 24539, 2024-09-12T02:14:53.923 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-09-12T02:14:53.923 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-09-12T02:14:53.923 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-09-12T02:14:53.923 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 159.22779130699999, 2024-09-12T02:14:53.923 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 25, 2024-09-12T02:14:53.924 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 97, 2024-09-12T02:14:53.924 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 95, 2024-09-12T02:14:53.924 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 175.27936374000001 2024-09-12T02:14:53.924 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:14:53.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.911+0000 7f6738800640 1 -- 172.21.15.110:0/2940864857 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f67180a2c00 msgr2=0x7f67180a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:53.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.911+0000 7f6738800640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f67180a2c00 0x7f67180a50c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6724098020 tx=0x7f6724000bc0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.911+0000 7f6738800640 1 -- 172.21.15.110:0/2940864857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67300ffb60 msgr2=0x7f6730198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:53.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.911+0000 7f6738800640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67300ffb60 0x7f6730198470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f672400e9f0 tx=0x7f672400eeb0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.911+0000 7f6738800640 1 -- 172.21.15.110:0/2940864857 shutdown_connections 2024-09-12T02:14:53.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.911+0000 7f6738800640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f67180a2c00 0x7f67180a50c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.911+0000 7f6738800640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6730106b80 0x7f673019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.911+0000 7f6738800640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6730100500 0x7f67301989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.911+0000 7f6738800640 1 --2- 172.21.15.110:0/2940864857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67300ffb60 0x7f6730198470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:53.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.911+0000 7f6738800640 1 -- 172.21.15.110:0/2940864857 >> 172.21.15.110:0/2940864857 conn(0x7f67300fba90 msgr2=0x7f67300fc390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:53.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.911+0000 7f6738800640 1 -- 172.21.15.110:0/2940864857 shutdown_connections 2024-09-12T02:14:53.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:53.911+0000 7f6738800640 1 -- 172.21.15.110:0/2940864857 wait complete. 2024-09-12T02:14:54.600 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:54 smithi110 ceph-mon[30548]: pgmap v391: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-12T02:14:54.779 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T02:14:54.790 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T02:14:54.790 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T02:14:54.790 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T02:14:54.790 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-12T02:14:54.791 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:14:54.791 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T02:14:54.791 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-12T02:14:54.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:54 smithi136 ceph-mon[35814]: pgmap v391: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-12T02:14:54.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.943+0000 7f2e65600640 1 -- 172.21.15.110:0/3896647129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e60105910 msgr2=0x7f2e6010c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:54.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.943+0000 7f2e65600640 1 --2- 172.21.15.110:0/3896647129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e60105910 0x7f2e6010c1a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009900 tx=0x7f2e5802a410 comp rx=0 tx=0).stop 2024-09-12T02:14:54.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.943+0000 7f2e65600640 1 -- 172.21.15.110:0/3896647129 shutdown_connections 2024-09-12T02:14:54.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.943+0000 7f2e65600640 1 --2- 172.21.15.110:0/3896647129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e60105910 0x7f2e6010c1a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:54.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.943+0000 7f2e65600640 1 --2- 172.21.15.110:0/3896647129 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e60104f50 0x7f2e601053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:54.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.943+0000 7f2e65600640 1 --2- 172.21.15.110:0/3896647129 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e60103d60 0x7f2e60104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:54.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.943+0000 7f2e65600640 1 -- 172.21.15.110:0/3896647129 >> 172.21.15.110:0/3896647129 conn(0x7f2e600ff4e0 msgr2=0x7f2e60101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:54.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.943+0000 7f2e65600640 1 -- 172.21.15.110:0/3896647129 shutdown_connections 2024-09-12T02:14:54.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.943+0000 7f2e65600640 1 -- 172.21.15.110:0/3896647129 wait complete. 2024-09-12T02:14:54.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.944+0000 7f2e65600640 1 Processor -- start 2024-09-12T02:14:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.944+0000 7f2e65600640 1 -- start start 2024-09-12T02:14:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e65600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e60103d60 0x7f2e60199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e65600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e60104f50 0x7f2e6019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e65600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e60105910 0x7f2e601a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e65600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6010f9e0 con 0x7f2e60104f50 2024-09-12T02:14:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e65600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6010f860 con 0x7f2e60103d60 2024-09-12T02:14:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e65600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6010fb60 con 0x7f2e60105910 2024-09-12T02:14:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e56000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e60104f50 0x7f2e6019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e56000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e60104f50 0x7f2e6019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49622/0 (socket says 172.21.15.110:49622) 2024-09-12T02:14:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e56000640 1 -- 172.21.15.110:0/2312276521 learned_addr learned my addr 172.21.15.110:0/2312276521 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e5ea00640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e60103d60 0x7f2e60199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:54.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e5f400640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e60105910 0x7f2e601a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:54.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e56000640 1 -- 172.21.15.110:0/2312276521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e60105910 msgr2=0x7f2e601a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:54.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e56000640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e60105910 0x7f2e601a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:54.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e56000640 1 -- 172.21.15.110:0/2312276521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e60103d60 msgr2=0x7f2e60199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:54.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e56000640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e60103d60 0x7f2e60199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:54.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.945+0000 7f2e56000640 1 -- 172.21.15.110:0/2312276521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e601a1bf0 con 0x7f2e60104f50 2024-09-12T02:14:54.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.946+0000 7f2e56000640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e60104f50 0x7f2e6019a510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800e9f0 tx=0x7f2e4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:54.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.946+0000 7f2e57e00640 1 -- 172.21.15.110:0/2312276521 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4800cd80 con 0x7f2e60104f50 2024-09-12T02:14:54.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.946+0000 7f2e57e00640 1 -- 172.21.15.110:0/2312276521 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e48010910 con 0x7f2e60104f50 2024-09-12T02:14:54.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.946+0000 7f2e65600640 1 -- 172.21.15.110:0/2312276521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e601a1ee0 con 0x7f2e60104f50 2024-09-12T02:14:54.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.946+0000 7f2e57e00640 1 -- 172.21.15.110:0/2312276521 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e48018990 con 0x7f2e60104f50 2024-09-12T02:14:54.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.946+0000 7f2e65600640 1 -- 172.21.15.110:0/2312276521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e601a23a0 con 0x7f2e60104f50 2024-09-12T02:14:54.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.947+0000 7f2e65600640 1 -- 172.21.15.110:0/2312276521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6010b020 con 0x7f2e60104f50 2024-09-12T02:14:54.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.949+0000 7f2e57e00640 1 -- 172.21.15.110:0/2312276521 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f2e48010ac0 con 0x7f2e60104f50 2024-09-12T02:14:54.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.950+0000 7f2e57e00640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e440a2c30 0x7f2e440a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:54.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.950+0000 7f2e57e00640 1 -- 172.21.15.110:0/2312276521 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f2e480cf760 con 0x7f2e60104f50 2024-09-12T02:14:54.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.951+0000 7f2e5ea00640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e440a2c30 0x7f2e440a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:54.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.951+0000 7f2e5ea00640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e440a2c30 0x7f2e440a50f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2e60104db0 tx=0x7f2e50009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:54.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:54.955+0000 7f2e57e00640 1 -- 172.21.15.110:0/2312276521 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e4809bc70 con 0x7f2e60104f50 2024-09-12T02:14:55.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:54 smithi115 ceph-mon[35351]: pgmap v391: 129 pgs: 129 active+clean; 644 KiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-12T02:14:55.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.177+0000 7f2e65600640 1 -- 172.21.15.110:0/2312276521 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f2e60062e90 con 0x7f2e60104f50 2024-09-12T02:14:55.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.554+0000 7f2e57e00640 1 -- 172.21.15.110:0/2312276521 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f2e4809ff70 con 0x7f2e60104f50 2024-09-12T02:14:55.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.556+0000 7f2e65600640 1 -- 172.21.15.110:0/2312276521 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e440a2c30 msgr2=0x7f2e440a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:55.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.556+0000 7f2e65600640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e440a2c30 0x7f2e440a50f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2e60104db0 tx=0x7f2e50009500 comp rx=0 tx=0).stop 2024-09-12T02:14:55.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.556+0000 7f2e65600640 1 -- 172.21.15.110:0/2312276521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e60104f50 msgr2=0x7f2e6019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:55.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.556+0000 7f2e65600640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e60104f50 0x7f2e6019a510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800e9f0 tx=0x7f2e4800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:14:55.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.557+0000 7f2e65600640 1 -- 172.21.15.110:0/2312276521 shutdown_connections 2024-09-12T02:14:55.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.557+0000 7f2e65600640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2e440a2c30 0x7f2e440a50f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:55.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.557+0000 7f2e65600640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e60105910 0x7f2e601a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:55.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.557+0000 7f2e65600640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e60104f50 0x7f2e6019a510 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:55.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.557+0000 7f2e65600640 1 --2- 172.21.15.110:0/2312276521 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2e60103d60 0x7f2e60199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:55.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.557+0000 7f2e65600640 1 -- 172.21.15.110:0/2312276521 >> 172.21.15.110:0/2312276521 conn(0x7f2e600ff4e0 msgr2=0x7f2e601081f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:55.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.557+0000 7f2e65600640 1 -- 172.21.15.110:0/2312276521 shutdown_connections 2024-09-12T02:14:55.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:55.557+0000 7f2e65600640 1 -- 172.21.15.110:0/2312276521 wait complete. 2024-09-12T02:14:55.580 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T02:14:55.595 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T02:14:55.595 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-12T02:14:55.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:14:55.595 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-09-12T02:14:55.634 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-12T02:14:55.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:14:55.635 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-12T02:14:55.650 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:55 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2312276521' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T02:14:55.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:14:55.713 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-09-12T02:14:55.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:55 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2312276521' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T02:14:55.909 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: ignoring --setuser ceph since I am not root 2024-09-12T02:14:55.909 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: ignoring --setgroup ceph since I am not root 2024-09-12T02:14:55.909 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:55 smithi136 ceph-mgr[37629]: -- 172.21.15.136:0/2997012795 <== mon.1 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b90f0870e0 con 0x55b90f065000 2024-09-12T02:14:55.909 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:55.711+0000 7fc46f534040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:14:55.909 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:55.769+0000 7fc46f534040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:14:55.912 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:55 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2312276521' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-12T02:14:55.912 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: ignoring --setuser ceph since I am not root 2024-09-12T02:14:55.912 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: ignoring --setgroup ceph since I am not root 2024-09-12T02:14:55.912 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:55 smithi115 ceph-mgr[36720]: -- 172.21.15.115:0/4261292772 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558f903a90e0 con 0x558f90387400 2024-09-12T02:14:55.912 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:55.707+0000 7f06c089c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:14:55.912 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:55.764+0000 7f06c089c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:14:55.913 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:55.912+0000 7f06c089c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:14:55.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:55 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: ignoring --setuser ceph since I am not root 2024-09-12T02:14:55.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:55 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: ignoring --setgroup ceph since I am not root 2024-09-12T02:14:55.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:55 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:55.814+0000 7efdf35dc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T02:14:55.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:55 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:55.887+0000 7efdf35dc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T02:14:56.111 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v1', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-09-12T02:14:56.111 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T02:14:56.111 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-12T02:14:56.111 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-12T02:14:56.111 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T02:14:56.265 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:55.978+0000 7f06c089c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:14:56.265 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:56.125+0000 7f06c089c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:14:56.265 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:56.265+0000 7f06c089c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:14:56.273 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:55.918+0000 7fc46f534040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:14:56.273 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:55.984+0000 7fc46f534040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:14:56.273 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:56.131+0000 7fc46f534040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:14:56.273 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:56.272+0000 7fc46f534040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:14:56.347 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:56 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:56.086+0000 7efdf35dc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T02:14:56.347 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:56 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:56.171+0000 7efdf35dc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T02:14:56.489 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:14:56.629 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:56 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2312276521' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T02:14:56.629 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:56 smithi110 ceph-mon[30548]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-12T02:14:56.630 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:56 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:56.346+0000 7efdf35dc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:14:56.630 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:56 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:56.526+0000 7efdf35dc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T02:14:56.824 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:56 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2312276521' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T02:14:56.825 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:56 smithi115 ceph-mon[35351]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-12T02:14:56.825 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:56.579+0000 7f06c089c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:14:56.825 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:56.640+0000 7f06c089c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:14:56.825 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:56.824+0000 7f06c089c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:14:56.834 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:56 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2312276521' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-12T02:14:56.834 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:56 smithi136 ceph-mon[35814]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-12T02:14:56.834 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:56.588+0000 7fc46f534040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:14:56.834 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:56.649+0000 7fc46f534040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:14:56.834 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:56.833+0000 7fc46f534040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:14:57.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.114+0000 7f2b57c00640 1 -- 172.21.15.110:0/4018262990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b50104010 msgr2=0x7f2b501043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:57.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.114+0000 7f2b57c00640 1 --2- 172.21.15.110:0/4018262990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b50104010 0x7f2b501043f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009860 tx=0x7f2b4402a340 comp rx=0 tx=0).stop 2024-09-12T02:14:57.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.114+0000 7f2b57c00640 1 -- 172.21.15.110:0/4018262990 shutdown_connections 2024-09-12T02:14:57.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.114+0000 7f2b57c00640 1 --2- 172.21.15.110:0/4018262990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50109140 0x7f2b50110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:57.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.114+0000 7f2b57c00640 1 --2- 172.21.15.110:0/4018262990 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b501049c0 0x7f2b50108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:57.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.114+0000 7f2b57c00640 1 --2- 172.21.15.110:0/4018262990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b50104010 0x7f2b501043f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:57.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.114+0000 7f2b57c00640 1 -- 172.21.15.110:0/4018262990 >> 172.21.15.110:0/4018262990 conn(0x7f2b500ffa50 msgr2=0x7f2b50101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:57.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.114+0000 7f2b57c00640 1 -- 172.21.15.110:0/4018262990 shutdown_connections 2024-09-12T02:14:57.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.114+0000 7f2b57c00640 1 -- 172.21.15.110:0/4018262990 wait complete. 2024-09-12T02:14:57.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.115+0000 7f2b57c00640 1 Processor -- start 2024-09-12T02:14:57.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.115+0000 7f2b57c00640 1 -- start start 2024-09-12T02:14:57.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b57c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b50104010 0x7f2b5019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:57.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b57c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b501049c0 0x7f2b5019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:57.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b57c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50109140 0x7f2b5019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:57.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b57c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50114140 con 0x7f2b50104010 2024-09-12T02:14:57.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b57c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50113fc0 con 0x7f2b501049c0 2024-09-12T02:14:57.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b57c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501142c0 con 0x7f2b50109140 2024-09-12T02:14:57.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b55c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50109140 0x7f2b5019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:57.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b55200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b50104010 0x7f2b5019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b4fe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b501049c0 0x7f2b5019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b55c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50109140 0x7f2b5019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:38928/0 (socket says 172.21.15.110:38928) 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b55c00640 1 -- 172.21.15.110:0/431442986 learned_addr learned my addr 172.21.15.110:0/431442986 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b55c00640 1 -- 172.21.15.110:0/431442986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b501049c0 msgr2=0x7f2b5019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b55c00640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b501049c0 0x7f2b5019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b55c00640 1 -- 172.21.15.110:0/431442986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b50104010 msgr2=0x7f2b5019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b55c00640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b50104010 0x7f2b5019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b55c00640 1 -- 172.21.15.110:0/431442986 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5019f5b0 con 0x7f2b50109140 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b4fe00640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b501049c0 0x7f2b5019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.116+0000 7f2b55200640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b50104010 0x7f2b5019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.117+0000 7f2b55c00640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50109140 0x7f2b5019eed0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009fd0 tx=0x7f2b4800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.117+0000 7f2b4d600640 1 -- 172.21.15.110:0/431442986 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b48004b20 con 0x7f2b50109140 2024-09-12T02:14:57.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.117+0000 7f2b57c00640 1 -- 172.21.15.110:0/431442986 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5019f8a0 con 0x7f2b50109140 2024-09-12T02:14:57.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.117+0000 7f2b4d600640 1 -- 172.21.15.110:0/431442986 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b48003e50 con 0x7f2b50109140 2024-09-12T02:14:57.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.117+0000 7f2b4d600640 1 -- 172.21.15.110:0/431442986 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800b630 con 0x7f2b50109140 2024-09-12T02:14:57.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.117+0000 7f2b57c00640 1 -- 172.21.15.110:0/431442986 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b501a7180 con 0x7f2b50109140 2024-09-12T02:14:57.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.118+0000 7f2b57c00640 1 -- 172.21.15.110:0/431442986 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b501043f0 con 0x7f2b50109140 2024-09-12T02:14:57.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.120+0000 7f2b4d600640 1 -- 172.21.15.110:0/431442986 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7f2b4801d020 con 0x7f2b50109140 2024-09-12T02:14:57.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.121+0000 7f2b4d600640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2b380a2bd0 0x7f2b380a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:14:57.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.121+0000 7f2b55200640 1 -- 172.21.15.110:0/431442986 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2b380a2bd0 msgr2=0x7f2b380a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/511769794 2024-09-12T02:14:57.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.121+0000 7f2b4d600640 1 -- 172.21.15.110:0/431442986 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f2b480cf3f0 con 0x7f2b50109140 2024-09-12T02:14:57.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.121+0000 7f2b55200640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2b380a2bd0 0x7f2b380a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:14:57.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.125+0000 7f2b4d600640 1 -- 172.21.15.110:0/431442986 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2b4809bf50 con 0x7f2b50109140 2024-09-12T02:14:57.186 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:56 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:56.900+0000 7efdf35dc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T02:14:57.186 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:56 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:56.971+0000 7efdf35dc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T02:14:57.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.322+0000 7f2b55200640 1 -- 172.21.15.110:0/431442986 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2b380a2bd0 msgr2=0x7f2b380a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/511769794 2024-09-12T02:14:57.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.322+0000 7f2b55200640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2b380a2bd0 0x7f2b380a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:14:57.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.342+0000 7f2b57c00640 1 -- 172.21.15.110:0/431442986 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2b5010c320 con 0x7f2b50109140 2024-09-12T02:14:57.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.342+0000 7f2b4d600640 1 -- 172.21.15.110:0/431442986 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+88 (secure 0 0 0) 0x7f2b4809b850 con 0x7f2b50109140 2024-09-12T02:14:57.343 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-12T02:14:57.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.345+0000 7f2b57c00640 1 -- 172.21.15.110:0/431442986 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2b380a2bd0 msgr2=0x7f2b380a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:14:57.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.345+0000 7f2b57c00640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2b380a2bd0 0x7f2b380a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:57.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.345+0000 7f2b57c00640 1 -- 172.21.15.110:0/431442986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50109140 msgr2=0x7f2b5019eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:14:57.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.345+0000 7f2b57c00640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50109140 0x7f2b5019eed0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009fd0 tx=0x7f2b4800c800 comp rx=0 tx=0).stop 2024-09-12T02:14:57.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.345+0000 7f2b57c00640 1 -- 172.21.15.110:0/431442986 shutdown_connections 2024-09-12T02:14:57.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.345+0000 7f2b57c00640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f2b380a2bd0 0x7f2b380a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:57.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.345+0000 7f2b57c00640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b50109140 0x7f2b5019eed0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:57.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.345+0000 7f2b57c00640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2b501049c0 0x7f2b5019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:57.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.345+0000 7f2b57c00640 1 --2- 172.21.15.110:0/431442986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b50104010 0x7f2b5019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:14:57.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.345+0000 7f2b57c00640 1 -- 172.21.15.110:0/431442986 >> 172.21.15.110:0/431442986 conn(0x7f2b500ffa50 msgr2=0x7f2b50100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:14:57.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.345+0000 7f2b57c00640 1 -- 172.21.15.110:0/431442986 shutdown_connections 2024-09-12T02:14:57.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:57.345+0000 7f2b57c00640 1 -- 172.21.15.110:0/431442986 wait complete. 2024-09-12T02:14:57.557 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:57 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:57.192+0000 7efdf35dc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T02:14:57.860 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:14:57 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/431442986' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:14:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:14:57 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/431442986' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:14:57.908 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:57 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:57.721+0000 7fc46f534040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:14:57.909 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:57 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:57.789+0000 7fc46f534040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:14:58.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:14:57 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/431442986' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T02:14:58.044 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:57 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:57.705+0000 7f06c089c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:14:58.045 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:57 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:57.773+0000 7f06c089c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:14:58.422 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T02:14:58.422 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T02:14:58.422 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-09-12T02:14:58.423 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T02:14:58.423 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-12T02:14:58.423 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T02:14:58.423 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T02:14:58.423 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T02:14:58.423 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-12T02:14:58.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:14:58.423 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-09-12T02:14:58.460 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T02:14:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T02:14:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T02:14:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:14:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-09-12T02:14:58.460 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:14:58.460 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42053sec preferred_lft 42053sec 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link noprefixroute 2024-09-12T02:14:58.461 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-09-12T02:14:58.462 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T02:14:58.462 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:14:58.462 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-12T02:14:58.462 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2024-09-12T02:14:58.462 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2024-09-12T02:14:58.462 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2024-09-12T02:14:58.462 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T02:14:58.462 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-12T02:14:58.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:14:58.596 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:58 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:58.310+0000 7efdf35dc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T02:14:58.596 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:58 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:58.394+0000 7efdf35dc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T02:14:58.631 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:58.509+0000 7f06c089c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:14:58.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:14:58.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:14:58.689 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T02:14:58.744 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-09-12T02:14:58.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:14:58.747 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-09-12T02:14:58.762 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:58.501+0000 7fc46f534040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:14:58.762 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:58.617+0000 7fc46f534040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:14:58.784 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-09-12T02:14:58.784 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T02:14:58.785 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T02:14:58.785 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T02:14:58.785 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T02:14:58.785 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:14:58.785 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-12T02:14:58.785 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T02:14:58.785 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T02:14:58.785 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T02:14:58.785 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-12T02:14:58.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:14:58.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:14:58.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:14:58.990 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-09-12T02:14:58.998 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:58.631+0000 7f06c089c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:14:58.998 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:58.779+0000 7f06c089c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:14:58.998 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:58.843+0000 7f06c089c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:14:58.999 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:58.998+0000 7f06c089c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:14:59.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:14:59.026 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2024-09-12T02:14:59.045 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:58.762+0000 7fc46f534040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:14:59.045 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:58.824+0000 7fc46f534040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:14:59.045 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:58.976+0000 7fc46f534040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:14:59.045 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:59.045+0000 7fc46f534040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:14:59.101 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:14:59.101 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-12T02:14:59.101 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-12T02:14:59.101 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-12T02:14:59.101 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-12T02:14:59.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:14:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:14:59.281 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-12T02:14:59.282 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:14:59.282 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-12T02:14:59.282 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-12T02:14:59.282 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T02:14:59.282 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-12T02:14:59.282 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-12T02:14:59.282 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-12T02:14:59.282 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-12T02:14:59.294 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:59.069+0000 7f06c089c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:14:59.294 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:59.132+0000 7f06c089c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:14:59.329 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:59.105+0000 7fc46f534040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:14:59.329 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:59.263+0000 7fc46f534040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:14:59.329 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:59.329+0000 7fc46f534040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:14:59.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:14:59.488 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:59 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:59.365+0000 7efdf35dc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T02:14:59.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:14:59.506 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T02:14:59.506 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-09-12T02:14:59.506 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-09-12T02:14:59.506 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T02:14:59.506 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-09-12T02:14:59.574 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:59.298+0000 7f06c089c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:14:59.575 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:59.366+0000 7f06c089c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:14:59.575 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:59.432+0000 7f06c089c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:14:59.575 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:59.515+0000 7f06c089c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:14:59.575 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:59.574+0000 7f06c089c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:14:59.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:14:59.598 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:59.396+0000 7fc46f534040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:14:59.598 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:59.479+0000 7fc46f534040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:14:59.598 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:59.539+0000 7fc46f534040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:14:59.598 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:14:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:14:59.598+0000 7fc46f534040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:14:59.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:14:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:14:59.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:14:59.701 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /tmp/cephfs 2024-09-12T02:14:59.737 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-12T02:14:59.737 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T02:14:59.737 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /tmp/cephfs 2024-09-12T02:14:59.772 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:59 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:59.517+0000 7efdf35dc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T02:14:59.773 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:59 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:59.695+0000 7efdf35dc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T02:14:59.810 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-12T02:14:59.810 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-12T02:14:59.810 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/0726ba32-b748-40d8-bb38-f69cc5a7bd4b 2024-09-12T02:14:59.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:14:59.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/0726ba32-b748-40d8-bb38-f69cc5a7bd4b /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,context=system_u:object_r:postgresql_db_t:s0 2024-09-12T02:14:59.939 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0" 2024-09-12T02:14:59.939 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-12T02:14:59.939 INFO:teuthology.orchestra.run.smithi110.stdout:invalid new device string format 2024-09-12T02:15:00.038 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:59 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:59.772+0000 7efdf35dc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T02:15:00.038 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:14:59 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:14:59.951+0000 7efdf35dc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T02:15:00.038 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:00.036+0000 7efdf35dc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T02:15:00.044 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:14:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:14:59.634+0000 7f06c089c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:15:00.297 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:00.110+0000 7efdf35dc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T02:15:00.563 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:00.296+0000 7efdf35dc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T02:15:00.564 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:00.378+0000 7efdf35dc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T02:15:00.564 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:00.463+0000 7efdf35dc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T02:15:00.564 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:00.563+0000 7efdf35dc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T02:15:00.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-mon[30548]: Standby manager daemon z restarted 2024-09-12T02:15:00.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-mon[30548]: Standby manager daemon z started 2024-09-12T02:15:00.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.136:0/1765945647' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:15:00.564 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.136:0/1765945647' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:15:00.565 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.136:0/1765945647' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:15:00.565 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.136:0/1765945647' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:15:00.565 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-mon[30548]: Standby manager daemon y restarted 2024-09-12T02:15:00.565 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-mon[30548]: Standby manager daemon y started 2024-09-12T02:15:00.565 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.115:0/1953316102' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:15:00.565 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.115:0/1953316102' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:15:00.565 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.115:0/1953316102' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:15:00.565 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-mon[30548]: from='mgr.? 172.21.15.115:0/1953316102' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:15:00.593 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0" 2024-09-12T02:15:00.593 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-09-12T02:15:00.593 INFO:teuthology.orchestra.run.smithi110.stdout:invalid new device string format 2024-09-12T02:15:00.593 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.110:6789,172.21.15.115:6789,172.21.15.136:6789" 2024-09-12T02:15:00.593 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.110:6789,172.21.15.115:6789,172.21.15.136:6789:/volumes/qa/sv_1/0726ba32-b748-40d8-bb38-f69cc5a7bd4b 2024-09-12T02:15:00.594 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,context="system_u:object_r:postgresql_db_t:s0",key=0,fsid=10ead734-70ab-11ef-bcea-c7b262605968" will pass to kernel 2024-09-12T02:15:00.599 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T02:15:00.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:15:00.599 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /tmp/cephfs 2024-09-12T02:15:00.658 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z[37625]: 2024-09-12T02:15:00.392+0000 7fc46f534040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:15:00.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-mon[35814]: Standby manager daemon z restarted 2024-09-12T02:15:00.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-mon[35814]: Standby manager daemon z started 2024-09-12T02:15:00.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.136:0/1765945647' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:15:00.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.136:0/1765945647' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:15:00.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.136:0/1765945647' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:15:00.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.136:0/1765945647' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:15:00.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-mon[35814]: Standby manager daemon y restarted 2024-09-12T02:15:00.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-mon[35814]: Standby manager daemon y started 2024-09-12T02:15:00.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.115:0/1953316102' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:15:00.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.115:0/1953316102' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:15:00.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.115:0/1953316102' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:15:00.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:00 smithi136 ceph-mon[35814]: from='mgr.? 172.21.15.115:0/1953316102' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:15:00.661 DEBUG:teuthology.orchestra.run.smithi110:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:15:00.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:15:00.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:15:00.758 INFO:teuthology.orchestra.run.smithi110.stdout:client25171 2024-09-12T02:15:00.758 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:15:00.758 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:15:00.795 DEBUG:teuthology.orchestra.run.smithi110:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:15:00.796 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y[36716]: 2024-09-12T02:15:00.428+0000 7f06c089c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:15:00.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-mon[35351]: Standby manager daemon z restarted 2024-09-12T02:15:00.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-mon[35351]: Standby manager daemon z started 2024-09-12T02:15:00.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.136:0/1765945647' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-12T02:15:00.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.136:0/1765945647' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:15:00.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.136:0/1765945647' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-12T02:15:00.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.136:0/1765945647' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:15:00.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-mon[35351]: Standby manager daemon y restarted 2024-09-12T02:15:00.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-mon[35351]: Standby manager daemon y started 2024-09-12T02:15:00.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.115:0/1953316102' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-12T02:15:00.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.115:0/1953316102' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T02:15:00.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.115:0/1953316102' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-12T02:15:00.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:00 smithi115 ceph-mon[35351]: from='mgr.? 172.21.15.115:0/1953316102' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T02:15:00.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:15:00.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:15:00.927 INFO:teuthology.orchestra.run.smithi110.stdout:client25171 2024-09-12T02:15:00.927 DEBUG:teuthology.orchestra.run.smithi110:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T02:15:00.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:00.640+0000 7efdf35dc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T02:15:00.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:00.720+0000 7efdf35dc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T02:15:01.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T02:15:01.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:15:01.017 INFO:teuthology.orchestra.run.smithi110.stdout:client25171 2024-09-12T02:15:01.018 DEBUG:teuthology.orchestra.run.smithi110:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/10ead734-70ab-11ef-bcea-c7b262605968.client25171/status') 2024-09-12T02:15:01.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T02:15:01.158 INFO:teuthology.orchestra.run.smithi110.stdout:instance: client.25171 (3)172.21.15.110:0/1167261615 2024-09-12T02:15:01.159 INFO:teuthology.orchestra.run.smithi110.stdout:blocklisted: false 2024-09-12T02:15:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:0+1 records in 2024-09-12T02:15:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:0+1 records out 2024-09-12T02:15:01.159 INFO:teuthology.orchestra.run.smithi110.stderr:72 bytes copied, 5.6742e-05 s, 1.3 MB/s 2024-09-12T02:15:01.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T02:15:01.170 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T02:15:01.181 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:15:01.181 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T02:15:01.181 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-12T02:15:01.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.336+0000 7f95f2e00640 1 -- 172.21.15.110:0/3845608256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec101b60 msgr2=0x7f95ec101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:01.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.336+0000 7f95f2e00640 1 --2- 172.21.15.110:0/3845608256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec101b60 0x7f95ec101f60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009860 tx=0x7f95dc02a340 comp rx=0 tx=0).stop 2024-09-12T02:15:01.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.336+0000 7f95f2e00640 1 -- 172.21.15.110:0/3845608256 shutdown_connections 2024-09-12T02:15:01.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.336+0000 7f95f2e00640 1 --2- 172.21.15.110:0/3845608256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec103710 0x7f95ec109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:01.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.336+0000 7f95f2e00640 1 --2- 172.21.15.110:0/3845608256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95ec102d50 0x7f95ec1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:01.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.336+0000 7f95f2e00640 1 --2- 172.21.15.110:0/3845608256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec101b60 0x7f95ec101f60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:01.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.336+0000 7f95f2e00640 1 -- 172.21.15.110:0/3845608256 >> 172.21.15.110:0/3845608256 conn(0x7f95ec0fd2e0 msgr2=0x7f95ec0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:01.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.336+0000 7f95f2e00640 1 -- 172.21.15.110:0/3845608256 shutdown_connections 2024-09-12T02:15:01.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.337+0000 7f95f2e00640 1 -- 172.21.15.110:0/3845608256 wait complete. 2024-09-12T02:15:01.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.337+0000 7f95f2e00640 1 Processor -- start 2024-09-12T02:15:01.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.338+0000 7f95f2e00640 1 -- start start 2024-09-12T02:15:01.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.338+0000 7f95f2e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec101b60 0x7f95ec075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:01.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.338+0000 7f95f2e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95ec102d50 0x7f95ec0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:01.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.338+0000 7f95f2e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec103710 0x7f95ec074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:01.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.338+0000 7f95f2e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec10d7e0 con 0x7f95ec102d50 2024-09-12T02:15:01.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.338+0000 7f95f2e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec10d660 con 0x7f95ec103710 2024-09-12T02:15:01.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.338+0000 7f95f2e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f95ec10d960 con 0x7f95ec101b60 2024-09-12T02:15:01.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.338+0000 7f95eb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95ec102d50 0x7f95ec0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:01.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.338+0000 7f95eb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95ec102d50 0x7f95ec0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42602/0 (socket says 172.21.15.110:42602) 2024-09-12T02:15:01.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.338+0000 7f95eb400640 1 -- 172.21.15.110:0/2241852366 learned_addr learned my addr 172.21.15.110:0/2241852366 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:15:01.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.338+0000 7f95ebe00640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec101b60 0x7f95ec075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:01.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.338+0000 7f95f0e00640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec103710 0x7f95ec074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:01.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.339+0000 7f95ebe00640 1 -- 172.21.15.110:0/2241852366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec103710 msgr2=0x7f95ec074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:01.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.339+0000 7f95ebe00640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec103710 0x7f95ec074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:01.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.339+0000 7f95ebe00640 1 -- 172.21.15.110:0/2241852366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95ec102d50 msgr2=0x7f95ec0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:01.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.339+0000 7f95ebe00640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95ec102d50 0x7f95ec0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:01.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.339+0000 7f95ebe00640 1 -- 172.21.15.110:0/2241852366 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ec0753b0 con 0x7f95ec101b60 2024-09-12T02:15:01.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.339+0000 7f95eb400640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95ec102d50 0x7f95ec0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:15:01.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.339+0000 7f95ebe00640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec101b60 0x7f95ec075fa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f95dc035040 tx=0x7f95dc033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:01.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.339+0000 7f95e8c00640 1 -- 172.21.15.110:0/2241852366 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc037040 con 0x7f95ec101b60 2024-09-12T02:15:01.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.339+0000 7f95f2e00640 1 -- 172.21.15.110:0/2241852366 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ec1a1e90 con 0x7f95ec101b60 2024-09-12T02:15:01.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.339+0000 7f95e8c00640 1 -- 172.21.15.110:0/2241852366 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95dc004040 con 0x7f95ec101b60 2024-09-12T02:15:01.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.339+0000 7f95e8c00640 1 -- 172.21.15.110:0/2241852366 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0055c0 con 0x7f95ec101b60 2024-09-12T02:15:01.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.339+0000 7f95f2e00640 1 -- 172.21.15.110:0/2241852366 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ec1a22a0 con 0x7f95ec101b60 2024-09-12T02:15:01.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.340+0000 7f95f2e00640 1 -- 172.21.15.110:0/2241852366 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ec108f00 con 0x7f95ec101b60 2024-09-12T02:15:01.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.343+0000 7f95e8c00640 1 -- 172.21.15.110:0/2241852366 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 20) ==== 137851+0+0 (secure 0 0 0) 0x7f95dc042020 con 0x7f95ec101b60 2024-09-12T02:15:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.344+0000 7f95e8c00640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f95d00a2c80 0x7f95d00a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.344+0000 7f95eb400640 1 -- 172.21.15.110:0/2241852366 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f95d00a2c80 msgr2=0x7f95d00a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/511769794 2024-09-12T02:15:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.344+0000 7f95e8c00640 1 -- 172.21.15.110:0/2241852366 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9158+0+0 (secure 0 0 0) 0x7f95dc0ef230 con 0x7f95ec101b60 2024-09-12T02:15:01.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.344+0000 7f95eb400640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f95d00a2c80 0x7f95d00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T02:15:01.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.346+0000 7f95e8c00640 1 -- 172.21.15.110:0/2241852366 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95dc049020 con 0x7f95ec101b60 2024-09-12T02:15:01.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.545+0000 7f95eb400640 1 -- 172.21.15.110:0/2241852366 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f95d00a2c80 msgr2=0x7f95d00a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6800/511769794 2024-09-12T02:15:01.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.545+0000 7f95eb400640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f95d00a2c80 0x7f95d00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T02:15:01.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.567+0000 7f95f2e00640 1 -- 172.21.15.110:0/2241852366 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f95ec02d7c0 con 0x7f95ec101b60 2024-09-12T02:15:01.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.697+0000 7f95e8c00640 1 -- 172.21.15.110:0/2241852366 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mgrmap(e 21) ==== 137518+0+0 (secure 0 0 0) 0x7f95dc0041f0 con 0x7f95ec101b60 2024-09-12T02:15:01.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.697+0000 7f95e8c00640 1 -- 172.21.15.110:0/2241852366 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f95d00a2c80 msgr2=0x7f95d00a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T02:15:01.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:01.697+0000 7f95e8c00640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f95d00a2c80 0x7f95d00a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:01 smithi115 ceph-mon[35351]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-09-12T02:15:01.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:01 smithi136 ceph-mon[35814]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-09-12T02:15:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:01 smithi110 ceph-mon[30548]: mgrmap e20: x(active, since 10m), standbys: y, z 2024-09-12T02:15:01.938 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:01.677+0000 7efdf35dc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T02:15:02.436 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:01.982+0000 7efd4bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:15:02.437 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:01.982+0000 7efd4bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:15:02.437 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:01.982+0000 7efd4bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:15:02.437 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:01.982+0000 7efd4bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:15:02.437 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:01.982+0000 7efd4bc00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:15:02.437 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:01.983+0000 7efd4da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:15:02.437 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:01.983+0000 7efd4da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:15:02.437 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:01.983+0000 7efd4da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:15:02.437 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:01.983+0000 7efd4da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:15:02.437 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:01.983+0000 7efd4da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:15:02.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.477+0000 7f95e8c00640 1 -- 172.21.15.110:0/2241852366 <== mon.1 v2:172.21.15.136:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7f95dc0bbd90 con 0x7f95ec101b60 2024-09-12T02:15:02.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.481+0000 7f95f2e00640 1 -- 172.21.15.110:0/2241852366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec101b60 msgr2=0x7f95ec075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:02.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.481+0000 7f95f2e00640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec101b60 0x7f95ec075fa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f95dc035040 tx=0x7f95dc033d90 comp rx=0 tx=0).stop 2024-09-12T02:15:02.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.481+0000 7f95f2e00640 1 -- 172.21.15.110:0/2241852366 shutdown_connections 2024-09-12T02:15:02.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.481+0000 7f95f2e00640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.110:6800/511769794,v1:172.21.15.110:6801/511769794] conn(0x7f95d00a2c80 0x7f95d00a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.481+0000 7f95f2e00640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f95ec103710 0x7f95ec074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.481+0000 7f95f2e00640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95ec102d50 0x7f95ec0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.481+0000 7f95f2e00640 1 --2- 172.21.15.110:0/2241852366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95ec101b60 0x7f95ec075fa0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.481+0000 7f95f2e00640 1 -- 172.21.15.110:0/2241852366 >> 172.21.15.110:0/2241852366 conn(0x7f95ec0fd2e0 msgr2=0x7f95ec1060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:02.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.481+0000 7f95f2e00640 1 -- 172.21.15.110:0/2241852366 shutdown_connections 2024-09-12T02:15:02.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.481+0000 7f95f2e00640 1 -- 172.21.15.110:0/2241852366 wait complete. 2024-09-12T02:15:02.507 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-12T02:15:02.522 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T02:15:02.540 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:15:02.540 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T02:15:02.540 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-12T02:15:02.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.710+0000 7fda7ce00640 1 -- 172.21.15.110:0/2411703191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda781056b0 msgr2=0x7fda78105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:02.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.710+0000 7fda7ce00640 1 --2- 172.21.15.110:0/2411703191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda781056b0 0x7fda78105b60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda70009be0 tx=0x7fda7002a6c0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.710+0000 7fda7ce00640 1 -- 172.21.15.110:0/2411703191 shutdown_connections 2024-09-12T02:15:02.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.710+0000 7fda7ce00640 1 --2- 172.21.15.110:0/2411703191 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda781056b0 0x7fda78105b60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.710+0000 7fda7ce00640 1 --2- 172.21.15.110:0/2411703191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda78102d00 0x7fda78105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.710+0000 7fda7ce00640 1 --2- 172.21.15.110:0/2411703191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda781003b0 0x7fda781027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.710+0000 7fda7ce00640 1 -- 172.21.15.110:0/2411703191 >> 172.21.15.110:0/2411703191 conn(0x7fda780fc1e0 msgr2=0x7fda780fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:02.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.711+0000 7fda7ce00640 1 -- 172.21.15.110:0/2411703191 shutdown_connections 2024-09-12T02:15:02.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.711+0000 7fda7ce00640 1 -- 172.21.15.110:0/2411703191 wait complete. 2024-09-12T02:15:02.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.713+0000 7fda7ce00640 1 Processor -- start 2024-09-12T02:15:02.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.713+0000 7fda7ce00640 1 -- start start 2024-09-12T02:15:02.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.714+0000 7fda7ce00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda781003b0 0x7fda7819e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:02.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.714+0000 7fda7ce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda78102d00 0x7fda7819e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:02.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.714+0000 7fda7ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda781056b0 0x7fda781a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:02.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.714+0000 7fda7ce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fda78113df0 con 0x7fda781056b0 2024-09-12T02:15:02.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.714+0000 7fda7ce00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fda78113c70 con 0x7fda781003b0 2024-09-12T02:15:02.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.714+0000 7fda7ce00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fda78113f70 con 0x7fda78102d00 2024-09-12T02:15:02.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.714+0000 7fda75400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda78102d00 0x7fda7819e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:02.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.714+0000 7fda75400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda78102d00 0x7fda7819e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:58592/0 (socket says 172.21.15.110:58592) 2024-09-12T02:15:02.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.714+0000 7fda75400640 1 -- 172.21.15.110:0/778862720 learned_addr learned my addr 172.21.15.110:0/778862720 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:15:02.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.714+0000 7fda76800640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda781056b0 0x7fda781a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:02.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.715+0000 7fda75400640 1 -- 172.21.15.110:0/778862720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda781003b0 msgr2=0x7fda7819e3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T02:15:02.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.715+0000 7fda75400640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda781003b0 0x7fda7819e3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.715+0000 7fda75400640 1 -- 172.21.15.110:0/778862720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda781056b0 msgr2=0x7fda781a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:02.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.715+0000 7fda75400640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda781056b0 0x7fda781a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.715+0000 7fda75400640 1 -- 172.21.15.110:0/778862720 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda781a6000 con 0x7fda78102d00 2024-09-12T02:15:02.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.715+0000 7fda76800640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda781056b0 0x7fda781a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:15:02.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.715+0000 7fda75400640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda78102d00 0x7fda7819e920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda6400d950 tx=0x7fda6400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:02.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.716+0000 7fda6ea00640 1 -- 172.21.15.110:0/778862720 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64017070 con 0x7fda78102d00 2024-09-12T02:15:02.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.716+0000 7fda6ea00640 1 -- 172.21.15.110:0/778862720 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda64009c30 con 0x7fda78102d00 2024-09-12T02:15:02.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.716+0000 7fda6ea00640 1 -- 172.21.15.110:0/778862720 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6400f6b0 con 0x7fda78102d00 2024-09-12T02:15:02.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.716+0000 7fda7ce00640 1 -- 172.21.15.110:0/778862720 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda781a62f0 con 0x7fda78102d00 2024-09-12T02:15:02.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.716+0000 7fda7ce00640 1 -- 172.21.15.110:0/778862720 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda781a67f0 con 0x7fda78102d00 2024-09-12T02:15:02.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.719+0000 7fda7ce00640 1 -- 172.21.15.110:0/778862720 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda580052c0 con 0x7fda78102d00 2024-09-12T02:15:02.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.724+0000 7fda6ea00640 1 -- 172.21.15.110:0/778862720 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7fda64004020 con 0x7fda78102d00 2024-09-12T02:15:02.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.725+0000 7fda6ea00640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fda5c0a2b10 0x7fda5c0a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:02.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.726+0000 7fda6ea00640 1 -- 172.21.15.110:0/778862720 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9416+0+0 (secure 0 0 0) 0x7fda640ce8d0 con 0x7fda78102d00 2024-09-12T02:15:02.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.726+0000 7fda75e00640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fda5c0a2b10 0x7fda5c0a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:02.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.726+0000 7fda6ea00640 1 -- 172.21.15.110:0/778862720 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda640fd250 con 0x7fda78102d00 2024-09-12T02:15:02.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.726+0000 7fda75e00640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fda5c0a2b10 0x7fda5c0a4fd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fda680096c0 tx=0x7fda68009260 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:02.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2241852366' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:15:02.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:15:02.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: Active manager daemon x restarted 2024-09-12T02:15:02.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: Activating manager daemon x 2024-09-12T02:15:02.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: osdmap e98: 12 total, 12 up, 12 in 2024-09-12T02:15:02.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: mgrmap e21: x(active, starting, since 0.0121478s), standbys: y, z 2024-09-12T02:15:02.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:15:02.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:15:02.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:15:02.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:15:02.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:15:02.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:15:02.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:15:02.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:15:02.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:15:02.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: Manager daemon x is now available 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:15:02.798 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:15:02.799 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:02 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:15:02.879 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2241852366' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:15:02.879 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:15:02.879 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: Active manager daemon x restarted 2024-09-12T02:15:02.879 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: Activating manager daemon x 2024-09-12T02:15:02.879 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: osdmap e98: 12 total, 12 up, 12 in 2024-09-12T02:15:02.879 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: mgrmap e21: x(active, starting, since 0.0121478s), standbys: y, z 2024-09-12T02:15:02.879 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:15:02.879 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:15:02.879 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:15:02.879 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:15:02.880 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:15:02.881 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:15:02.882 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:15:02.882 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:15:02.882 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:15:02.882 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: Manager daemon x is now available 2024-09-12T02:15:02.882 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:15:02.882 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:15:02.882 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:02 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:15:02.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.921+0000 7fda7ce00640 1 -- 172.21.15.110:0/778862720 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fda580055b0 con 0x7fda78102d00 2024-09-12T02:15:02.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.927+0000 7fda6ea00640 1 -- 172.21.15.110:0/778862720 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v30)=0 v30) ==== 129+0+0 (secure 0 0 0) 0x7fda6409b700 con 0x7fda78102d00 2024-09-12T02:15:02.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.929+0000 7fda7ce00640 1 -- 172.21.15.110:0/778862720 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fda5c0a2b10 msgr2=0x7fda5c0a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:02.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.929+0000 7fda7ce00640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fda5c0a2b10 0x7fda5c0a4fd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fda680096c0 tx=0x7fda68009260 comp rx=0 tx=0).stop 2024-09-12T02:15:02.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.929+0000 7fda7ce00640 1 -- 172.21.15.110:0/778862720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda78102d00 msgr2=0x7fda7819e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:02.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.929+0000 7fda7ce00640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda78102d00 0x7fda7819e920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fda6400d950 tx=0x7fda6400de10 comp rx=0 tx=0).stop 2024-09-12T02:15:02.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.929+0000 7fda7ce00640 1 -- 172.21.15.110:0/778862720 shutdown_connections 2024-09-12T02:15:02.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.930+0000 7fda7ce00640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fda5c0a2b10 0x7fda5c0a4fd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.930+0000 7fda7ce00640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda781056b0 0x7fda781a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.930+0000 7fda7ce00640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fda78102d00 0x7fda7819e920 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.930+0000 7fda7ce00640 1 --2- 172.21.15.110:0/778862720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda781003b0 0x7fda7819e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:02.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.930+0000 7fda7ce00640 1 -- 172.21.15.110:0/778862720 >> 172.21.15.110:0/778862720 conn(0x7fda780fc1e0 msgr2=0x7fda78100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:02.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.930+0000 7fda7ce00640 1 -- 172.21.15.110:0/778862720 shutdown_connections 2024-09-12T02:15:02.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:02.930+0000 7fda7ce00640 1 -- 172.21.15.110:0/778862720 wait complete. 2024-09-12T02:15:02.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2241852366' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:15:02.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-12T02:15:02.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: Active manager daemon x restarted 2024-09-12T02:15:02.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: Activating manager daemon x 2024-09-12T02:15:02.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: osdmap e98: 12 total, 12 up, 12 in 2024-09-12T02:15:02.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: mgrmap e21: x(active, starting, since 0.0121478s), standbys: y, z 2024-09-12T02:15:02.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:15:02.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:15:02.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:15:02.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-12T02:15:02.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-12T02:15:02.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-12T02:15:02.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T02:15:02.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T02:15:02.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T02:15:02.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T02:15:02.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T02:15:02.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T02:15:02.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-12T02:15:02.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-12T02:15:02.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-12T02:15:02.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-12T02:15:02.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-12T02:15:02.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-12T02:15:02.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T02:15:02.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T02:15:02.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T02:15:02.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: Manager daemon x is now available 2024-09-12T02:15:02.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:15:02.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-12T02:15:02.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:02 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-12T02:15:02.948 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-12T02:15:03.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.103+0000 7fec14c00640 1 -- 172.21.15.110:0/585285317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10101b60 msgr2=0x7fec10101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.103+0000 7fec14c00640 1 --2- 172.21.15.110:0/585285317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10101b60 0x7fec10101f60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fec00009900 tx=0x7fec0002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.104+0000 7fec14c00640 1 -- 172.21.15.110:0/585285317 shutdown_connections 2024-09-12T02:15:03.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.104+0000 7fec14c00640 1 --2- 172.21.15.110:0/585285317 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec10103710 0x7fec10109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.104+0000 7fec14c00640 1 --2- 172.21.15.110:0/585285317 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec10102d50 0x7fec101031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.104+0000 7fec14c00640 1 --2- 172.21.15.110:0/585285317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10101b60 0x7fec10101f60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.104+0000 7fec14c00640 1 -- 172.21.15.110:0/585285317 >> 172.21.15.110:0/585285317 conn(0x7fec100fd2e0 msgr2=0x7fec100ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:03.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.104+0000 7fec14c00640 1 -- 172.21.15.110:0/585285317 shutdown_connections 2024-09-12T02:15:03.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.104+0000 7fec14c00640 1 -- 172.21.15.110:0/585285317 wait complete. 2024-09-12T02:15:03.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.105+0000 7fec14c00640 1 Processor -- start 2024-09-12T02:15:03.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.105+0000 7fec14c00640 1 -- start start 2024-09-12T02:15:03.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.105+0000 7fec14c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10101b60 0x7fec1019e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:03.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.105+0000 7fec14c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec10102d50 0x7fec1019e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:03.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.105+0000 7fec14c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec10103710 0x7fec101a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:03.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.105+0000 7fec14c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fec1010d830 con 0x7fec10101b60 2024-09-12T02:15:03.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.105+0000 7fec14c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fec1010d6b0 con 0x7fec10103710 2024-09-12T02:15:03.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.105+0000 7fec14c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fec1010d9b0 con 0x7fec10102d50 2024-09-12T02:15:03.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0e800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec10103710 0x7fec101a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:03.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10101b60 0x7fec1019e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:03.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0d400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec10102d50 0x7fec1019e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:03.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0d400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec10102d50 0x7fec1019e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:58608/0 (socket says 172.21.15.110:58608) 2024-09-12T02:15:03.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0e800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec10103710 0x7fec101a59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:44816/0 (socket says 172.21.15.110:44816) 2024-09-12T02:15:03.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0d400640 1 -- 172.21.15.110:0/1610141474 learned_addr learned my addr 172.21.15.110:0/1610141474 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:15:03.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0e800640 1 -- 172.21.15.110:0/1610141474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec10102d50 msgr2=0x7fec1019e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0e800640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec10102d50 0x7fec1019e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0e800640 1 -- 172.21.15.110:0/1610141474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10101b60 msgr2=0x7fec1019e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0e800640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10101b60 0x7fec1019e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0e800640 1 -- 172.21.15.110:0/1610141474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec101a6010 con 0x7fec10103710 2024-09-12T02:15:03.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0d400640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec10102d50 0x7fec1019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:15:03.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec0e800640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec10103710 0x7fec101a59a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec08009fd0 tx=0x7fec0800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:03.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.106+0000 7fec06a00640 1 -- 172.21.15.110:0/1610141474 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0800ce20 con 0x7fec10103710 2024-09-12T02:15:03.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.107+0000 7fec06a00640 1 -- 172.21.15.110:0/1610141474 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec08005020 con 0x7fec10103710 2024-09-12T02:15:03.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.107+0000 7fec14c00640 1 -- 172.21.15.110:0/1610141474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec101a6300 con 0x7fec10103710 2024-09-12T02:15:03.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.107+0000 7fec06a00640 1 -- 172.21.15.110:0/1610141474 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec08010720 con 0x7fec10103710 2024-09-12T02:15:03.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.107+0000 7fec14c00640 1 -- 172.21.15.110:0/1610141474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec101a6850 con 0x7fec10103710 2024-09-12T02:15:03.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.108+0000 7fec14c00640 1 -- 172.21.15.110:0/1610141474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec10106ef0 con 0x7fec10103710 2024-09-12T02:15:03.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.110+0000 7fec06a00640 1 -- 172.21.15.110:0/1610141474 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7fec08005540 con 0x7fec10103710 2024-09-12T02:15:03.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.111+0000 7fec06a00640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7febf40a2ac0 0x7febf40a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:03.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.111+0000 7fec06a00640 1 -- 172.21.15.110:0/1610141474 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9416+0+0 (secure 0 0 0) 0x7fec080cf760 con 0x7fec10103710 2024-09-12T02:15:03.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.111+0000 7fec0de00640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7febf40a2ac0 0x7febf40a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:03.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.112+0000 7fec0de00640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7febf40a2ac0 0x7febf40a4f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec0002a9e0 tx=0x7fec000315b0 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:03.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.115+0000 7fec06a00640 1 -- 172.21.15.110:0/1610141474 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec0809c510 con 0x7fec10103710 2024-09-12T02:15:03.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.308+0000 7fec14c00640 1 -- 172.21.15.110:0/1610141474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fec10062df0 con 0x7fec10103710 2024-09-12T02:15:03.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.314+0000 7fec06a00640 1 -- 172.21.15.110:0/1610141474 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) ==== 138+0+0 (secure 0 0 0) 0x7fec0809be10 con 0x7fec10103710 2024-09-12T02:15:03.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.316+0000 7fec14c00640 1 -- 172.21.15.110:0/1610141474 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7febf40a2ac0 msgr2=0x7febf40a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.316+0000 7fec14c00640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7febf40a2ac0 0x7febf40a4f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec0002a9e0 tx=0x7fec000315b0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.316+0000 7fec14c00640 1 -- 172.21.15.110:0/1610141474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec10103710 msgr2=0x7fec101a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.316+0000 7fec14c00640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec10103710 0x7fec101a59a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec08009fd0 tx=0x7fec0800ef10 comp rx=0 tx=0).stop 2024-09-12T02:15:03.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.316+0000 7fec14c00640 1 -- 172.21.15.110:0/1610141474 shutdown_connections 2024-09-12T02:15:03.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.316+0000 7fec14c00640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7febf40a2ac0 0x7febf40a4f80 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec0002a9e0 tx=0x7fec000315b0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.316+0000 7fec14c00640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fec10103710 0x7fec101a59a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.316+0000 7fec14c00640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec10102d50 0x7fec1019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.316+0000 7fec14c00640 1 --2- 172.21.15.110:0/1610141474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec10101b60 0x7fec1019e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.316+0000 7fec14c00640 1 -- 172.21.15.110:0/1610141474 >> 172.21.15.110:0/1610141474 conn(0x7fec100fd2e0 msgr2=0x7fec101040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:03.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.317+0000 7fec14c00640 1 -- 172.21.15.110:0/1610141474 shutdown_connections 2024-09-12T02:15:03.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.317+0000 7fec14c00640 1 -- 172.21.15.110:0/1610141474 wait complete. 2024-09-12T02:15:03.340 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-12T02:15:03.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.498+0000 7f7af5a00640 1 -- 172.21.15.110:0/763702340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af0104d60 msgr2=0x7f7af01051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.498+0000 7f7af5a00640 1 --2- 172.21.15.110:0/763702340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af0104d60 0x7f7af01051e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009900 tx=0x7f7adc02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.498+0000 7f7af5a00640 1 -- 172.21.15.110:0/763702340 shutdown_connections 2024-09-12T02:15:03.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.498+0000 7f7af5a00640 1 --2- 172.21.15.110:0/763702340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0105720 0x7f7af010bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.498+0000 7f7af5a00640 1 --2- 172.21.15.110:0/763702340 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af0104d60 0x7f7af01051e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.498+0000 7f7af5a00640 1 --2- 172.21.15.110:0/763702340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7af0103b70 0x7f7af0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.498+0000 7f7af5a00640 1 -- 172.21.15.110:0/763702340 >> 172.21.15.110:0/763702340 conn(0x7f7af00ff310 msgr2=0x7f7af0101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:03.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.498+0000 7f7af5a00640 1 -- 172.21.15.110:0/763702340 shutdown_connections 2024-09-12T02:15:03.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.498+0000 7f7af5a00640 1 -- 172.21.15.110:0/763702340 wait complete. 2024-09-12T02:15:03.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.499+0000 7f7af5a00640 1 Processor -- start 2024-09-12T02:15:03.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.499+0000 7f7af5a00640 1 -- start start 2024-09-12T02:15:03.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.499+0000 7f7af5a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7af0103b70 0x7f7af0199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:03.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.499+0000 7f7af5a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af0104d60 0x7f7af019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:03.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.499+0000 7f7af5a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0105720 0x7f7af01a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:03.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.499+0000 7f7af5a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f7af010f840 con 0x7f7af0105720 2024-09-12T02:15:03.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.499+0000 7f7af5a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7af010f6c0 con 0x7f7af0104d60 2024-09-12T02:15:03.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.499+0000 7f7af5a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7af010f9c0 con 0x7f7af0103b70 2024-09-12T02:15:03.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7aef400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af0104d60 0x7f7af019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:03.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7aefe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7af0103b70 0x7f7af0199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:03.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7aef400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af0104d60 0x7f7af019a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:44824/0 (socket says 172.21.15.110:44824) 2024-09-12T02:15:03.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7aef400640 1 -- 172.21.15.110:0/2358637782 learned_addr learned my addr 172.21.15.110:0/2358637782 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:15:03.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7aefe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7af0103b70 0x7f7af0199ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:58630/0 (socket says 172.21.15.110:58630) 2024-09-12T02:15:03.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7af5000640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0105720 0x7f7af01a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:03.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7aefe00640 1 -- 172.21.15.110:0/2358637782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af0104d60 msgr2=0x7f7af019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7aefe00640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af0104d60 0x7f7af019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7aefe00640 1 -- 172.21.15.110:0/2358637782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0105720 msgr2=0x7f7af01a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7aefe00640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0105720 0x7f7af01a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7aefe00640 1 -- 172.21.15.110:0/2358637782 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af01a1ac0 con 0x7f7af0103b70 2024-09-12T02:15:03.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7aefe00640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7af0103b70 0x7f7af0199ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000e9c0 tx=0x7f7ae000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:03.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7aecc00640 1 -- 172.21.15.110:0/2358637782 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000ccc0 con 0x7f7af0103b70 2024-09-12T02:15:03.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.500+0000 7f7af5a00640 1 -- 172.21.15.110:0/2358637782 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af01a1db0 con 0x7f7af0103b70 2024-09-12T02:15:03.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.501+0000 7f7aecc00640 1 -- 172.21.15.110:0/2358637782 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ae00035f0 con 0x7f7af0103b70 2024-09-12T02:15:03.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.501+0000 7f7aecc00640 1 -- 172.21.15.110:0/2358637782 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000ce60 con 0x7f7af0103b70 2024-09-12T02:15:03.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.501+0000 7f7af5a00640 1 -- 172.21.15.110:0/2358637782 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af01a2210 con 0x7f7af0103b70 2024-09-12T02:15:03.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.502+0000 7f7af5a00640 1 -- 172.21.15.110:0/2358637782 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af010af60 con 0x7f7af0103b70 2024-09-12T02:15:03.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.503+0000 7f7aecc00640 1 -- 172.21.15.110:0/2358637782 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f7ae00037a0 con 0x7f7af0103b70 2024-09-12T02:15:03.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.505+0000 7f7aecc00640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f7ad40a2970 0x7f7ad40a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:03.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.505+0000 7f7aecc00640 1 -- 172.21.15.110:0/2358637782 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9416+0+0 (secure 0 0 0) 0x7f7ae00cf620 con 0x7f7af0103b70 2024-09-12T02:15:03.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.505+0000 7f7aef400640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f7ad40a2970 0x7f7ad40a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:03.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.505+0000 7f7aef400640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f7ad40a2970 0x7f7ad40a4e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7af019b3b0 tx=0x7f7adc0315b0 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:03.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.508+0000 7f7aecc00640 1 -- 172.21.15.110:0/2358637782 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ae009c390 con 0x7f7af0103b70 2024-09-12T02:15:03.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:03 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T02:15:03.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:03 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:15:03.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:03 smithi136 ceph-mon[35814]: mgrmap e22: x(active, since 1.02706s), standbys: y, z 2024-09-12T02:15:03.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:03 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:03.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:03 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:03.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:03 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' 2024-09-12T02:15:03.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:03 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' 2024-09-12T02:15:03.664 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T02:15:03.664 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:15:03.664 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-mon[30548]: mgrmap e22: x(active, since 1.02706s), standbys: y, z 2024-09-12T02:15:03.664 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:03.664 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:03.664 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' 2024-09-12T02:15:03.664 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' 2024-09-12T02:15:03.664 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:03.380+0000 7efd2c800640 -1 log_channel(cephadm) log [ERR] : [12/Sep/2024:02:15:03] ENGINE Error in HTTPServer.serve 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: Traceback (most recent call last): 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: self._connections.run(self.expiration_interval) 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: self._run(expiration_interval) 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: s = self.context.wrap_socket( 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: return self.sslsocket_class._create( 2024-09-12T02:15:03.665 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:15:03.666 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: self.do_handshake() 2024-09-12T02:15:03.666 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:15:03.666 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: self._sslobj.do_handshake() 2024-09-12T02:15:03.666 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:15:03.666 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:15:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:15:03.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.696+0000 7f7af5a00640 1 -- 172.21.15.110:0/2358637782 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f7af0062f00 con 0x7f7af0103b70 2024-09-12T02:15:03.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.702+0000 7f7aecc00640 1 -- 172.21.15.110:0/2358637782 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v32)=0 v32) ==== 133+0+0 (secure 0 0 0) 0x7f7ae009bc90 con 0x7f7af0103b70 2024-09-12T02:15:03.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.704+0000 7f7af5a00640 1 -- 172.21.15.110:0/2358637782 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f7ad40a2970 msgr2=0x7f7ad40a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.704+0000 7f7af5a00640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f7ad40a2970 0x7f7ad40a4e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7af019b3b0 tx=0x7f7adc0315b0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.704+0000 7f7af5a00640 1 -- 172.21.15.110:0/2358637782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7af0103b70 msgr2=0x7f7af0199ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.704+0000 7f7af5a00640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7af0103b70 0x7f7af0199ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000e9c0 tx=0x7f7ae000ee80 comp rx=0 tx=0).stop 2024-09-12T02:15:03.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.704+0000 7f7af5a00640 1 -- 172.21.15.110:0/2358637782 shutdown_connections 2024-09-12T02:15:03.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.704+0000 7f7af5a00640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f7ad40a2970 0x7f7ad40a4e30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.704+0000 7f7af5a00640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7af0105720 0x7f7af01a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.704+0000 7f7af5a00640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7af0104d60 0x7f7af019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.704+0000 7f7af5a00640 1 --2- 172.21.15.110:0/2358637782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7af0103b70 0x7f7af0199ea0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.704+0000 7f7af5a00640 1 -- 172.21.15.110:0/2358637782 >> 172.21.15.110:0/2358637782 conn(0x7f7af00ff310 msgr2=0x7f7af0108130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:03.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.705+0000 7f7af5a00640 1 -- 172.21.15.110:0/2358637782 shutdown_connections 2024-09-12T02:15:03.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.705+0000 7f7af5a00640 1 -- 172.21.15.110:0/2358637782 wait complete. 2024-09-12T02:15:03.722 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-12T02:15:03.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:03 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-12T02:15:03.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:03 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:15:03.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:03 smithi115 ceph-mon[35351]: mgrmap e22: x(active, since 1.02706s), standbys: y, z 2024-09-12T02:15:03.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:03 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:03.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:03 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:03.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:03 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' 2024-09-12T02:15:03.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:03 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' 2024-09-12T02:15:03.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.893+0000 7f2292400640 1 -- 172.21.15.110:0/126943818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c103d60 msgr2=0x7f228c104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.893+0000 7f2292400640 1 --2- 172.21.15.110:0/126943818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c103d60 0x7f228c104160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f227c009900 tx=0x7f227c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.894+0000 7f2292400640 1 -- 172.21.15.110:0/126943818 shutdown_connections 2024-09-12T02:15:03.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.894+0000 7f2292400640 1 --2- 172.21.15.110:0/126943818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f228c105910 0x7f228c10c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.894+0000 7f2292400640 1 --2- 172.21.15.110:0/126943818 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f228c104f50 0x7f228c1053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.894+0000 7f2292400640 1 --2- 172.21.15.110:0/126943818 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c103d60 0x7f228c104160 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.894+0000 7f2292400640 1 -- 172.21.15.110:0/126943818 >> 172.21.15.110:0/126943818 conn(0x7f228c0ff4e0 msgr2=0x7f228c101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:03.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.894+0000 7f2292400640 1 -- 172.21.15.110:0/126943818 shutdown_connections 2024-09-12T02:15:03.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.894+0000 7f2292400640 1 -- 172.21.15.110:0/126943818 wait complete. 2024-09-12T02:15:03.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.894+0000 7f2292400640 1 Processor -- start 2024-09-12T02:15:03.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.895+0000 7f2292400640 1 -- start start 2024-09-12T02:15:03.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.895+0000 7f2292400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f228c103d60 0x7f228c19a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.895+0000 7f2292400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f228c104f50 0x7f228c19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.895+0000 7f2292400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c105910 0x7f228c1a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.895+0000 7f2292400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f228c10fa30 con 0x7f228c104f50 2024-09-12T02:15:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.895+0000 7f2292400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f228c10f8b0 con 0x7f228c103d60 2024-09-12T02:15:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.895+0000 7f2292400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f228c10fbb0 con 0x7f228c105910 2024-09-12T02:15:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.895+0000 7f228b400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f228c103d60 0x7f228c19a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.895+0000 7f228aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f228c104f50 0x7f228c19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.895+0000 7f228b400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f228c103d60 0x7f228c19a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:44870/0 (socket says 172.21.15.110:44870) 2024-09-12T02:15:03.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.895+0000 7f228be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c105910 0x7f228c1a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.895+0000 7f228b400640 1 -- 172.21.15.110:0/4272090188 learned_addr learned my addr 172.21.15.110:0/4272090188 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:15:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.896+0000 7f228b400640 1 -- 172.21.15.110:0/4272090188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c105910 msgr2=0x7f228c1a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.896+0000 7f228b400640 1 --2- 172.21.15.110:0/4272090188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c105910 0x7f228c1a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.896+0000 7f228b400640 1 -- 172.21.15.110:0/4272090188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f228c104f50 msgr2=0x7f228c19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.896+0000 7f228b400640 1 --2- 172.21.15.110:0/4272090188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f228c104f50 0x7f228c19a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.896+0000 7f228b400640 1 -- 172.21.15.110:0/4272090188 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c1a1c20 con 0x7f228c103d60 2024-09-12T02:15:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.896+0000 7f228b400640 1 --2- 172.21.15.110:0/4272090188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f228c103d60 0x7f228c19a000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f227c031440 tx=0x7f227c032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.896+0000 7f2283e00640 1 -- 172.21.15.110:0/4272090188 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c03f030 con 0x7f228c103d60 2024-09-12T02:15:03.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.896+0000 7f2283e00640 1 -- 172.21.15.110:0/4272090188 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f227c003ce0 con 0x7f228c103d60 2024-09-12T02:15:03.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.896+0000 7f2292400640 1 -- 172.21.15.110:0/4272090188 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c1a1eb0 con 0x7f228c103d60 2024-09-12T02:15:03.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.896+0000 7f2283e00640 1 -- 172.21.15.110:0/4272090188 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c035070 con 0x7f228c103d60 2024-09-12T02:15:03.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.896+0000 7f2292400640 1 -- 172.21.15.110:0/4272090188 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c1a22c0 con 0x7f228c103d60 2024-09-12T02:15:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.897+0000 7f2292400640 1 -- 172.21.15.110:0/4272090188 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c10b100 con 0x7f228c103d60 2024-09-12T02:15:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.899+0000 7f2283e00640 1 -- 172.21.15.110:0/4272090188 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f227c042030 con 0x7f228c103d60 2024-09-12T02:15:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.901+0000 7f2283e00640 1 --2- 172.21.15.110:0/4272090188 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f22700a2a40 0x7f22700a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.901+0000 7f2283e00640 1 -- 172.21.15.110:0/4272090188 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9416+0+0 (secure 0 0 0) 0x7f227c0ef950 con 0x7f228c103d60 2024-09-12T02:15:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.901+0000 7f228aa00640 1 --2- 172.21.15.110:0/4272090188 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f22700a2a40 0x7f22700a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.902+0000 7f228aa00640 1 --2- 172.21.15.110:0/4272090188 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f22700a2a40 0x7f22700a4f00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f228c19b510 tx=0x7f2278005f90 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:03.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:03.904+0000 7f2283e00640 1 -- 172.21.15.110:0/4272090188 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f227c0bc070 con 0x7f228c103d60 2024-09-12T02:15:04.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.104+0000 7f2292400640 1 -- 172.21.15.110:0/4272090188 --> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f228c062630 con 0x7f22700a2a40 2024-09-12T02:15:04.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.198+0000 7f2283e00640 1 -- 172.21.15.110:0/4272090188 <== mgr.15147 v2:172.21.15.110:6800/1913988278 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f228c062630 con 0x7f22700a2a40 2024-09-12T02:15:04.199 INFO:teuthology.orchestra.run.smithi110.stdout:Schedule set for path / 2024-09-12T02:15:04.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.200+0000 7f2292400640 1 -- 172.21.15.110:0/4272090188 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f22700a2a40 msgr2=0x7f22700a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:04.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.200+0000 7f2292400640 1 --2- 172.21.15.110:0/4272090188 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f22700a2a40 0x7f22700a4f00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f228c19b510 tx=0x7f2278005f90 comp rx=0 tx=0).stop 2024-09-12T02:15:04.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.200+0000 7f2292400640 1 -- 172.21.15.110:0/4272090188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f228c103d60 msgr2=0x7f228c19a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:04.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.200+0000 7f2292400640 1 --2- 172.21.15.110:0/4272090188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f228c103d60 0x7f228c19a000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f227c031440 tx=0x7f227c032ce0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.200+0000 7f2292400640 1 -- 172.21.15.110:0/4272090188 shutdown_connections 2024-09-12T02:15:04.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.200+0000 7f2292400640 1 --2- 172.21.15.110:0/4272090188 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f22700a2a40 0x7f22700a4f00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.200+0000 7f2292400640 1 --2- 172.21.15.110:0/4272090188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c105910 0x7f228c1a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.200+0000 7f2292400640 1 --2- 172.21.15.110:0/4272090188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f228c104f50 0x7f228c19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.200+0000 7f2292400640 1 --2- 172.21.15.110:0/4272090188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f228c103d60 0x7f228c19a000 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.200+0000 7f2292400640 1 -- 172.21.15.110:0/4272090188 >> 172.21.15.110:0/4272090188 conn(0x7f228c0ff4e0 msgr2=0x7f228c1082d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:04.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.200+0000 7f2292400640 1 -- 172.21.15.110:0/4272090188 shutdown_connections 2024-09-12T02:15:04.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.200+0000 7f2292400640 1 -- 172.21.15.110:0/4272090188 wait complete. 2024-09-12T02:15:04.218 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-12T02:15:04.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.382+0000 7f1f5d400640 1 -- 172.21.15.110:0/1534887026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f581025c0 msgr2=0x7f1f581049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:04.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.382+0000 7f1f5d400640 1 --2- 172.21.15.110:0/1534887026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f581025c0 0x7f1f581049b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009900 tx=0x7f1f4802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.383+0000 7f1f5d400640 1 -- 172.21.15.110:0/1534887026 shutdown_connections 2024-09-12T02:15:04.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.383+0000 7f1f5d400640 1 --2- 172.21.15.110:0/1534887026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f58107820 0x7f1f58109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.383+0000 7f1f5d400640 1 --2- 172.21.15.110:0/1534887026 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f58104ef0 0x7f1f581072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.383+0000 7f1f5d400640 1 --2- 172.21.15.110:0/1534887026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f581025c0 0x7f1f581049b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.383+0000 7f1f5d400640 1 -- 172.21.15.110:0/1534887026 >> 172.21.15.110:0/1534887026 conn(0x7f1f580fc1e0 msgr2=0x7f1f580fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:04.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.383+0000 7f1f5d400640 1 -- 172.21.15.110:0/1534887026 shutdown_connections 2024-09-12T02:15:04.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.383+0000 7f1f5d400640 1 -- 172.21.15.110:0/1534887026 wait complete. 2024-09-12T02:15:04.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f5d400640 1 Processor -- start 2024-09-12T02:15:04.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f5d400640 1 -- start start 2024-09-12T02:15:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f5d400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f581025c0 0x7f1f5819a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f5d400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f58104ef0 0x7f1f5819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f5d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f58107820 0x7f1f581a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f5d400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5810d880 con 0x7f1f58107820 2024-09-12T02:15:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f5d400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5810d700 con 0x7f1f581025c0 2024-09-12T02:15:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f5d400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5810da00 con 0x7f1f58104ef0 2024-09-12T02:15:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f57200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f58107820 0x7f1f581a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f56800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f581025c0 0x7f1f5819a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f55e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f58104ef0 0x7f1f5819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f56800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f581025c0 0x7f1f5819a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:44882/0 (socket says 172.21.15.110:44882) 2024-09-12T02:15:04.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f57200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f58107820 0x7f1f581a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42824/0 (socket says 172.21.15.110:42824) 2024-09-12T02:15:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.384+0000 7f1f56800640 1 -- 172.21.15.110:0/1126288802 learned_addr learned my addr 172.21.15.110:0/1126288802 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:15:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.385+0000 7f1f55e00640 1 -- 172.21.15.110:0/1126288802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f581025c0 msgr2=0x7f1f5819a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.385+0000 7f1f55e00640 1 --2- 172.21.15.110:0/1126288802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f581025c0 0x7f1f5819a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.385+0000 7f1f55e00640 1 -- 172.21.15.110:0/1126288802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f58107820 msgr2=0x7f1f581a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.385+0000 7f1f55e00640 1 --2- 172.21.15.110:0/1126288802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f58107820 0x7f1f581a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.385+0000 7f1f55e00640 1 -- 172.21.15.110:0/1126288802 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f581a1c60 con 0x7f1f58104ef0 2024-09-12T02:15:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.385+0000 7f1f55e00640 1 --2- 172.21.15.110:0/1126288802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f58104ef0 0x7f1f5819a580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400e9c0 tx=0x7f1f4400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.385+0000 7f1f4f400640 1 -- 172.21.15.110:0/1126288802 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4400cd80 con 0x7f1f58104ef0 2024-09-12T02:15:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.385+0000 7f1f4f400640 1 -- 172.21.15.110:0/1126288802 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f440035f0 con 0x7f1f58104ef0 2024-09-12T02:15:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.385+0000 7f1f5d400640 1 -- 172.21.15.110:0/1126288802 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f581a1f50 con 0x7f1f58104ef0 2024-09-12T02:15:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.385+0000 7f1f4f400640 1 -- 172.21.15.110:0/1126288802 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44010690 con 0x7f1f58104ef0 2024-09-12T02:15:04.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.385+0000 7f1f5d400640 1 -- 172.21.15.110:0/1126288802 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f581a2410 con 0x7f1f58104ef0 2024-09-12T02:15:04.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.387+0000 7f1f5d400640 1 -- 172.21.15.110:0/1126288802 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f58109390 con 0x7f1f58104ef0 2024-09-12T02:15:04.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.389+0000 7f1f4f400640 1 -- 172.21.15.110:0/1126288802 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f1f440037a0 con 0x7f1f58104ef0 2024-09-12T02:15:04.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.390+0000 7f1f4f400640 1 --2- 172.21.15.110:0/1126288802 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f1f3c0a2a40 0x7f1f3c0a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:04.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.390+0000 7f1f4f400640 1 -- 172.21.15.110:0/1126288802 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9416+0+0 (secure 0 0 0) 0x7f1f440cf3a0 con 0x7f1f58104ef0 2024-09-12T02:15:04.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.390+0000 7f1f56800640 1 --2- 172.21.15.110:0/1126288802 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f1f3c0a2a40 0x7f1f3c0a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:04.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.391+0000 7f1f56800640 1 --2- 172.21.15.110:0/1126288802 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f1f3c0a2a40 0x7f1f3c0a4f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1f480096c0 tx=0x7f1f480315b0 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:04.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.394+0000 7f1f4f400640 1 -- 172.21.15.110:0/1126288802 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1f4409c110 con 0x7f1f58104ef0 2024-09-12T02:15:04.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.498+0000 7f1f4f400640 1 -- 172.21.15.110:0/1126288802 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mgrmap(e 23) ==== 137954+0+0 (secure 0 0 0) 0x7f1f44098080 con 0x7f1f58104ef0 2024-09-12T02:15:04.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.622+0000 7f1f5d400640 1 -- 172.21.15.110:0/1126288802 --> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f1f580626d0 con 0x7f1f3c0a2a40 2024-09-12T02:15:04.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.686+0000 7f1f4f400640 1 -- 172.21.15.110:0/1126288802 <== mgr.15147 v2:172.21.15.110:6800/1913988278 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f1f580626d0 con 0x7f1f3c0a2a40 2024-09-12T02:15:04.687 INFO:teuthology.orchestra.run.smithi110.stdout:Retention added to path / 2024-09-12T02:15:04.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.688+0000 7f1f5d400640 1 -- 172.21.15.110:0/1126288802 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f1f3c0a2a40 msgr2=0x7f1f3c0a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:04.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.688+0000 7f1f5d400640 1 --2- 172.21.15.110:0/1126288802 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f1f3c0a2a40 0x7f1f3c0a4f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1f480096c0 tx=0x7f1f480315b0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.688+0000 7f1f5d400640 1 -- 172.21.15.110:0/1126288802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f58104ef0 msgr2=0x7f1f5819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:04.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.688+0000 7f1f5d400640 1 --2- 172.21.15.110:0/1126288802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f58104ef0 0x7f1f5819a580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400e9c0 tx=0x7f1f4400ee80 comp rx=0 tx=0).stop 2024-09-12T02:15:04.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.689+0000 7f1f5d400640 1 -- 172.21.15.110:0/1126288802 shutdown_connections 2024-09-12T02:15:04.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.689+0000 7f1f5d400640 1 --2- 172.21.15.110:0/1126288802 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f1f3c0a2a40 0x7f1f3c0a4f00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.689+0000 7f1f5d400640 1 --2- 172.21.15.110:0/1126288802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f58107820 0x7f1f581a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.689+0000 7f1f5d400640 1 --2- 172.21.15.110:0/1126288802 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f58104ef0 0x7f1f5819a580 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.689+0000 7f1f5d400640 1 --2- 172.21.15.110:0/1126288802 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1f581025c0 0x7f1f5819a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.689+0000 7f1f5d400640 1 -- 172.21.15.110:0/1126288802 >> 172.21.15.110:0/1126288802 conn(0x7f1f580fc1e0 msgr2=0x7f1f58101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:04.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.689+0000 7f1f5d400640 1 -- 172.21.15.110:0/1126288802 shutdown_connections 2024-09-12T02:15:04.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.689+0000 7f1f5d400640 1 -- 172.21.15.110:0/1126288802 wait complete. 2024-09-12T02:15:04.705 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T02:15:04.755 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: [12/Sep/2024:02:15:03] ENGINE Bus STARTING 2024-09-12T02:15:04.755 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: [12/Sep/2024:02:15:03] ENGINE Serving on http://172.21.15.110:8765 2024-09-12T02:15:04.756 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: [12/Sep/2024:02:15:03] ENGINE Serving on https://172.21.15.110:7150 2024-09-12T02:15:04.756 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: [12/Sep/2024:02:15:03] ENGINE Bus STARTED 2024-09-12T02:15:04.756 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: [12/Sep/2024:02:15:03] ENGINE Error in HTTPServer.serve 2024-09-12T02:15:04.756 INFO:journalctl@ceph.mon.a.smithi110.stdout: Traceback (most recent call last): 2024-09-12T02:15:04.756 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:15:04.756 INFO:journalctl@ceph.mon.a.smithi110.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:15:04.756 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:15:04.756 INFO:journalctl@ceph.mon.a.smithi110.stdout: self._run(expiration_interval) 2024-09-12T02:15:04.756 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:15:04.756 INFO:journalctl@ceph.mon.a.smithi110.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:15:04.756 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout: s = self.context.wrap_socket( 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout: return self.sslsocket_class._create( 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout: self.do_handshake() 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout: self._sslobj.do_handshake() 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.757 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.758 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.758 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.758 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.758 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:04.758 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:04.758 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:04.758 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:04.758 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:04 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: [12/Sep/2024:02:15:03] ENGINE Bus STARTING 2024-09-12T02:15:04.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: [12/Sep/2024:02:15:03] ENGINE Serving on http://172.21.15.110:8765 2024-09-12T02:15:04.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: [12/Sep/2024:02:15:03] ENGINE Serving on https://172.21.15.110:7150 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: [12/Sep/2024:02:15:03] ENGINE Bus STARTED 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: [12/Sep/2024:02:15:03] ENGINE Error in HTTPServer.serve 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout: Traceback (most recent call last): 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout: self._run(expiration_interval) 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:15:04.795 INFO:journalctl@ceph.mon.b.smithi115.stdout: s = self.context.wrap_socket( 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout: return self.sslsocket_class._create( 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout: self.do_handshake() 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout: self._sslobj.do_handshake() 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:04.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:04.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:04.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:04.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:04 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.873+0000 7f5d55600640 1 -- 172.21.15.110:0/3905817500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d50074c50 msgr2=0x7f5d500750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:04.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.873+0000 7f5d55600640 1 --2- 172.21.15.110:0/3905817500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d50074c50 0x7f5d500750b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009900 tx=0x7f5d3c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.873+0000 7f5d55600640 1 -- 172.21.15.110:0/3905817500 shutdown_connections 2024-09-12T02:15:04.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.873+0000 7f5d55600640 1 --2- 172.21.15.110:0/3905817500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d501099d0 0x7f5d5010be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.873+0000 7f5d55600640 1 --2- 172.21.15.110:0/3905817500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d50074c50 0x7f5d500750b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.873+0000 7f5d55600640 1 --2- 172.21.15.110:0/3905817500 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d50076230 0x7f5d50074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.873+0000 7f5d55600640 1 -- 172.21.15.110:0/3905817500 >> 172.21.15.110:0/3905817500 conn(0x7f5d500fd2e0 msgr2=0x7f5d500ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:04.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.873+0000 7f5d55600640 1 -- 172.21.15.110:0/3905817500 shutdown_connections 2024-09-12T02:15:04.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.873+0000 7f5d55600640 1 -- 172.21.15.110:0/3905817500 wait complete. 2024-09-12T02:15:04.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d55600640 1 Processor -- start 2024-09-12T02:15:04.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d55600640 1 -- start start 2024-09-12T02:15:04.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d55600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d50074c50 0x7f5d5019a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:04.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d55600640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d50076230 0x7f5d5019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:04.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d55600640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d501099d0 0x7f5d501a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d55600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5010fa20 con 0x7f5d50074c50 2024-09-12T02:15:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d55600640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5010f8a0 con 0x7f5d501099d0 2024-09-12T02:15:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d55600640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5d5010fba0 con 0x7f5d50076230 2024-09-12T02:15:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d4ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d50074c50 0x7f5d5019a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d4ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d50074c50 0x7f5d5019a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42848/0 (socket says 172.21.15.110:42848) 2024-09-12T02:15:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d4ea00640 1 -- 172.21.15.110:0/3173243430 learned_addr learned my addr 172.21.15.110:0/3173243430 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:15:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d4f400640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d501099d0 0x7f5d501a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.874+0000 7f5d4e000640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d50076230 0x7f5d5019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.875+0000 7f5d4ea00640 1 -- 172.21.15.110:0/3173243430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d50076230 msgr2=0x7f5d5019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.875+0000 7f5d4ea00640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d50076230 0x7f5d5019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.875+0000 7f5d4ea00640 1 -- 172.21.15.110:0/3173243430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d501099d0 msgr2=0x7f5d501a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:04.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.875+0000 7f5d4ea00640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d501099d0 0x7f5d501a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:04.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.875+0000 7f5d4ea00640 1 -- 172.21.15.110:0/3173243430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d501a1c40 con 0x7f5d50074c50 2024-09-12T02:15:04.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.875+0000 7f5d4f400640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d501099d0 0x7f5d501a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:15:04.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.875+0000 7f5d4ea00640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d50074c50 0x7f5d5019a020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000e9f0 tx=0x7f5d4000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:04.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.875+0000 7f5d47400640 1 -- 172.21.15.110:0/3173243430 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4000ccc0 con 0x7f5d50074c50 2024-09-12T02:15:04.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.875+0000 7f5d47400640 1 -- 172.21.15.110:0/3173243430 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d4000ce60 con 0x7f5d50074c50 2024-09-12T02:15:04.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.875+0000 7f5d55600640 1 -- 172.21.15.110:0/3173243430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d501a1f30 con 0x7f5d50074c50 2024-09-12T02:15:04.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.875+0000 7f5d47400640 1 -- 172.21.15.110:0/3173243430 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d40010690 con 0x7f5d50074c50 2024-09-12T02:15:04.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.876+0000 7f5d55600640 1 -- 172.21.15.110:0/3173243430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d501a2390 con 0x7f5d50074c50 2024-09-12T02:15:04.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.877+0000 7f5d55600640 1 -- 172.21.15.110:0/3173243430 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d50108040 con 0x7f5d50074c50 2024-09-12T02:15:04.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.879+0000 7f5d47400640 1 -- 172.21.15.110:0/3173243430 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 23) ==== 137954+0+0 (secure 0 0 0) 0x7f5d400046c0 con 0x7f5d50074c50 2024-09-12T02:15:04.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.880+0000 7f5d47400640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f5d340a2e20 0x7f5d340a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:04.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.880+0000 7f5d47400640 1 -- 172.21.15.110:0/3173243430 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9416+0+0 (secure 0 0 0) 0x7f5d400cfb00 con 0x7f5d50074c50 2024-09-12T02:15:04.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.880+0000 7f5d4e000640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f5d340a2e20 0x7f5d340a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:04.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.881+0000 7f5d4e000640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f5d340a2e20 0x7f5d340a52e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c031440 tx=0x7f5d3c0315b0 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:04.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:04.884+0000 7f5d47400640 1 -- 172.21.15.110:0/3173243430 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d4009c3a0 con 0x7f5d50074c50 2024-09-12T02:15:04.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: [12/Sep/2024:02:15:03] ENGINE Bus STARTING 2024-09-12T02:15:04.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: [12/Sep/2024:02:15:03] ENGINE Serving on http://172.21.15.110:8765 2024-09-12T02:15:04.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: [12/Sep/2024:02:15:03] ENGINE Serving on https://172.21.15.110:7150 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: [12/Sep/2024:02:15:03] ENGINE Bus STARTED 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: [12/Sep/2024:02:15:03] ENGINE Error in HTTPServer.serve 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout: Traceback (most recent call last): 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout: self._connections.run(self.expiration_interval) 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout: self._run(expiration_interval) 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout: s = self.context.wrap_socket( 2024-09-12T02:15:04.909 INFO:journalctl@ceph.mon.c.smithi136.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T02:15:04.910 INFO:journalctl@ceph.mon.c.smithi136.stdout: return self.sslsocket_class._create( 2024-09-12T02:15:04.910 INFO:journalctl@ceph.mon.c.smithi136.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T02:15:04.910 INFO:journalctl@ceph.mon.c.smithi136.stdout: self.do_handshake() 2024-09-12T02:15:04.910 INFO:journalctl@ceph.mon.c.smithi136.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T02:15:04.910 INFO:journalctl@ceph.mon.c.smithi136.stdout: self._sslobj.do_handshake() 2024-09-12T02:15:04.910 INFO:journalctl@ceph.mon.c.smithi136.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T02:15:04.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' 2024-09-12T02:15:04.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.911 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:04.911 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:04.911 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:04.911 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:04.911 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:04.911 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:04 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:05.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.099+0000 7f5d55600640 1 -- 172.21.15.110:0/3173243430 --> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f5d50062630 con 0x7f5d340a2e20 2024-09-12T02:15:05.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.106+0000 7f5d47400640 1 -- 172.21.15.110:0/3173243430 <== mgr.15147 v2:172.21.15.110:6800/1913988278 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f5d50062630 con 0x7f5d340a2e20 2024-09-12T02:15:05.106 INFO:teuthology.orchestra.run.smithi110.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T02:15:04", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-12T02:15:05.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.108+0000 7f5d55600640 1 -- 172.21.15.110:0/3173243430 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f5d340a2e20 msgr2=0x7f5d340a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:05.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.108+0000 7f5d55600640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f5d340a2e20 0x7f5d340a52e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c031440 tx=0x7f5d3c0315b0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.108+0000 7f5d55600640 1 -- 172.21.15.110:0/3173243430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d50074c50 msgr2=0x7f5d5019a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:05.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.108+0000 7f5d55600640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d50074c50 0x7f5d5019a020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5d4000e9f0 tx=0x7f5d4000edf0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.108+0000 7f5d55600640 1 -- 172.21.15.110:0/3173243430 shutdown_connections 2024-09-12T02:15:05.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.108+0000 7f5d55600640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f5d340a2e20 0x7f5d340a52e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.108+0000 7f5d55600640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5d501099d0 0x7f5d501a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.108+0000 7f5d55600640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d50076230 0x7f5d5019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.108+0000 7f5d55600640 1 --2- 172.21.15.110:0/3173243430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d50074c50 0x7f5d5019a020 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.108+0000 7f5d55600640 1 -- 172.21.15.110:0/3173243430 >> 172.21.15.110:0/3173243430 conn(0x7f5d500fd2e0 msgr2=0x7f5d5010bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:05.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.108+0000 7f5d55600640 1 -- 172.21.15.110:0/3173243430 shutdown_connections 2024-09-12T02:15:05.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.108+0000 7f5d55600640 1 -- 172.21.15.110:0/3173243430 wait complete. 2024-09-12T02:15:05.124 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T02:15:05.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.283+0000 7f88fbe00640 1 -- 172.21.15.110:0/1871100274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc101580 msgr2=0x7f88fc101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:05.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.283+0000 7f88fbe00640 1 --2- 172.21.15.110:0/1871100274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc101580 0x7f88fc101a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009860 tx=0x7f88e402a340 comp rx=0 tx=0).stop 2024-09-12T02:15:05.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.283+0000 7f88fbe00640 1 -- 172.21.15.110:0/1871100274 shutdown_connections 2024-09-12T02:15:05.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.283+0000 7f88fbe00640 1 --2- 172.21.15.110:0/1871100274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88fc101f40 0x7f88fc109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.283+0000 7f88fbe00640 1 --2- 172.21.15.110:0/1871100274 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc101580 0x7f88fc101a00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.283+0000 7f88fbe00640 1 --2- 172.21.15.110:0/1871100274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88fc103050 0x7f88fc103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.283+0000 7f88fbe00640 1 -- 172.21.15.110:0/1871100274 >> 172.21.15.110:0/1871100274 conn(0x7f88fc0fd0d0 msgr2=0x7f88fc0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:05.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.283+0000 7f88fbe00640 1 -- 172.21.15.110:0/1871100274 shutdown_connections 2024-09-12T02:15:05.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.283+0000 7f88fbe00640 1 -- 172.21.15.110:0/1871100274 wait complete. 2024-09-12T02:15:05.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.284+0000 7f88fbe00640 1 Processor -- start 2024-09-12T02:15:05.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.284+0000 7f88fbe00640 1 -- start start 2024-09-12T02:15:05.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88fbe00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc101580 0x7f88fc075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:05.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88fbe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88fc101f40 0x7f88fc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:05.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88fbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88fc103050 0x7f88fc074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:05.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88fbe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc10d6f0 con 0x7f88fc103050 2024-09-12T02:15:05.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88fbe00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc10d570 con 0x7f88fc101580 2024-09-12T02:15:05.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88fbe00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f88fc10d870 con 0x7f88fc101f40 2024-09-12T02:15:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88faa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc101580 0x7f88fc075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88fb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88fc103050 0x7f88fc074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88faa00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc101580 0x7f88fc075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:44930/0 (socket says 172.21.15.110:44930) 2024-09-12T02:15:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88faa00640 1 -- 172.21.15.110:0/1801592188 learned_addr learned my addr 172.21.15.110:0/1801592188 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:15:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88fa000640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88fc101f40 0x7f88fc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88faa00640 1 -- 172.21.15.110:0/1801592188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88fc101f40 msgr2=0x7f88fc0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88faa00640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88fc101f40 0x7f88fc0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88faa00640 1 -- 172.21.15.110:0/1801592188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88fc103050 msgr2=0x7f88fc074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88faa00640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88fc103050 0x7f88fc074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.285+0000 7f88faa00640 1 -- 172.21.15.110:0/1801592188 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88fc0753b0 con 0x7f88fc101580 2024-09-12T02:15:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.286+0000 7f88faa00640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc101580 0x7f88fc075fa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00e9a0 tx=0x7f88ec00ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:05.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.286+0000 7f88f3400640 1 -- 172.21.15.110:0/1801592188 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00cd80 con 0x7f88fc101580 2024-09-12T02:15:05.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.286+0000 7f88f3400640 1 -- 172.21.15.110:0/1801592188 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f88ec010910 con 0x7f88fc101580 2024-09-12T02:15:05.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.286+0000 7f88fbe00640 1 -- 172.21.15.110:0/1801592188 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88fc1a1ef0 con 0x7f88fc101580 2024-09-12T02:15:05.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.286+0000 7f88f3400640 1 -- 172.21.15.110:0/1801592188 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec018a30 con 0x7f88fc101580 2024-09-12T02:15:05.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.286+0000 7f88fbe00640 1 -- 172.21.15.110:0/1801592188 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88fc1a2350 con 0x7f88fc101580 2024-09-12T02:15:05.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.287+0000 7f88fbe00640 1 -- 172.21.15.110:0/1801592188 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88fc108e00 con 0x7f88fc101580 2024-09-12T02:15:05.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.289+0000 7f88f3400640 1 -- 172.21.15.110:0/1801592188 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 23) ==== 137954+0+0 (secure 0 0 0) 0x7f88ec010ac0 con 0x7f88fc101580 2024-09-12T02:15:05.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.290+0000 7f88f3400640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f88e00a2d70 0x7f88e00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:15:05.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.290+0000 7f88f3400640 1 -- 172.21.15.110:0/1801592188 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9416+0+0 (secure 0 0 0) 0x7f88ec0cf940 con 0x7f88fc101580 2024-09-12T02:15:05.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.290+0000 7f88fa000640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f88e00a2d70 0x7f88e00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:15:05.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.291+0000 7f88fa000640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f88e00a2d70 0x7f88e00a5230 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009830 tx=0x7f88e4030550 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:15:05.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.294+0000 7f88f3400640 1 -- 172.21.15.110:0/1801592188 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88ec09bb30 con 0x7f88fc101580 2024-09-12T02:15:05.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.498+0000 7f88fbe00640 1 -- 172.21.15.110:0/1801592188 --> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f88fc062630 con 0x7f88e00a2d70 2024-09-12T02:15:05.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.506+0000 7f88f3400640 1 -- 172.21.15.110:0/1801592188 <== mgr.15147 v2:172.21.15.110:6800/1913988278 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f88fc062630 con 0x7f88e00a2d70 2024-09-12T02:15:05.507 INFO:teuthology.orchestra.run.smithi110.stdout:/ 1m 6m3h 2024-09-12T02:15:05.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.508+0000 7f88fbe00640 1 -- 172.21.15.110:0/1801592188 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f88e00a2d70 msgr2=0x7f88e00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:05.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.508+0000 7f88fbe00640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f88e00a2d70 0x7f88e00a5230 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f88e4009830 tx=0x7f88e4030550 comp rx=0 tx=0).stop 2024-09-12T02:15:05.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.508+0000 7f88fbe00640 1 -- 172.21.15.110:0/1801592188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc101580 msgr2=0x7f88fc075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:15:05.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.508+0000 7f88fbe00640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc101580 0x7f88fc075fa0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00e9a0 tx=0x7f88ec00ee60 comp rx=0 tx=0).stop 2024-09-12T02:15:05.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.509+0000 7f88fbe00640 1 -- 172.21.15.110:0/1801592188 shutdown_connections 2024-09-12T02:15:05.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.509+0000 7f88fbe00640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f88e00a2d70 0x7f88e00a5230 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.509+0000 7f88fbe00640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88fc103050 0x7f88fc074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.509+0000 7f88fbe00640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88fc101f40 0x7f88fc0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.509+0000 7f88fbe00640 1 --2- 172.21.15.110:0/1801592188 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88fc101580 0x7f88fc075fa0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:15:05.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.509+0000 7f88fbe00640 1 -- 172.21.15.110:0/1801592188 >> 172.21.15.110:0/1801592188 conn(0x7f88fc0fd0d0 msgr2=0x7f88fc105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:15:05.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.509+0000 7f88fbe00640 1 -- 172.21.15.110:0/1801592188 shutdown_connections 2024-09-12T02:15:05.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:15:05.509+0000 7f88fbe00640 1 -- 172.21.15.110:0/1801592188 wait complete. 2024-09-12T02:15:05.525 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-12T02:15:05.591 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-12T02:15:05.602 INFO:teuthology.run_tasks:Running task exec... 2024-09-12T02:15:05.625 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:15:05.625 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T02:15:05.625 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-12T02:15:05.703 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:05.734 INFO:teuthology.orchestra.run.smithi110.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-12T02:15:05.735 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6789,172.21.15.115:6789,172.21.15.136:6789:/volumes/qa/sv_1/0726ba32-b748-40d8-bb38-f69cc5a7bd4b 1.1T 388M 1.1T 1% /tmp/cephfs 2024-09-12T02:15:05.736 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:15:05.736 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: from='client.25229 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:15:05.736 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi115 to 176.0M 2024-09-12T02:15:05.736 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: Unable to set osd_memory_target on smithi115 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T02:15:05.736 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:05.736 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:05.736 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:05.736 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:05.736 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-12T02:15:05.737 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:05.737 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi136 to 176.0M 2024-09-12T02:15:05.737 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: Unable to set osd_memory_target on smithi136 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T02:15:05.737 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: from='client.25240 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:15:05.737 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:05.737 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:05 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:05.741 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-12T02:15:05.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:15:05.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: from='client.25229 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:15:05.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi115 to 176.0M 2024-09-12T02:15:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: Unable to set osd_memory_target on smithi115 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T02:15:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-12T02:15:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi136 to 176.0M 2024-09-12T02:15:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: Unable to set osd_memory_target on smithi136 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T02:15:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: from='client.25240 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:15:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:05.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:05 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:05.852 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-12T02:15:05.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:15:05.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: from='client.25229 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:15:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi115 to 176.0M 2024-09-12T02:15:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: Unable to set osd_memory_target on smithi115 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T02:15:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-12T02:15:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi136 to 176.0M 2024-09-12T02:15:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: Unable to set osd_memory_target on smithi136 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T02:15:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: from='client.25240 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:15:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:05.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:05 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:05.935 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-12T02:15:06.679 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:06 smithi110 ceph-mon[30548]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:15:06.679 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:06 smithi110 ceph-mon[30548]: from='client.25247 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:15:06.679 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:06 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:06.679 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:06 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:06.679 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:06 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:06.679 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:06 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:06.679 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:06 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:06.679 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:06 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:06.679 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:06 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:15:06.679 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:06 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:15:06.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:06 smithi115 ceph-mon[35351]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:15:06.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:06 smithi115 ceph-mon[35351]: from='client.25247 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:15:06.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:06 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:06.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:06 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:06.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:06 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:06.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:06 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:06.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:06 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:06.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:06 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:06.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:06 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:15:06.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:06 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:15:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:06 smithi136 ceph-mon[35814]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:15:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:06 smithi136 ceph-mon[35814]: from='client.25247 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:15:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:06 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:06.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:06 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:06 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:06 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:06 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:06 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:15:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:06 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:15:06.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:06 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:15:07.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:15:07.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-09-12T02:15:07.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: Unable to set osd_memory_target on smithi110 to 185014681: error parsing value: Value '185014681' is below minimum 939524096 2024-09-12T02:15:07.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-12T02:15:07.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-12T02:15:07.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-12T02:15:07.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: Updating smithi115:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:15:07.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: Updating smithi136:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:15:07.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-12T02:15:07.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:07.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:07.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:07.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:07 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:07.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:15:07.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-09-12T02:15:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: Unable to set osd_memory_target on smithi110 to 185014681: error parsing value: Value '185014681' is below minimum 939524096 2024-09-12T02:15:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-12T02:15:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-12T02:15:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-12T02:15:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: Updating smithi115:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:15:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: Updating smithi136:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:15:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-12T02:15:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:07 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:07.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:15:07.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-09-12T02:15:07.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: Unable to set osd_memory_target on smithi110 to 185014681: error parsing value: Value '185014681' is below minimum 939524096 2024-09-12T02:15:07.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: Updating smithi110:/etc/ceph/ceph.conf 2024-09-12T02:15:07.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: Updating smithi115:/etc/ceph/ceph.conf 2024-09-12T02:15:07.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: Updating smithi136:/etc/ceph/ceph.conf 2024-09-12T02:15:07.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: Updating smithi115:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:15:07.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: Updating smithi136:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:15:07.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-12T02:15:07.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:07.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:07.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:07.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:07 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:08.782 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:08 smithi115 ceph-mon[35351]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:15:08.782 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:08 smithi115 ceph-mon[35351]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:15:08.782 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:08 smithi115 ceph-mon[35351]: Updating smithi110:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:15:08.782 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:08 smithi115 ceph-mon[35351]: Updating smithi115:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:15:08.782 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:08 smithi115 ceph-mon[35351]: Updating smithi136:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:15:08.782 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:08 smithi115 ceph-mon[35351]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:15:08.782 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:08 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:08.782 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:08 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:08.783 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:08 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:08.783 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:08 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:15:08.872 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:08 smithi110 ceph-mon[30548]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:15:08.872 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:08 smithi110 ceph-mon[30548]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:15:08.872 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:08 smithi110 ceph-mon[30548]: Updating smithi110:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:15:08.872 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:08 smithi110 ceph-mon[30548]: Updating smithi115:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:15:08.872 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:08 smithi110 ceph-mon[30548]: Updating smithi136:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:15:08.872 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:08 smithi110 ceph-mon[30548]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:15:08.872 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:08 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:08.873 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:08 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:08.873 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:08 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:08.873 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:08 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:15:08.876 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-12T02:15:08.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:08 smithi136 ceph-mon[35814]: Updating smithi115:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:15:08.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:08 smithi136 ceph-mon[35814]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:15:08.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:08 smithi136 ceph-mon[35814]: Updating smithi110:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T02:15:08.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:08 smithi136 ceph-mon[35814]: Updating smithi115:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:15:08.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:08 smithi136 ceph-mon[35814]: Updating smithi136:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:15:08.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:08 smithi136 ceph-mon[35814]: Updating smithi110:/etc/ceph/ceph.client.admin.keyring 2024-09-12T02:15:08.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:08 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:08.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:08 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:08.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:08 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:08.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:08 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:15:08.952 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-12T02:15:08.957 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-12T02:15:09.040 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-12T02:15:09.117 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/: 2024-09-12T02:15:09.117 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:09.117 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 . 2024-09-12T02:15:09.117 INFO:teuthology.orchestra.run.smithi110.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 .. 2024-09-12T02:15:09.117 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 data 2024-09-12T02:15:09.118 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:09.118 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data: 2024-09-12T02:15:09.118 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:09.118 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:09.118 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 .. 2024-09-12T02:15:09.122 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-12T02:15:09.217 INFO:teuthology.orchestra.run.smithi110.stdout:[Service] 2024-09-12T02:15:09.217 INFO:teuthology.orchestra.run.smithi110.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-12T02:15:09.217 INFO:teuthology.orchestra.run.smithi110.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-12T02:15:09.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-12T02:15:09.395 INFO:teuthology.orchestra.run.smithi110.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-12T02:15:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:09 smithi115 ceph-mon[35351]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:15:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:09 smithi115 ceph-mon[35351]: Updating smithi110:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:15:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:09 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:09 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:09.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:09 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:15:09.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:09 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:15:09.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:09 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:09.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:09 smithi136 ceph-mon[35814]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:15:09.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:09 smithi136 ceph-mon[35814]: Updating smithi110:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:15:09.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:09 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:09.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:09 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:09.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:09 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:15:09.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:09 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:15:09.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:09 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:09 smithi110 ceph-mon[30548]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:15:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:09 smithi110 ceph-mon[30548]: Updating smithi110:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T02:15:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:09 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:09 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:09 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:15:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:09 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:15:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:09 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:15:11.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:11 smithi115 ceph-mon[35351]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 77 op/s 2024-09-12T02:15:11.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:11 smithi136 ceph-mon[35814]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 77 op/s 2024-09-12T02:15:11.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:11 smithi110 ceph-mon[30548]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 77 op/s 2024-09-12T02:15:13.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:13 smithi115 ceph-mon[35351]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 103 KiB/s wr, 60 op/s 2024-09-12T02:15:13.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:13 smithi136 ceph-mon[35814]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 103 KiB/s wr, 60 op/s 2024-09-12T02:15:13.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:13 smithi110 ceph-mon[30548]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 103 KiB/s wr, 60 op/s 2024-09-12T02:15:14.478 INFO:teuthology.orchestra.run.smithi110.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-12T02:15:14.484 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-12T02:15:14.575 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/: 2024-09-12T02:15:14.575 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.575 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 . 2024-09-12T02:15:14.576 INFO:teuthology.orchestra.run.smithi110.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 .. 2024-09-12T02:15:14.576 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 data 2024-09-12T02:15:14.576 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.576 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data: 2024-09-12T02:15:14.576 INFO:teuthology.orchestra.run.smithi110.stdout:total 35 2024-09-12T02:15:14.576 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 . 2024-09-12T02:15:14.576 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 .. 2024-09-12T02:15:14.576 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 base 2024-09-12T02:15:14.576 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 12 02:15 global 2024-09-12T02:15:14.576 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 log 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_commit_ts 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_dynshmem 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 12 02:15 pg_hba.conf 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 12 02:15 pg_ident.conf 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 pg_logical 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:15 pg_multixact 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_notify 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_replslot 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_serial 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_snapshots 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_stat 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_stat_tmp 2024-09-12T02:15:14.577 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 pg_subtrans 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_tblspc 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_twophase 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 PG_VERSION 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:15 pg_wal 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 pg_xact 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 12 02:15 postgresql.auto.conf 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 12 02:15 postgresql.conf 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base: 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 . 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:15 1 2024-09-12T02:15:14.578 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:15 13493 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:15 13494 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:total 7777 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:15 . 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 .. 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 112 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 113 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:15 1247 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1247_fsm 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1247_vm 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 12 02:15 1249 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1249_fsm 2024-09-12T02:15:14.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1249_vm 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 12 02:15 1255 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1255_fsm 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1255_vm 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 12 02:15 1259 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1259_fsm 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1259_vm 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 12 02:15 13344 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13344_fsm 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13344_vm 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13346 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13348 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13349 2024-09-12T02:15:14.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13349_fsm 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13349_vm 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13351 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13353 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13354 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13354_fsm 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13354_vm 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13356 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13358 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13359 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13359_fsm 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13359_vm 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13361 2024-09-12T02:15:14.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13363 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 1417 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 1418 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 174 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 175 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2187 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2224 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2328 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2336 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2337 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2579 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2600 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2600_fsm 2024-09-12T02:15:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2600_vm 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2601 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2601_fsm 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2601_vm 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2602 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2602_fsm 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2602_vm 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2603 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2603_fsm 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2603_vm 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2604 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2605 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2605_fsm 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2605_vm 2024-09-12T02:15:14.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2606 2024-09-12T02:15:14.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2606_fsm 2024-09-12T02:15:14.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2606_vm 2024-09-12T02:15:14.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2607 2024-09-12T02:15:14.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2607_fsm 2024-09-12T02:15:14.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2607_vm 2024-09-12T02:15:14.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 12 02:15 2608 2024-09-12T02:15:14.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2608_fsm 2024-09-12T02:15:14.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2608_vm 2024-09-12T02:15:14.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 12 02:15 2609 2024-09-12T02:15:14.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2609_fsm 2024-09-12T02:15:14.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2609_vm 2024-09-12T02:15:14.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2610 2024-09-12T02:15:14.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2610_fsm 2024-09-12T02:15:14.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2610_vm 2024-09-12T02:15:14.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2611 2024-09-12T02:15:14.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2612 2024-09-12T02:15:14.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2612_fsm 2024-09-12T02:15:14.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2612_vm 2024-09-12T02:15:14.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2613 2024-09-12T02:15:14.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2615 2024-09-12T02:15:14.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2615_fsm 2024-09-12T02:15:14.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2615_vm 2024-09-12T02:15:14.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2616 2024-09-12T02:15:14.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2616_fsm 2024-09-12T02:15:14.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2616_vm 2024-09-12T02:15:14.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 12 02:15 2617 2024-09-12T02:15:14.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2617_fsm 2024-09-12T02:15:14.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2617_vm 2024-09-12T02:15:14.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 12 02:15 2618 2024-09-12T02:15:14.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2618_fsm 2024-09-12T02:15:14.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2618_vm 2024-09-12T02:15:14.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 12 02:15 2619 2024-09-12T02:15:14.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2619_fsm 2024-09-12T02:15:14.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2619_vm 2024-09-12T02:15:14.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2620 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2650 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2651 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2652 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2653 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2654 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2655 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2656 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2657 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:15 2658 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:15 2659 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2660 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2661 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2662 2024-09-12T02:15:14.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2663 2024-09-12T02:15:14.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2664 2024-09-12T02:15:14.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2665 2024-09-12T02:15:14.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2666 2024-09-12T02:15:14.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2667 2024-09-12T02:15:14.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2668 2024-09-12T02:15:14.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2669 2024-09-12T02:15:14.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2670 2024-09-12T02:15:14.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 12 02:15 2673 2024-09-12T02:15:14.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 12 02:15 2674 2024-09-12T02:15:14.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 12 02:15 2675 2024-09-12T02:15:14.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2678 2024-09-12T02:15:14.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2679 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2680 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2681 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2682 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2683 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2684 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2685 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2686 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2687 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2688 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2689 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 12 02:15 2690 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 12 02:15 2691 2024-09-12T02:15:14.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2692 2024-09-12T02:15:14.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2693 2024-09-12T02:15:14.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2696 2024-09-12T02:15:14.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2699 2024-09-12T02:15:14.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2701 2024-09-12T02:15:14.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2702 2024-09-12T02:15:14.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2703 2024-09-12T02:15:14.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2704 2024-09-12T02:15:14.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2753 2024-09-12T02:15:14.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2753_fsm 2024-09-12T02:15:14.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2753_vm 2024-09-12T02:15:14.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2754 2024-09-12T02:15:14.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2755 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2756 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2757 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2830 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2831 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2832 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2833 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2834 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2835 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2836 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2837 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 12 02:15 2838 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2838_fsm 2024-09-12T02:15:14.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2838_vm 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2839 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2840 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2840_fsm 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2840_vm 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2841 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2995 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2996 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3079 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3079_fsm 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3079_vm 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3080 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3081 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 3085 2024-09-12T02:15:14.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3118 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3119 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:15 3164 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3256 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3257 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3258 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3350 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3351 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3379 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3380 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3381 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3394 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3394_fsm 2024-09-12T02:15:14.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3394_vm 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3395 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3429 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3430 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3431 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3433 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3439 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3440 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 3455 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 12 02:15 3456 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3456_fsm 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3456_vm 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3466 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3467 2024-09-12T02:15:14.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3468 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3501 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3502 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3503 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3534 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3541 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3541_fsm 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3541_vm 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3542 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3574 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3575 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3576 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3596 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3597 2024-09-12T02:15:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3598 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3599 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3600 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3600_fsm 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3600_vm 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3601 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3601_fsm 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3601_vm 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3602 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3602_fsm 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3602_vm 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3603 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3603_fsm 2024-09-12T02:15:14.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3603_vm 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3604 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3605 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3606 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3607 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3608 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 3609 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3712 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3764 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3764_fsm 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3764_vm 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3766 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3767 2024-09-12T02:15:14.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3997 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4143 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4144 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4145 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4146 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4147 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4148 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4149 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4150 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4151 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4152 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4153 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4154 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4155 2024-09-12T02:15:14.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4156 2024-09-12T02:15:14.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4157 2024-09-12T02:15:14.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4158 2024-09-12T02:15:14.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4159 2024-09-12T02:15:14.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4160 2024-09-12T02:15:14.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4161 2024-09-12T02:15:14.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4162 2024-09-12T02:15:14.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4163 2024-09-12T02:15:14.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4164 2024-09-12T02:15:14.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4165 2024-09-12T02:15:14.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4166 2024-09-12T02:15:14.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4167 2024-09-12T02:15:14.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4168 2024-09-12T02:15:14.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4169 2024-09-12T02:15:14.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4170 2024-09-12T02:15:14.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4171 2024-09-12T02:15:14.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4172 2024-09-12T02:15:14.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4173 2024-09-12T02:15:14.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4174 2024-09-12T02:15:14.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 5002 2024-09-12T02:15:14.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 548 2024-09-12T02:15:14.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 549 2024-09-12T02:15:14.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6102 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6104 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6106 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6110 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6111 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6112 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6113 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6117 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 826 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 827 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 828 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:15 pg_filenode.map 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 PG_VERSION 2024-09-12T02:15:14.603 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.604 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-12T02:15:14.604 INFO:teuthology.orchestra.run.smithi110.stdout:total 7777 2024-09-12T02:15:14.604 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:15 . 2024-09-12T02:15:14.604 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 .. 2024-09-12T02:15:14.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 112 2024-09-12T02:15:14.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 113 2024-09-12T02:15:14.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:15 1247 2024-09-12T02:15:14.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1247_fsm 2024-09-12T02:15:14.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1247_vm 2024-09-12T02:15:14.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 12 02:15 1249 2024-09-12T02:15:14.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1249_fsm 2024-09-12T02:15:14.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1249_vm 2024-09-12T02:15:14.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 12 02:15 1255 2024-09-12T02:15:14.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1255_fsm 2024-09-12T02:15:14.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1255_vm 2024-09-12T02:15:14.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 12 02:15 1259 2024-09-12T02:15:14.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1259_fsm 2024-09-12T02:15:14.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1259_vm 2024-09-12T02:15:14.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 12 02:15 13344 2024-09-12T02:15:14.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13344_fsm 2024-09-12T02:15:14.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13344_vm 2024-09-12T02:15:14.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13346 2024-09-12T02:15:14.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13348 2024-09-12T02:15:14.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13349 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13349_fsm 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13349_vm 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13351 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13353 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13354 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13354_fsm 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13354_vm 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13356 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13358 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13359 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13359_fsm 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13359_vm 2024-09-12T02:15:14.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13361 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13363 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 1417 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 1418 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 174 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 175 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2187 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2224 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2328 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2336 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2337 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2579 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2600 2024-09-12T02:15:14.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2600_fsm 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2600_vm 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2601 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2601_fsm 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2601_vm 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2602 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2602_fsm 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2602_vm 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2603 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2603_fsm 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2603_vm 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2604 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2605 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2605_fsm 2024-09-12T02:15:14.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2605_vm 2024-09-12T02:15:14.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2606 2024-09-12T02:15:14.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2606_fsm 2024-09-12T02:15:14.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2606_vm 2024-09-12T02:15:14.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2607 2024-09-12T02:15:14.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2607_fsm 2024-09-12T02:15:14.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2607_vm 2024-09-12T02:15:14.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 12 02:15 2608 2024-09-12T02:15:14.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2608_fsm 2024-09-12T02:15:14.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2608_vm 2024-09-12T02:15:14.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 12 02:15 2609 2024-09-12T02:15:14.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2609_fsm 2024-09-12T02:15:14.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2609_vm 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2610 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2610_fsm 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2610_vm 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2611 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2612 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2612_fsm 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2612_vm 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2613 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2615 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2615_fsm 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2615_vm 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2616 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2616_fsm 2024-09-12T02:15:14.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2616_vm 2024-09-12T02:15:14.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 12 02:15 2617 2024-09-12T02:15:14.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2617_fsm 2024-09-12T02:15:14.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2617_vm 2024-09-12T02:15:14.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 12 02:15 2618 2024-09-12T02:15:14.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2618_fsm 2024-09-12T02:15:14.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2618_vm 2024-09-12T02:15:14.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 12 02:15 2619 2024-09-12T02:15:14.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2619_fsm 2024-09-12T02:15:14.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2619_vm 2024-09-12T02:15:14.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2620 2024-09-12T02:15:14.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2650 2024-09-12T02:15:14.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2651 2024-09-12T02:15:14.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2652 2024-09-12T02:15:14.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2653 2024-09-12T02:15:14.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2654 2024-09-12T02:15:14.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2655 2024-09-12T02:15:14.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2656 2024-09-12T02:15:14.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2657 2024-09-12T02:15:14.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:15 2658 2024-09-12T02:15:14.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:15 2659 2024-09-12T02:15:14.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2660 2024-09-12T02:15:14.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2661 2024-09-12T02:15:14.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2662 2024-09-12T02:15:14.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2663 2024-09-12T02:15:14.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2664 2024-09-12T02:15:14.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2665 2024-09-12T02:15:14.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2666 2024-09-12T02:15:14.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2667 2024-09-12T02:15:14.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2668 2024-09-12T02:15:14.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2669 2024-09-12T02:15:14.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2670 2024-09-12T02:15:14.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 12 02:15 2673 2024-09-12T02:15:14.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 12 02:15 2674 2024-09-12T02:15:14.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 12 02:15 2675 2024-09-12T02:15:14.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2678 2024-09-12T02:15:14.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2679 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2680 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2681 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2682 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2683 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2684 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2685 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2686 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2687 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2688 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2689 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 12 02:15 2690 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 12 02:15 2691 2024-09-12T02:15:14.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2692 2024-09-12T02:15:14.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2693 2024-09-12T02:15:14.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2696 2024-09-12T02:15:14.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2699 2024-09-12T02:15:14.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2701 2024-09-12T02:15:14.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2702 2024-09-12T02:15:14.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2703 2024-09-12T02:15:14.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2704 2024-09-12T02:15:14.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2753 2024-09-12T02:15:14.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2753_fsm 2024-09-12T02:15:14.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2753_vm 2024-09-12T02:15:14.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2754 2024-09-12T02:15:14.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2755 2024-09-12T02:15:14.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2756 2024-09-12T02:15:14.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2757 2024-09-12T02:15:14.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2830 2024-09-12T02:15:14.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2831 2024-09-12T02:15:14.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2832 2024-09-12T02:15:14.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2833 2024-09-12T02:15:14.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2834 2024-09-12T02:15:14.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2835 2024-09-12T02:15:14.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2836 2024-09-12T02:15:14.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2837 2024-09-12T02:15:14.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 12 02:15 2838 2024-09-12T02:15:14.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2838_fsm 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2838_vm 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2839 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2840 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2840_fsm 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2840_vm 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2841 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2995 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2996 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3079 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3079_fsm 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3079_vm 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3080 2024-09-12T02:15:14.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3081 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 3085 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3118 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3119 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:15 3164 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3256 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3257 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3258 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3350 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3351 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3379 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3380 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3381 2024-09-12T02:15:14.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3394 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3394_fsm 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3394_vm 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3395 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3429 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3430 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3431 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3433 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3439 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3440 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 3455 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 12 02:15 3456 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3456_fsm 2024-09-12T02:15:14.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3456_vm 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3466 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3467 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3468 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3501 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3502 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3503 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3534 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3541 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3541_fsm 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3541_vm 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3542 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3574 2024-09-12T02:15:14.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3575 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3576 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3596 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3597 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3598 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3599 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3600 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3600_fsm 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3600_vm 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3601 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3601_fsm 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3601_vm 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3602 2024-09-12T02:15:14.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3602_fsm 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3602_vm 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3603 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3603_fsm 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3603_vm 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3604 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3605 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3606 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3607 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3608 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 3609 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3712 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3764 2024-09-12T02:15:14.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3764_fsm 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3764_vm 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3766 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3767 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3997 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4143 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4144 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4145 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4146 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4147 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4148 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4149 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4150 2024-09-12T02:15:14.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4151 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4152 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4153 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4154 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4155 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4156 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4157 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4158 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4159 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4160 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4161 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4162 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4163 2024-09-12T02:15:14.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4164 2024-09-12T02:15:14.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4165 2024-09-12T02:15:14.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4166 2024-09-12T02:15:14.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4167 2024-09-12T02:15:14.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4168 2024-09-12T02:15:14.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4169 2024-09-12T02:15:14.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4170 2024-09-12T02:15:14.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4171 2024-09-12T02:15:14.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4172 2024-09-12T02:15:14.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4173 2024-09-12T02:15:14.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4174 2024-09-12T02:15:14.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 5002 2024-09-12T02:15:14.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 548 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 549 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6102 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6104 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6106 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6110 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6111 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6112 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6113 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6117 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 826 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 827 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 828 2024-09-12T02:15:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:15 pg_filenode.map 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 PG_VERSION 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout:total 7777 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:15 . 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 .. 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 112 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 113 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:15 1247 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1247_fsm 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1247_vm 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 12 02:15 1249 2024-09-12T02:15:14.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1249_fsm 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1249_vm 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 12 02:15 1255 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1255_fsm 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1255_vm 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 12 02:15 1259 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1259_fsm 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1259_vm 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 12 02:15 13344 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13344_fsm 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13344_vm 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13346 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13348 2024-09-12T02:15:14.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13349 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13349_fsm 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13349_vm 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13351 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13353 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13354 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13354_fsm 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13354_vm 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13356 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13358 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13359 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13359_fsm 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13359_vm 2024-09-12T02:15:14.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13361 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13363 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 1417 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 1418 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 174 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 175 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2187 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2224 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2328 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2336 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2337 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2579 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2600 2024-09-12T02:15:14.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2600_fsm 2024-09-12T02:15:14.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2600_vm 2024-09-12T02:15:14.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2601 2024-09-12T02:15:14.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2601_fsm 2024-09-12T02:15:14.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2601_vm 2024-09-12T02:15:14.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2602 2024-09-12T02:15:14.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2602_fsm 2024-09-12T02:15:14.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2602_vm 2024-09-12T02:15:14.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2603 2024-09-12T02:15:14.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2603_fsm 2024-09-12T02:15:14.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2603_vm 2024-09-12T02:15:14.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2604 2024-09-12T02:15:14.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2605 2024-09-12T02:15:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2605_fsm 2024-09-12T02:15:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2605_vm 2024-09-12T02:15:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2606 2024-09-12T02:15:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2606_fsm 2024-09-12T02:15:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2606_vm 2024-09-12T02:15:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2607 2024-09-12T02:15:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2607_fsm 2024-09-12T02:15:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2607_vm 2024-09-12T02:15:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 12 02:15 2608 2024-09-12T02:15:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2608_fsm 2024-09-12T02:15:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2608_vm 2024-09-12T02:15:14.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 12 02:15 2609 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2609_fsm 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2609_vm 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2610 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2610_fsm 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2610_vm 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2611 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2612 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2612_fsm 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2612_vm 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2613 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2615 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2615_fsm 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2615_vm 2024-09-12T02:15:14.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2616 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2616_fsm 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2616_vm 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 12 02:15 2617 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2617_fsm 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2617_vm 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 12 02:15 2618 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2618_fsm 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2618_vm 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 12 02:15 2619 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2619_fsm 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2619_vm 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2620 2024-09-12T02:15:14.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2650 2024-09-12T02:15:14.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2651 2024-09-12T02:15:14.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2652 2024-09-12T02:15:14.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2653 2024-09-12T02:15:14.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2654 2024-09-12T02:15:14.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2655 2024-09-12T02:15:14.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2656 2024-09-12T02:15:14.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2657 2024-09-12T02:15:14.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:15 2658 2024-09-12T02:15:14.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:15 2659 2024-09-12T02:15:14.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2660 2024-09-12T02:15:14.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2661 2024-09-12T02:15:14.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2662 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2663 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2664 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2665 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2666 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2667 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2668 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2669 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2670 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 12 02:15 2673 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 12 02:15 2674 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 12 02:15 2675 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2678 2024-09-12T02:15:14.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2679 2024-09-12T02:15:14.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2680 2024-09-12T02:15:14.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2681 2024-09-12T02:15:14.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2682 2024-09-12T02:15:14.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2683 2024-09-12T02:15:14.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2684 2024-09-12T02:15:14.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2685 2024-09-12T02:15:14.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2686 2024-09-12T02:15:14.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2687 2024-09-12T02:15:14.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2688 2024-09-12T02:15:14.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2689 2024-09-12T02:15:14.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 12 02:15 2690 2024-09-12T02:15:14.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 12 02:15 2691 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2692 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2693 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2696 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2699 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2701 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2702 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2703 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2704 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2753 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2753_fsm 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2753_vm 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2754 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2755 2024-09-12T02:15:14.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2756 2024-09-12T02:15:14.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2757 2024-09-12T02:15:14.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2830 2024-09-12T02:15:14.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2831 2024-09-12T02:15:14.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2832 2024-09-12T02:15:14.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2833 2024-09-12T02:15:14.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2834 2024-09-12T02:15:14.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2835 2024-09-12T02:15:14.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2836 2024-09-12T02:15:14.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2837 2024-09-12T02:15:14.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 12 02:15 2838 2024-09-12T02:15:14.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2838_fsm 2024-09-12T02:15:14.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2838_vm 2024-09-12T02:15:14.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2839 2024-09-12T02:15:14.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2840 2024-09-12T02:15:14.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2840_fsm 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2840_vm 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2841 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2995 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2996 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3079 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3079_fsm 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3079_vm 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3080 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3081 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 3085 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3118 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3119 2024-09-12T02:15:14.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:15 3164 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3256 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3257 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3258 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3350 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3351 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3379 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3380 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3381 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3394 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3394_fsm 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3394_vm 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3395 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3429 2024-09-12T02:15:14.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3430 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3431 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3433 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3439 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3440 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 3455 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 12 02:15 3456 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3456_fsm 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3456_vm 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3466 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3467 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3468 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3501 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3502 2024-09-12T02:15:14.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3503 2024-09-12T02:15:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3534 2024-09-12T02:15:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3541 2024-09-12T02:15:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3541_fsm 2024-09-12T02:15:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3541_vm 2024-09-12T02:15:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3542 2024-09-12T02:15:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3574 2024-09-12T02:15:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3575 2024-09-12T02:15:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3576 2024-09-12T02:15:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3596 2024-09-12T02:15:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3597 2024-09-12T02:15:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3598 2024-09-12T02:15:14.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3599 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3600 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3600_fsm 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3600_vm 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3601 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3601_fsm 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3601_vm 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3602 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3602_fsm 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3602_vm 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3603 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3603_fsm 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3603_vm 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3604 2024-09-12T02:15:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3605 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3606 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3607 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3608 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 3609 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3712 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3764 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3764_fsm 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3764_vm 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3766 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3767 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3997 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4143 2024-09-12T02:15:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4144 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4145 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4146 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4147 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4148 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4149 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4150 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4151 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4152 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4153 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4154 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4155 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4156 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4157 2024-09-12T02:15:14.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4158 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4159 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4160 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4161 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4162 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4163 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4164 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4165 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4166 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4167 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4168 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4169 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4170 2024-09-12T02:15:14.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4171 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4172 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4173 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4174 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 5002 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 548 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 549 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6102 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6104 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6106 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6110 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6111 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6112 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6113 2024-09-12T02:15:14.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6117 2024-09-12T02:15:14.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 826 2024-09-12T02:15:14.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 827 2024-09-12T02:15:14.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 828 2024-09-12T02:15:14.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:15 pg_filenode.map 2024-09-12T02:15:14.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 PG_VERSION 2024-09-12T02:15:14.650 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.650 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/global: 2024-09-12T02:15:14.651 INFO:teuthology.orchestra.run.smithi110.stdout:total 537 2024-09-12T02:15:14.651 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 12 02:15 . 2024-09-12T02:15:14.651 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1213 2024-09-12T02:15:14.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1213_fsm 2024-09-12T02:15:14.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1213_vm 2024-09-12T02:15:14.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1214 2024-09-12T02:15:14.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1214_fsm 2024-09-12T02:15:14.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1214_vm 2024-09-12T02:15:14.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 1232 2024-09-12T02:15:14.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 1233 2024-09-12T02:15:14.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1260 2024-09-12T02:15:14.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1260_fsm 2024-09-12T02:15:14.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1260_vm 2024-09-12T02:15:14.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1261 2024-09-12T02:15:14.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1261_fsm 2024-09-12T02:15:14.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1261_vm 2024-09-12T02:15:14.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1262 2024-09-12T02:15:14.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1262_fsm 2024-09-12T02:15:14.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1262_vm 2024-09-12T02:15:14.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2396 2024-09-12T02:15:14.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2396_fsm 2024-09-12T02:15:14.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2396_vm 2024-09-12T02:15:14.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2397 2024-09-12T02:15:14.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2671 2024-09-12T02:15:14.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2672 2024-09-12T02:15:14.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2676 2024-09-12T02:15:14.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2677 2024-09-12T02:15:14.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2694 2024-09-12T02:15:14.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2695 2024-09-12T02:15:14.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2697 2024-09-12T02:15:14.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2698 2024-09-12T02:15:14.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2846 2024-09-12T02:15:14.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2847 2024-09-12T02:15:14.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2964 2024-09-12T02:15:14.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2965 2024-09-12T02:15:14.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2966 2024-09-12T02:15:14.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2967 2024-09-12T02:15:14.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3592 2024-09-12T02:15:14.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3593 2024-09-12T02:15:14.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4060 2024-09-12T02:15:14.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4061 2024-09-12T02:15:14.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4175 2024-09-12T02:15:14.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4176 2024-09-12T02:15:14.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4177 2024-09-12T02:15:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4178 2024-09-12T02:15:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4181 2024-09-12T02:15:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4182 2024-09-12T02:15:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4183 2024-09-12T02:15:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4184 2024-09-12T02:15:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4185 2024-09-12T02:15:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4186 2024-09-12T02:15:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6000 2024-09-12T02:15:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6001 2024-09-12T02:15:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6002 2024-09-12T02:15:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6100 2024-09-12T02:15:14.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6114 2024-09-12T02:15:14.663 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6115 2024-09-12T02:15:14.663 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 pg_control 2024-09-12T02:15:14.663 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:15 pg_filenode.map 2024-09-12T02:15:14.663 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.663 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/log: 2024-09-12T02:15:14.663 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.663 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.663 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.663 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.663 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-12T02:15:14.663 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.663 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout:total 1 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 . 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 mappings 2024-09-12T02:15:14.664 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 12 02:15 replorigin_checkpoint 2024-09-12T02:15:14.665 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 snapshots 2024-09-12T02:15:14.665 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.665 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-12T02:15:14.665 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.665 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.665 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 .. 2024-09-12T02:15:14.665 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.665 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-12T02:15:14.665 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.665 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.665 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 .. 2024-09-12T02:15:14.665 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.666 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-12T02:15:14.666 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.666 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:15 . 2024-09-12T02:15:14.666 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.666 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 members 2024-09-12T02:15:14.666 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 offsets 2024-09-12T02:15:14.666 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.666 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-12T02:15:14.666 INFO:teuthology.orchestra.run.smithi110.stdout:total 8 2024-09-12T02:15:14.666 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 . 2024-09-12T02:15:14.667 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:15 .. 2024-09-12T02:15:14.668 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 0000 2024-09-12T02:15:14.668 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.668 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-12T02:15:14.668 INFO:teuthology.orchestra.run.smithi110.stdout:total 8 2024-09-12T02:15:14.668 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 . 2024-09-12T02:15:14.668 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:15 .. 2024-09-12T02:15:14.668 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 0000 2024-09-12T02:15:14.668 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.668 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-12T02:15:14.668 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.668 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-12T02:15:14.669 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.670 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout:total 8 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 . 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 0000 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.671 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout:total 16384 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:15 . 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:15 000000010000000000000001 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 archive_status 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:15 .. 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:15:14.672 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-12T02:15:14.673 INFO:teuthology.orchestra.run.smithi110.stdout:total 8 2024-09-12T02:15:14.673 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 . 2024-09-12T02:15:14.673 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Sep 12 02:15 .. 2024-09-12T02:15:14.673 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 0000 2024-09-12T02:15:14.673 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-12T02:15:14.911 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-12T02:15:15.001 INFO:teuthology.orchestra.run.smithi110.stderr:dropping old tables... 2024-09-12T02:15:15.002 INFO:teuthology.orchestra.run.smithi110.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-12T02:15:15.002 INFO:teuthology.orchestra.run.smithi110.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-12T02:15:15.002 INFO:teuthology.orchestra.run.smithi110.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-12T02:15:15.002 INFO:teuthology.orchestra.run.smithi110.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-12T02:15:15.002 INFO:teuthology.orchestra.run.smithi110.stderr:creating tables... 2024-09-12T02:15:15.019 INFO:teuthology.orchestra.run.smithi110.stderr:generating data (client-side)... 2024-09-12T02:15:15.167 INFO:teuthology.orchestra.run.smithi110.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.12 s, remaining 3.83 s) 2024-09-12T02:15:15.432 INFO:teuthology.orchestra.run.smithi110.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.39 s, remaining 5.82 s) 2024-09-12T02:15:15.731 INFO:teuthology.orchestra.run.smithi110.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.69 s, remaining 6.65 s) 2024-09-12T02:15:15.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:15 smithi115 ceph-mon[35351]: pgmap v9: 129 pgs: 129 active+clean; 29 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 2.6 MiB/s wr, 90 op/s 2024-09-12T02:15:15.883 INFO:teuthology.orchestra.run.smithi110.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.84 s, remaining 5.88 s) 2024-09-12T02:15:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:15 smithi136 ceph-mon[35814]: pgmap v9: 129 pgs: 129 active+clean; 29 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 2.6 MiB/s wr, 90 op/s 2024-09-12T02:15:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:15 smithi110 ceph-mon[30548]: pgmap v9: 129 pgs: 129 active+clean; 29 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 2.6 MiB/s wr, 90 op/s 2024-09-12T02:15:16.119 INFO:teuthology.orchestra.run.smithi110.stderr:500000 of 3200000 tuples (15%) done (elapsed 1.08 s, remaining 5.81 s) 2024-09-12T02:15:16.256 INFO:teuthology.orchestra.run.smithi110.stderr:600000 of 3200000 tuples (18%) done (elapsed 1.21 s, remaining 5.25 s) 2024-09-12T02:15:16.539 INFO:teuthology.orchestra.run.smithi110.stderr:700000 of 3200000 tuples (21%) done (elapsed 1.50 s, remaining 5.34 s) 2024-09-12T02:15:16.812 INFO:teuthology.orchestra.run.smithi110.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.77 s, remaining 5.31 s) 2024-09-12T02:15:16.949 INFO:teuthology.orchestra.run.smithi110.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.91 s, remaining 4.87 s) 2024-09-12T02:15:17.168 INFO:teuthology.orchestra.run.smithi110.stderr:1000000 of 3200000 tuples (31%) done (elapsed 2.12 s, remaining 4.67 s) 2024-09-12T02:15:17.430 INFO:teuthology.orchestra.run.smithi110.stderr:1100000 of 3200000 tuples (34%) done (elapsed 2.39 s, remaining 4.56 s) 2024-09-12T02:15:17.548 INFO:teuthology.orchestra.run.smithi110.stderr:1200000 of 3200000 tuples (37%) done (elapsed 2.50 s, remaining 4.17 s) 2024-09-12T02:15:17.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:17 smithi115 ceph-mon[35351]: pgmap v10: 129 pgs: 129 active+clean; 29 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 2.4 MiB/s wr, 82 op/s 2024-09-12T02:15:17.841 INFO:teuthology.orchestra.run.smithi110.stderr:1300000 of 3200000 tuples (40%) done (elapsed 2.80 s, remaining 4.09 s) 2024-09-12T02:15:17.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:17 smithi136 ceph-mon[35814]: pgmap v10: 129 pgs: 129 active+clean; 29 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 2.4 MiB/s wr, 82 op/s 2024-09-12T02:15:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:17 smithi110 ceph-mon[30548]: pgmap v10: 129 pgs: 129 active+clean; 29 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 2.4 MiB/s wr, 82 op/s 2024-09-12T02:15:18.162 INFO:teuthology.orchestra.run.smithi110.stderr:1400000 of 3200000 tuples (43%) done (elapsed 3.12 s, remaining 4.01 s) 2024-09-12T02:15:18.278 INFO:teuthology.orchestra.run.smithi110.stderr:1500000 of 3200000 tuples (46%) done (elapsed 3.23 s, remaining 3.67 s) 2024-09-12T02:15:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:1600000 of 3200000 tuples (50%) done (elapsed 3.54 s, remaining 3.54 s) 2024-09-12T02:15:18.747 INFO:teuthology.orchestra.run.smithi110.stderr:1700000 of 3200000 tuples (53%) done (elapsed 3.70 s, remaining 3.27 s) 2024-09-12T02:15:19.011 INFO:teuthology.orchestra.run.smithi110.stderr:1800000 of 3200000 tuples (56%) done (elapsed 3.97 s, remaining 3.09 s) 2024-09-12T02:15:19.260 INFO:teuthology.orchestra.run.smithi110.stderr:1900000 of 3200000 tuples (59%) done (elapsed 4.22 s, remaining 2.88 s) 2024-09-12T02:15:19.543 INFO:teuthology.orchestra.run.smithi110.stderr:2000000 of 3200000 tuples (62%) done (elapsed 4.50 s, remaining 2.70 s) 2024-09-12T02:15:19.627 INFO:teuthology.orchestra.run.smithi110.stderr:2100000 of 3200000 tuples (65%) done (elapsed 4.58 s, remaining 2.40 s) 2024-09-12T02:15:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:19 smithi115 ceph-mon[35351]: pgmap v11: 129 pgs: 129 active+clean; 29 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 2.4 MiB/s wr, 82 op/s 2024-09-12T02:15:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:19 smithi136 ceph-mon[35814]: pgmap v11: 129 pgs: 129 active+clean; 29 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 2.4 MiB/s wr, 82 op/s 2024-09-12T02:15:19.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:19 smithi110 ceph-mon[30548]: pgmap v11: 129 pgs: 129 active+clean; 29 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 2.4 MiB/s wr, 82 op/s 2024-09-12T02:15:19.971 INFO:teuthology.orchestra.run.smithi110.stderr:2200000 of 3200000 tuples (68%) done (elapsed 4.93 s, remaining 2.24 s) 2024-09-12T02:15:20.059 INFO:teuthology.orchestra.run.smithi110.stderr:2300000 of 3200000 tuples (71%) done (elapsed 5.02 s, remaining 1.96 s) 2024-09-12T02:15:20.325 INFO:teuthology.orchestra.run.smithi110.stderr:2400000 of 3200000 tuples (75%) done (elapsed 5.28 s, remaining 1.76 s) 2024-09-12T02:15:20.619 INFO:teuthology.orchestra.run.smithi110.stderr:2500000 of 3200000 tuples (78%) done (elapsed 5.58 s, remaining 1.56 s) 2024-09-12T02:15:20.739 INFO:teuthology.orchestra.run.smithi110.stderr:2600000 of 3200000 tuples (81%) done (elapsed 5.70 s, remaining 1.31 s) 2024-09-12T02:15:20.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:20 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:15:20.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:20 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:15:20.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:20 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:15:21.040 INFO:teuthology.orchestra.run.smithi110.stderr:2700000 of 3200000 tuples (84%) done (elapsed 6.00 s, remaining 1.11 s) 2024-09-12T02:15:21.323 INFO:teuthology.orchestra.run.smithi110.stderr:2800000 of 3200000 tuples (87%) done (elapsed 6.28 s, remaining 0.90 s) 2024-09-12T02:15:21.458 INFO:teuthology.orchestra.run.smithi110.stderr:2900000 of 3200000 tuples (90%) done (elapsed 6.41 s, remaining 0.66 s) 2024-09-12T02:15:21.663 INFO:teuthology.orchestra.run.smithi110.stderr:3000000 of 3200000 tuples (93%) done (elapsed 6.62 s, remaining 0.44 s) 2024-09-12T02:15:21.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:21 smithi115 ceph-mon[35351]: pgmap v12: 129 pgs: 129 active+clean; 165 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 24 MiB/s wr, 174 op/s 2024-09-12T02:15:21.807 INFO:teuthology.orchestra.run.smithi110.stderr:3100000 of 3200000 tuples (96%) done (elapsed 6.76 s, remaining 0.22 s) 2024-09-12T02:15:21.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:21 smithi136 ceph-mon[35814]: pgmap v12: 129 pgs: 129 active+clean; 165 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 24 MiB/s wr, 174 op/s 2024-09-12T02:15:21.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:21 smithi110 ceph-mon[30548]: pgmap v12: 129 pgs: 129 active+clean; 165 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 24 MiB/s wr, 174 op/s 2024-09-12T02:15:22.068 INFO:teuthology.orchestra.run.smithi110.stderr:3200000 of 3200000 tuples (100%) done (elapsed 7.02 s, remaining 0.00 s) 2024-09-12T02:15:22.129 INFO:teuthology.orchestra.run.smithi110.stderr:vacuuming... 2024-09-12T02:15:23.104 INFO:teuthology.orchestra.run.smithi110.stderr:creating primary keys... 2024-09-12T02:15:23.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:23 smithi115 ceph-mon[35351]: pgmap v13: 129 pgs: 129 active+clean; 165 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 24 MiB/s wr, 128 op/s 2024-09-12T02:15:23.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:23 smithi136 ceph-mon[35814]: pgmap v13: 129 pgs: 129 active+clean; 165 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 24 MiB/s wr, 128 op/s 2024-09-12T02:15:23.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:23 smithi110 ceph-mon[30548]: pgmap v13: 129 pgs: 129 active+clean; 165 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 24 MiB/s wr, 128 op/s 2024-09-12T02:15:25.061 INFO:teuthology.orchestra.run.smithi110.stderr:done in 10.06 s (drop tables 0.00 s, create tables 0.02 s, client-side generate 7.11 s, vacuum 0.97 s, primary keys 1.96 s). 2024-09-12T02:15:25.068 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-12T02:15:25.171 INFO:teuthology.orchestra.run.smithi110.stderr:starting vacuum...end. 2024-09-12T02:15:25.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:25 smithi115 ceph-mon[35351]: pgmap v14: 129 pgs: 129 active+clean; 365 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 58 MiB/s wr, 153 op/s 2024-09-12T02:15:25.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:25 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:15:25.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:25 smithi136 ceph-mon[35814]: pgmap v14: 129 pgs: 129 active+clean; 365 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 58 MiB/s wr, 153 op/s 2024-09-12T02:15:25.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:25 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:15:25.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:25 smithi110 ceph-mon[30548]: pgmap v14: 129 pgs: 129 active+clean; 365 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 58 MiB/s wr, 153 op/s 2024-09-12T02:15:25.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:25 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:15:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:27 smithi115 ceph-mon[35351]: pgmap v15: 129 pgs: 129 active+clean; 365 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 56 MiB/s wr, 116 op/s 2024-09-12T02:15:27.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:27 smithi136 ceph-mon[35814]: pgmap v15: 129 pgs: 129 active+clean; 365 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 56 MiB/s wr, 116 op/s 2024-09-12T02:15:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:27 smithi110 ceph-mon[30548]: pgmap v15: 129 pgs: 129 active+clean; 365 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 56 MiB/s wr, 116 op/s 2024-09-12T02:15:29.895 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:29 smithi115 ceph-mon[35351]: pgmap v16: 129 pgs: 129 active+clean; 365 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 56 MiB/s wr, 116 op/s 2024-09-12T02:15:29.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:29 smithi136 ceph-mon[35814]: pgmap v16: 129 pgs: 129 active+clean; 365 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 56 MiB/s wr, 116 op/s 2024-09-12T02:15:29.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:29 smithi110 ceph-mon[30548]: pgmap v16: 129 pgs: 129 active+clean; 365 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 56 MiB/s wr, 116 op/s 2024-09-12T02:15:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 5.0 s, 2752.6 tps, lat 34.667 ms stddev 37.643 2024-09-12T02:15:31.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:31 smithi136 ceph-mon[35814]: pgmap v17: 129 pgs: 129 active+clean; 514 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 74 MiB/s wr, 190 op/s 2024-09-12T02:15:31.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:31 smithi110 ceph-mon[30548]: pgmap v17: 129 pgs: 129 active+clean; 514 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 74 MiB/s wr, 190 op/s 2024-09-12T02:15:32.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:31 smithi115 ceph-mon[35351]: pgmap v17: 129 pgs: 129 active+clean; 514 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 74 MiB/s wr, 190 op/s 2024-09-12T02:15:33.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:33 smithi136 ceph-mon[35814]: pgmap v18: 129 pgs: 129 active+clean; 514 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 53 MiB/s wr, 99 op/s 2024-09-12T02:15:33.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:33 smithi110 ceph-mon[30548]: pgmap v18: 129 pgs: 129 active+clean; 514 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 53 MiB/s wr, 99 op/s 2024-09-12T02:15:34.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:33 smithi115 ceph-mon[35351]: pgmap v18: 129 pgs: 129 active+clean; 514 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 53 MiB/s wr, 99 op/s 2024-09-12T02:15:35.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 10.0 s, 2727.6 tps, lat 36.800 ms stddev 44.330 2024-09-12T02:15:35.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:35 smithi136 ceph-mon[35814]: pgmap v19: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 55 MiB/s wr, 361 op/s 2024-09-12T02:15:35.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:35 smithi110 ceph-mon[30548]: pgmap v19: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 55 MiB/s wr, 361 op/s 2024-09-12T02:15:36.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:35 smithi115 ceph-mon[35351]: pgmap v19: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 55 MiB/s wr, 361 op/s 2024-09-12T02:15:37.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:37 smithi136 ceph-mon[35814]: pgmap v20: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 21 MiB/s wr, 336 op/s 2024-09-12T02:15:37.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:37 smithi110 ceph-mon[30548]: pgmap v20: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 21 MiB/s wr, 336 op/s 2024-09-12T02:15:38.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:37 smithi115 ceph-mon[35351]: pgmap v20: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 21 MiB/s wr, 336 op/s 2024-09-12T02:15:39.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:39 smithi136 ceph-mon[35814]: pgmap v21: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 21 MiB/s wr, 336 op/s 2024-09-12T02:15:39.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:39 smithi110 ceph-mon[30548]: pgmap v21: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 21 MiB/s wr, 336 op/s 2024-09-12T02:15:40.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:39 smithi115 ceph-mon[35351]: pgmap v21: 129 pgs: 129 active+clean; 902 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 21 MiB/s wr, 336 op/s 2024-09-12T02:15:40.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 15.0 s, 1955.8 tps, lat 50.969 ms stddev 61.681 2024-09-12T02:15:41.868 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:41 smithi110 ceph-mon[30548]: pgmap v22: 129 pgs: 129 active+clean; 932 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 25 MiB/s wr, 610 op/s 2024-09-12T02:15:41.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:41 smithi136 ceph-mon[35814]: pgmap v22: 129 pgs: 129 active+clean; 932 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 25 MiB/s wr, 610 op/s 2024-09-12T02:15:42.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:41 smithi115 ceph-mon[35351]: pgmap v22: 129 pgs: 129 active+clean; 932 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 25 MiB/s wr, 610 op/s 2024-09-12T02:15:43.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:43 smithi136 ceph-mon[35814]: pgmap v23: 129 pgs: 129 active+clean; 932 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.8 MiB/s wr, 536 op/s 2024-09-12T02:15:43.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:43 smithi110 ceph-mon[30548]: pgmap v23: 129 pgs: 129 active+clean; 932 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.8 MiB/s wr, 536 op/s 2024-09-12T02:15:44.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:43 smithi115 ceph-mon[35351]: pgmap v23: 129 pgs: 129 active+clean; 932 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.8 MiB/s wr, 536 op/s 2024-09-12T02:15:45.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 20.0 s, 2259.6 tps, lat 44.279 ms stddev 54.942 2024-09-12T02:15:45.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:45 smithi136 ceph-mon[35814]: pgmap v24: 129 pgs: 129 active+clean; 971 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 911 op/s 2024-09-12T02:15:45.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:45 smithi110 ceph-mon[30548]: pgmap v24: 129 pgs: 129 active+clean; 971 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 911 op/s 2024-09-12T02:15:46.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:45 smithi115 ceph-mon[35351]: pgmap v24: 129 pgs: 129 active+clean; 971 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 15 MiB/s wr, 911 op/s 2024-09-12T02:15:47.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:47 smithi136 ceph-mon[35814]: pgmap v25: 129 pgs: 129 active+clean; 971 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 MiB/s wr, 648 op/s 2024-09-12T02:15:47.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:47 smithi110 ceph-mon[30548]: pgmap v25: 129 pgs: 129 active+clean; 971 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 MiB/s wr, 648 op/s 2024-09-12T02:15:48.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:47 smithi115 ceph-mon[35351]: pgmap v25: 129 pgs: 129 active+clean; 971 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 MiB/s wr, 648 op/s 2024-09-12T02:15:49.624 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:49 smithi110 ceph-mon[30548]: pgmap v26: 129 pgs: 129 active+clean; 971 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 MiB/s wr, 648 op/s 2024-09-12T02:15:49.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:49 smithi136 ceph-mon[35814]: pgmap v26: 129 pgs: 129 active+clean; 971 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 MiB/s wr, 648 op/s 2024-09-12T02:15:50.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:49 smithi115 ceph-mon[35351]: pgmap v26: 129 pgs: 129 active+clean; 971 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 MiB/s wr, 648 op/s 2024-09-12T02:15:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 25.0 s, 2208.4 tps, lat 45.552 ms stddev 53.997 2024-09-12T02:15:51.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:51 smithi136 ceph-mon[35814]: pgmap v27: 129 pgs: 129 active+clean; 990 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 924 op/s 2024-09-12T02:15:51.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:51 smithi110 ceph-mon[30548]: pgmap v27: 129 pgs: 129 active+clean; 990 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 924 op/s 2024-09-12T02:15:52.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:51 smithi115 ceph-mon[35351]: pgmap v27: 129 pgs: 129 active+clean; 990 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 MiB/s wr, 924 op/s 2024-09-12T02:15:53.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:53 smithi136 ceph-mon[35814]: pgmap v28: 129 pgs: 129 active+clean; 990 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 650 op/s 2024-09-12T02:15:53.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:53 smithi110 ceph-mon[30548]: pgmap v28: 129 pgs: 129 active+clean; 990 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 650 op/s 2024-09-12T02:15:54.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:53 smithi115 ceph-mon[35351]: pgmap v28: 129 pgs: 129 active+clean; 990 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 650 op/s 2024-09-12T02:15:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 30.0 s, 2628.8 tps, lat 38.051 ms stddev 44.262 2024-09-12T02:15:55.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:55 smithi136 ceph-mon[35814]: pgmap v29: 129 pgs: 129 active+clean; 1008 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 938 op/s 2024-09-12T02:15:55.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:55 smithi110 ceph-mon[30548]: pgmap v29: 129 pgs: 129 active+clean; 1008 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 938 op/s 2024-09-12T02:15:56.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:55 smithi115 ceph-mon[35351]: pgmap v29: 129 pgs: 129 active+clean; 1008 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 MiB/s wr, 938 op/s 2024-09-12T02:15:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:57 smithi136 ceph-mon[35814]: pgmap v30: 129 pgs: 129 active+clean; 1008 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.6 MiB/s wr, 563 op/s 2024-09-12T02:15:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:57 smithi110 ceph-mon[30548]: pgmap v30: 129 pgs: 129 active+clean; 1008 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.6 MiB/s wr, 563 op/s 2024-09-12T02:15:58.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:57 smithi115 ceph-mon[35351]: pgmap v30: 129 pgs: 129 active+clean; 1008 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.6 MiB/s wr, 563 op/s 2024-09-12T02:15:59.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:15:59 smithi136 ceph-mon[35814]: pgmap v31: 129 pgs: 129 active+clean; 1008 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.7 MiB/s wr, 580 op/s 2024-09-12T02:15:59.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:15:59 smithi110 ceph-mon[30548]: pgmap v31: 129 pgs: 129 active+clean; 1008 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.7 MiB/s wr, 580 op/s 2024-09-12T02:16:00.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:15:59 smithi115 ceph-mon[35351]: pgmap v31: 129 pgs: 129 active+clean; 1008 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.7 MiB/s wr, 580 op/s 2024-09-12T02:16:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 35.0 s, 2092.0 tps, lat 47.638 ms stddev 54.834 2024-09-12T02:16:01.186 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:16:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:16:00.710+0000 7efd20000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:16:01.186 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:16:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:16:00.710+0000 7efd20000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:16:01.187 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:16:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:16:00.710+0000 7efd20000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:16:01.187 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:16:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:16:00.710+0000 7efd20000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:16:01.187 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:16:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:16:00.710+0000 7efd20000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-12T02:16:01.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:01 smithi136 ceph-mon[35814]: pgmap v32: 129 pgs: 129 active+clean; 1008 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 834 op/s 2024-09-12T02:16:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:01 smithi110 ceph-mon[30548]: pgmap v32: 129 pgs: 129 active+clean; 1008 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 834 op/s 2024-09-12T02:16:02.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:01 smithi115 ceph-mon[35351]: pgmap v32: 129 pgs: 129 active+clean; 1008 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 834 op/s 2024-09-12T02:16:03.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:03 smithi110 ceph-mon[30548]: pgmap v33: 129 pgs: 129 active+clean; 1008 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.6 MiB/s wr, 558 op/s 2024-09-12T02:16:03.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:03 smithi110 ceph-mon[30548]: mgrmap e25: x(active, since 60s), standbys: y, z 2024-09-12T02:16:04.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:03 smithi115 ceph-mon[35351]: pgmap v33: 129 pgs: 129 active+clean; 1008 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.6 MiB/s wr, 558 op/s 2024-09-12T02:16:04.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:03 smithi115 ceph-mon[35351]: mgrmap e25: x(active, since 60s), standbys: y, z 2024-09-12T02:16:04.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:03 smithi136 ceph-mon[35814]: pgmap v33: 129 pgs: 129 active+clean; 1008 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.6 MiB/s wr, 558 op/s 2024-09-12T02:16:04.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:03 smithi136 ceph-mon[35814]: mgrmap e25: x(active, since 60s), standbys: y, z 2024-09-12T02:16:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 40.0 s, 451.0 tps, lat 180.839 ms stddev 254.805 2024-09-12T02:16:05.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:05 smithi110 ceph-mon[30548]: pgmap v34: 129 pgs: 129 active+clean; 1010 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.6 MiB/s wr, 807 op/s 2024-09-12T02:16:06.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:05 smithi115 ceph-mon[35351]: pgmap v34: 129 pgs: 129 active+clean; 1010 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.6 MiB/s wr, 807 op/s 2024-09-12T02:16:06.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:05 smithi136 ceph-mon[35814]: pgmap v34: 129 pgs: 129 active+clean; 1010 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.6 MiB/s wr, 807 op/s 2024-09-12T02:16:07.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:07 smithi110 ceph-mon[30548]: pgmap v35: 129 pgs: 129 active+clean; 1010 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.5 MiB/s wr, 519 op/s 2024-09-12T02:16:08.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:07 smithi115 ceph-mon[35351]: pgmap v35: 129 pgs: 129 active+clean; 1010 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.5 MiB/s wr, 519 op/s 2024-09-12T02:16:08.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:07 smithi136 ceph-mon[35814]: pgmap v35: 129 pgs: 129 active+clean; 1010 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.5 MiB/s wr, 519 op/s 2024-09-12T02:16:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:09 smithi110 ceph-mon[30548]: pgmap v36: 129 pgs: 129 active+clean; 1011 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.5 MiB/s wr, 677 op/s 2024-09-12T02:16:09.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:09 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:16:09.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:09 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:16:09.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:09 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:16:10.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:09 smithi115 ceph-mon[35351]: pgmap v36: 129 pgs: 129 active+clean; 1011 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.5 MiB/s wr, 677 op/s 2024-09-12T02:16:10.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:09 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:16:10.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:09 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:16:10.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:09 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:16:10.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:09 smithi136 ceph-mon[35814]: pgmap v36: 129 pgs: 129 active+clean; 1011 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.5 MiB/s wr, 677 op/s 2024-09-12T02:16:10.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:09 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:16:10.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:09 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:16:10.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:09 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:16:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 45.0 s, 1270.8 tps, lat 93.589 ms stddev 354.096 2024-09-12T02:16:10.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:10 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:16:10.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:10 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:16:10.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:10 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:16:11.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:10 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:16:11.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:10 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:16:11.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:10 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:16:11.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:10 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:16:11.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:10 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:16:11.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:10 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:16:12.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:11 smithi115 ceph-mon[35351]: pgmap v37: 129 pgs: 129 active+clean; 1017 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 36 MiB/s wr, 1.43k op/s 2024-09-12T02:16:12.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:11 smithi136 ceph-mon[35814]: pgmap v37: 129 pgs: 129 active+clean; 1017 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 36 MiB/s wr, 1.43k op/s 2024-09-12T02:16:12.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:11 smithi110 ceph-mon[30548]: pgmap v37: 129 pgs: 129 active+clean; 1017 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 36 MiB/s wr, 1.43k op/s 2024-09-12T02:16:14.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:13 smithi115 ceph-mon[35351]: pgmap v38: 129 pgs: 129 active+clean; 1017 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 34 MiB/s wr, 1.18k op/s 2024-09-12T02:16:14.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:13 smithi136 ceph-mon[35814]: pgmap v38: 129 pgs: 129 active+clean; 1017 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 34 MiB/s wr, 1.18k op/s 2024-09-12T02:16:14.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:13 smithi110 ceph-mon[30548]: pgmap v38: 129 pgs: 129 active+clean; 1017 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 34 MiB/s wr, 1.18k op/s 2024-09-12T02:16:15.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 50.0 s, 1810.4 tps, lat 55.152 ms stddev 87.482 2024-09-12T02:16:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:15 smithi115 ceph-mon[35351]: pgmap v39: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 1.45k op/s 2024-09-12T02:16:16.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:15 smithi136 ceph-mon[35814]: pgmap v39: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 1.45k op/s 2024-09-12T02:16:16.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:15 smithi110 ceph-mon[30548]: pgmap v39: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 MiB/s wr, 1.45k op/s 2024-09-12T02:16:18.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:17 smithi115 ceph-mon[35351]: pgmap v40: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 36 MiB/s wr, 1.20k op/s 2024-09-12T02:16:18.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:17 smithi136 ceph-mon[35814]: pgmap v40: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 36 MiB/s wr, 1.20k op/s 2024-09-12T02:16:18.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:17 smithi110 ceph-mon[30548]: pgmap v40: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 36 MiB/s wr, 1.20k op/s 2024-09-12T02:16:19.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:18 smithi115 ceph-mon[35351]: pgmap v41: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 39 MiB/s wr, 1.46k op/s 2024-09-12T02:16:19.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:18 smithi136 ceph-mon[35814]: pgmap v41: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 39 MiB/s wr, 1.46k op/s 2024-09-12T02:16:19.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:18 smithi110 ceph-mon[30548]: pgmap v41: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 39 MiB/s wr, 1.46k op/s 2024-09-12T02:16:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 55.0 s, 3050.6 tps, lat 32.879 ms stddev 37.217 2024-09-12T02:16:21.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:20 smithi115 ceph-mon[35351]: pgmap v42: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 35 MiB/s wr, 1.41k op/s 2024-09-12T02:16:21.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:20 smithi136 ceph-mon[35814]: pgmap v42: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 35 MiB/s wr, 1.41k op/s 2024-09-12T02:16:21.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:20 smithi110 ceph-mon[30548]: pgmap v42: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 35 MiB/s wr, 1.41k op/s 2024-09-12T02:16:23.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:22 smithi136 ceph-mon[35814]: pgmap v43: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 8.0 MiB/s wr, 640 op/s 2024-09-12T02:16:23.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:22 smithi110 ceph-mon[30548]: pgmap v43: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 8.0 MiB/s wr, 640 op/s 2024-09-12T02:16:23.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:22 smithi115 ceph-mon[35351]: pgmap v43: 129 pgs: 129 active+clean; 1.1 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 8.0 MiB/s wr, 640 op/s 2024-09-12T02:16:25.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:24 smithi136 ceph-mon[35814]: pgmap v44: 129 pgs: 129 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-09-12T02:16:25.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 60.0 s, 3321.4 tps, lat 29.976 ms stddev 35.112 2024-09-12T02:16:25.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:24 smithi110 ceph-mon[30548]: pgmap v44: 129 pgs: 129 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-09-12T02:16:25.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:24 smithi115 ceph-mon[35351]: pgmap v44: 129 pgs: 129 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-09-12T02:16:27.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:26 smithi136 ceph-mon[35814]: pgmap v45: 129 pgs: 129 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 9.0 MiB/s wr, 774 op/s 2024-09-12T02:16:27.189 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:26 smithi110 ceph-mon[30548]: pgmap v45: 129 pgs: 129 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 9.0 MiB/s wr, 774 op/s 2024-09-12T02:16:27.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:26 smithi115 ceph-mon[35351]: pgmap v45: 129 pgs: 129 active+clean; 1.0 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 9.0 MiB/s wr, 774 op/s 2024-09-12T02:16:29.097 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:28 smithi115 ceph-mon[35351]: pgmap v46: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 12 MiB/s wr, 1.02k op/s 2024-09-12T02:16:29.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:28 smithi136 ceph-mon[35814]: pgmap v46: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 12 MiB/s wr, 1.02k op/s 2024-09-12T02:16:29.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:28 smithi110 ceph-mon[30548]: pgmap v46: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 12 MiB/s wr, 1.02k op/s 2024-09-12T02:16:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 65.0 s, 3027.4 tps, lat 32.973 ms stddev 39.906 2024-09-12T02:16:31.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:30 smithi136 ceph-mon[35814]: pgmap v47: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 11 MiB/s wr, 815 op/s 2024-09-12T02:16:31.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:30 smithi110 ceph-mon[30548]: pgmap v47: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 11 MiB/s wr, 815 op/s 2024-09-12T02:16:31.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:30 smithi115 ceph-mon[35351]: pgmap v47: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 11 MiB/s wr, 815 op/s 2024-09-12T02:16:33.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:32 smithi136 ceph-mon[35814]: pgmap v48: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 9.3 MiB/s wr, 702 op/s 2024-09-12T02:16:33.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:32 smithi110 ceph-mon[30548]: pgmap v48: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 9.3 MiB/s wr, 702 op/s 2024-09-12T02:16:33.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:32 smithi115 ceph-mon[35351]: pgmap v48: 129 pgs: 129 active+clean; 1.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 9.3 MiB/s wr, 702 op/s 2024-09-12T02:16:35.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:34 smithi136 ceph-mon[35814]: pgmap v49: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2024-09-12T02:16:35.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:34 smithi136 ceph-mon[35814]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-12T02:16:35.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 70.0 s, 2344.2 tps, lat 42.547 ms stddev 50.562 2024-09-12T02:16:35.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:34 smithi110 ceph-mon[30548]: pgmap v49: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2024-09-12T02:16:35.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:34 smithi110 ceph-mon[30548]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-12T02:16:35.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:34 smithi115 ceph-mon[35351]: pgmap v49: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2024-09-12T02:16:35.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:34 smithi115 ceph-mon[35351]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-12T02:16:37.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:36 smithi136 ceph-mon[35814]: pgmap v50: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 697 op/s 2024-09-12T02:16:37.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:36 smithi110 ceph-mon[30548]: pgmap v50: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 697 op/s 2024-09-12T02:16:37.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:36 smithi115 ceph-mon[35351]: pgmap v50: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 697 op/s 2024-09-12T02:16:39.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:38 smithi136 ceph-mon[35814]: pgmap v51: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 730 op/s 2024-09-12T02:16:39.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:38 smithi110 ceph-mon[30548]: pgmap v51: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 730 op/s 2024-09-12T02:16:39.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:38 smithi115 ceph-mon[35351]: pgmap v51: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 730 op/s 2024-09-12T02:16:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 75.0 s, 1833.2 tps, lat 54.834 ms stddev 63.814 2024-09-12T02:16:41.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:40 smithi136 ceph-mon[35814]: pgmap v52: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.0 MiB/s wr, 713 op/s 2024-09-12T02:16:41.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:40 smithi110 ceph-mon[30548]: pgmap v52: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.0 MiB/s wr, 713 op/s 2024-09-12T02:16:41.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:40 smithi115 ceph-mon[35351]: pgmap v52: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.0 MiB/s wr, 713 op/s 2024-09-12T02:16:43.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:42 smithi136 ceph-mon[35814]: pgmap v53: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 656 op/s 2024-09-12T02:16:43.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:42 smithi110 ceph-mon[30548]: pgmap v53: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 656 op/s 2024-09-12T02:16:43.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:42 smithi115 ceph-mon[35351]: pgmap v53: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 656 op/s 2024-09-12T02:16:45.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:44 smithi136 ceph-mon[35814]: pgmap v54: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 919 op/s 2024-09-12T02:16:45.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 80.0 s, 2163.8 tps, lat 45.751 ms stddev 59.048 2024-09-12T02:16:45.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:44 smithi110 ceph-mon[30548]: pgmap v54: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 919 op/s 2024-09-12T02:16:45.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:44 smithi115 ceph-mon[35351]: pgmap v54: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 919 op/s 2024-09-12T02:16:47.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:46 smithi136 ceph-mon[35814]: pgmap v55: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.1 MiB/s wr, 524 op/s 2024-09-12T02:16:47.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:46 smithi110 ceph-mon[30548]: pgmap v55: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.1 MiB/s wr, 524 op/s 2024-09-12T02:16:47.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:46 smithi115 ceph-mon[35351]: pgmap v55: 129 pgs: 129 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.1 MiB/s wr, 524 op/s 2024-09-12T02:16:49.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:48 smithi136 ceph-mon[35814]: pgmap v56: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.8 MiB/s wr, 660 op/s 2024-09-12T02:16:49.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:48 smithi110 ceph-mon[30548]: pgmap v56: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.8 MiB/s wr, 660 op/s 2024-09-12T02:16:49.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:48 smithi115 ceph-mon[35351]: pgmap v56: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.8 MiB/s wr, 660 op/s 2024-09-12T02:16:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 85.0 s, 1858.8 tps, lat 53.955 ms stddev 65.473 2024-09-12T02:16:51.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:50 smithi136 ceph-mon[35814]: pgmap v57: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 875 op/s 2024-09-12T02:16:51.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:50 smithi110 ceph-mon[30548]: pgmap v57: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 875 op/s 2024-09-12T02:16:51.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:50 smithi115 ceph-mon[35351]: pgmap v57: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 875 op/s 2024-09-12T02:16:53.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:52 smithi136 ceph-mon[35814]: pgmap v58: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 MiB/s wr, 646 op/s 2024-09-12T02:16:53.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:52 smithi110 ceph-mon[30548]: pgmap v58: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 MiB/s wr, 646 op/s 2024-09-12T02:16:53.298 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:52 smithi115 ceph-mon[35351]: pgmap v58: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 MiB/s wr, 646 op/s 2024-09-12T02:16:55.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:54 smithi136 ceph-mon[35814]: pgmap v59: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 901 op/s 2024-09-12T02:16:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 90.0 s, 1592.8 tps, lat 63.015 ms stddev 102.252 2024-09-12T02:16:55.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:54 smithi110 ceph-mon[30548]: pgmap v59: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 901 op/s 2024-09-12T02:16:55.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:54 smithi115 ceph-mon[35351]: pgmap v59: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 901 op/s 2024-09-12T02:16:57.189 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:56 smithi110 ceph-mon[30548]: pgmap v60: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.8 MiB/s wr, 655 op/s 2024-09-12T02:16:57.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:56 smithi115 ceph-mon[35351]: pgmap v60: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.8 MiB/s wr, 655 op/s 2024-09-12T02:16:57.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:56 smithi136 ceph-mon[35814]: pgmap v60: 129 pgs: 129 active+clean; 1.2 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.8 MiB/s wr, 655 op/s 2024-09-12T02:16:59.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:16:58 smithi110 ceph-mon[30548]: pgmap v61: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 886 op/s 2024-09-12T02:16:59.210 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:16:58 smithi136 ceph-mon[35814]: pgmap v61: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 886 op/s 2024-09-12T02:16:59.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:16:58 smithi115 ceph-mon[35351]: pgmap v61: 129 pgs: 129 active+clean; 1.2 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 886 op/s 2024-09-12T02:17:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 95.0 s, 1550.4 tps, lat 58.246 ms stddev 88.862 2024-09-12T02:17:01.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:00 smithi110 ceph-mon[30548]: pgmap v62: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 860 op/s 2024-09-12T02:17:01.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:00 smithi115 ceph-mon[35351]: pgmap v62: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 860 op/s 2024-09-12T02:17:01.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:00 smithi136 ceph-mon[35814]: pgmap v62: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 860 op/s 2024-09-12T02:17:03.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:02 smithi115 ceph-mon[35351]: pgmap v63: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.5 MiB/s wr, 613 op/s 2024-09-12T02:17:03.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:02 smithi136 ceph-mon[35814]: pgmap v63: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.5 MiB/s wr, 613 op/s 2024-09-12T02:17:03.443 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:02 smithi110 ceph-mon[30548]: pgmap v63: 129 pgs: 129 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.5 MiB/s wr, 613 op/s 2024-09-12T02:17:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 100.0 s, 642.8 tps, lat 169.072 ms stddev 391.415 2024-09-12T02:17:05.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:04 smithi115 ceph-mon[35351]: pgmap v64: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 1.59k op/s 2024-09-12T02:17:05.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:04 smithi136 ceph-mon[35814]: pgmap v64: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 1.59k op/s 2024-09-12T02:17:05.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:04 smithi110 ceph-mon[30548]: pgmap v64: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 28 MiB/s wr, 1.59k op/s 2024-09-12T02:17:07.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:06 smithi115 ceph-mon[35351]: pgmap v65: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 1.53k op/s 2024-09-12T02:17:07.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:06 smithi136 ceph-mon[35814]: pgmap v65: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 1.53k op/s 2024-09-12T02:17:07.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:06 smithi110 ceph-mon[30548]: pgmap v65: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 MiB/s wr, 1.53k op/s 2024-09-12T02:17:09.241 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:08 smithi110 ceph-mon[30548]: pgmap v66: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 MiB/s wr, 1.74k op/s 2024-09-12T02:17:09.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:08 smithi115 ceph-mon[35351]: pgmap v66: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 MiB/s wr, 1.74k op/s 2024-09-12T02:17:09.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:08 smithi136 ceph-mon[35814]: pgmap v66: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 MiB/s wr, 1.74k op/s 2024-09-12T02:17:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 105.0 s, 2716.2 tps, lat 37.191 ms stddev 46.396 2024-09-12T02:17:11.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:10 smithi115 ceph-mon[35351]: pgmap v67: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 MiB/s wr, 1.58k op/s 2024-09-12T02:17:11.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:10 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:17:11.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:10 smithi136 ceph-mon[35814]: pgmap v67: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 MiB/s wr, 1.58k op/s 2024-09-12T02:17:11.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:10 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:17:11.439 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:10 smithi110 ceph-mon[30548]: pgmap v67: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 MiB/s wr, 1.58k op/s 2024-09-12T02:17:11.439 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:10 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:17:12.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:11 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:17:12.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:11 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:17:12.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:11 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:17:12.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:11 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:17:12.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:11 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:17:12.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:11 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:17:12.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:11 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:17:12.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:11 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:17:12.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:11 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:17:13.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:12 smithi115 ceph-mon[35351]: pgmap v68: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 1.47k op/s 2024-09-12T02:17:13.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:12 smithi136 ceph-mon[35814]: pgmap v68: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 1.47k op/s 2024-09-12T02:17:13.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:12 smithi110 ceph-mon[30548]: pgmap v68: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 1.47k op/s 2024-09-12T02:17:15.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 110.0 s, 1740.2 tps, lat 56.835 ms stddev 65.304 2024-09-12T02:17:15.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:14 smithi115 ceph-mon[35351]: pgmap v69: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 MiB/s wr, 1.71k op/s 2024-09-12T02:17:15.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:14 smithi136 ceph-mon[35814]: pgmap v69: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 MiB/s wr, 1.71k op/s 2024-09-12T02:17:15.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:14 smithi110 ceph-mon[30548]: pgmap v69: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 MiB/s wr, 1.71k op/s 2024-09-12T02:17:17.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:16 smithi115 ceph-mon[35351]: pgmap v70: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.7 MiB/s wr, 761 op/s 2024-09-12T02:17:17.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:16 smithi136 ceph-mon[35814]: pgmap v70: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.7 MiB/s wr, 761 op/s 2024-09-12T02:17:17.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:16 smithi110 ceph-mon[30548]: pgmap v70: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.7 MiB/s wr, 761 op/s 2024-09-12T02:17:19.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:18 smithi115 ceph-mon[35351]: pgmap v71: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.8 MiB/s wr, 682 op/s 2024-09-12T02:17:19.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:18 smithi136 ceph-mon[35814]: pgmap v71: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.8 MiB/s wr, 682 op/s 2024-09-12T02:17:19.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:18 smithi110 ceph-mon[30548]: pgmap v71: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.8 MiB/s wr, 682 op/s 2024-09-12T02:17:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 115.0 s, 1935.4 tps, lat 52.225 ms stddev 68.094 2024-09-12T02:17:21.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:20 smithi115 ceph-mon[35351]: pgmap v72: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-09-12T02:17:21.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:20 smithi136 ceph-mon[35814]: pgmap v72: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-09-12T02:17:21.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:20 smithi110 ceph-mon[30548]: pgmap v72: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-09-12T02:17:23.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:23 smithi115 ceph-mon[35351]: pgmap v73: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 527 op/s 2024-09-12T02:17:23.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:23 smithi136 ceph-mon[35814]: pgmap v73: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 527 op/s 2024-09-12T02:17:23.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:23 smithi110 ceph-mon[30548]: pgmap v73: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.2 MiB/s wr, 527 op/s 2024-09-12T02:17:25.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 120.0 s, 2155.2 tps, lat 46.158 ms stddev 58.404 2024-09-12T02:17:25.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:25 smithi115 ceph-mon[35351]: pgmap v74: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.5 MiB/s wr, 775 op/s 2024-09-12T02:17:25.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:25 smithi136 ceph-mon[35814]: pgmap v74: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.5 MiB/s wr, 775 op/s 2024-09-12T02:17:25.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:25 smithi110 ceph-mon[30548]: pgmap v74: 129 pgs: 129 active+clean; 1.5 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 8.5 MiB/s wr, 775 op/s 2024-09-12T02:17:27.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:27 smithi115 ceph-mon[35351]: pgmap v75: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.5 MiB/s wr, 567 op/s 2024-09-12T02:17:27.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:27 smithi136 ceph-mon[35814]: pgmap v75: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.5 MiB/s wr, 567 op/s 2024-09-12T02:17:27.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:27 smithi110 ceph-mon[30548]: pgmap v75: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.5 MiB/s wr, 567 op/s 2024-09-12T02:17:29.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:29 smithi115 ceph-mon[35351]: pgmap v76: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.0 MiB/s wr, 628 op/s 2024-09-12T02:17:29.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:29 smithi136 ceph-mon[35814]: pgmap v76: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.0 MiB/s wr, 628 op/s 2024-09-12T02:17:29.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:29 smithi110 ceph-mon[30548]: pgmap v76: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.0 MiB/s wr, 628 op/s 2024-09-12T02:17:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 125.0 s, 1761.2 tps, lat 56.185 ms stddev 77.914 2024-09-12T02:17:31.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:31 smithi115 ceph-mon[35351]: pgmap v77: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.6 MiB/s wr, 675 op/s 2024-09-12T02:17:31.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:31 smithi136 ceph-mon[35814]: pgmap v77: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.6 MiB/s wr, 675 op/s 2024-09-12T02:17:31.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:31 smithi110 ceph-mon[30548]: pgmap v77: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.6 MiB/s wr, 675 op/s 2024-09-12T02:17:33.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:33 smithi115 ceph-mon[35351]: pgmap v78: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 530 op/s 2024-09-12T02:17:33.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:33 smithi136 ceph-mon[35814]: pgmap v78: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 530 op/s 2024-09-12T02:17:33.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:33 smithi110 ceph-mon[30548]: pgmap v78: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.9 MiB/s wr, 530 op/s 2024-09-12T02:17:35.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 130.0 s, 1566.6 tps, lat 63.935 ms stddev 79.656 2024-09-12T02:17:35.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:35 smithi115 ceph-mon[35351]: pgmap v79: 129 pgs: 129 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 810 op/s 2024-09-12T02:17:35.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:35 smithi136 ceph-mon[35814]: pgmap v79: 129 pgs: 129 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 810 op/s 2024-09-12T02:17:35.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:35 smithi110 ceph-mon[30548]: pgmap v79: 129 pgs: 129 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.9 MiB/s wr, 810 op/s 2024-09-12T02:17:37.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:37 smithi115 ceph-mon[35351]: pgmap v80: 129 pgs: 129 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.4 MiB/s wr, 615 op/s 2024-09-12T02:17:37.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:37 smithi136 ceph-mon[35814]: pgmap v80: 129 pgs: 129 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.4 MiB/s wr, 615 op/s 2024-09-12T02:17:37.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:37 smithi110 ceph-mon[30548]: pgmap v80: 129 pgs: 129 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.4 MiB/s wr, 615 op/s 2024-09-12T02:17:39.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:39 smithi136 ceph-mon[35814]: pgmap v81: 129 pgs: 129 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.8 MiB/s wr, 677 op/s 2024-09-12T02:17:39.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:39 smithi110 ceph-mon[30548]: pgmap v81: 129 pgs: 129 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.8 MiB/s wr, 677 op/s 2024-09-12T02:17:39.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:39 smithi115 ceph-mon[35351]: pgmap v81: 129 pgs: 129 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.8 MiB/s wr, 677 op/s 2024-09-12T02:17:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 135.0 s, 1598.6 tps, lat 63.158 ms stddev 82.401 2024-09-12T02:17:41.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:41 smithi136 ceph-mon[35814]: pgmap v82: 129 pgs: 129 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 735 op/s 2024-09-12T02:17:41.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:41 smithi110 ceph-mon[30548]: pgmap v82: 129 pgs: 129 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 735 op/s 2024-09-12T02:17:41.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:41 smithi115 ceph-mon[35351]: pgmap v82: 129 pgs: 129 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 735 op/s 2024-09-12T02:17:43.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:43 smithi136 ceph-mon[35814]: pgmap v83: 129 pgs: 129 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 573 op/s 2024-09-12T02:17:43.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:43 smithi110 ceph-mon[30548]: pgmap v83: 129 pgs: 129 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 573 op/s 2024-09-12T02:17:43.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:43 smithi115 ceph-mon[35351]: pgmap v83: 129 pgs: 129 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 573 op/s 2024-09-12T02:17:45.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 140.0 s, 1710.3 tps, lat 57.813 ms stddev 72.196 2024-09-12T02:17:45.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:45 smithi136 ceph-mon[35814]: pgmap v84: 129 pgs: 129 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.4 MiB/s wr, 801 op/s 2024-09-12T02:17:45.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:45 smithi110 ceph-mon[30548]: pgmap v84: 129 pgs: 129 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.4 MiB/s wr, 801 op/s 2024-09-12T02:17:45.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:45 smithi115 ceph-mon[35351]: pgmap v84: 129 pgs: 129 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.4 MiB/s wr, 801 op/s 2024-09-12T02:17:47.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:47 smithi136 ceph-mon[35814]: pgmap v85: 129 pgs: 129 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 549 op/s 2024-09-12T02:17:47.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:47 smithi110 ceph-mon[30548]: pgmap v85: 129 pgs: 129 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 549 op/s 2024-09-12T02:17:47.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:47 smithi115 ceph-mon[35351]: pgmap v85: 129 pgs: 129 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 549 op/s 2024-09-12T02:17:49.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:49 smithi136 ceph-mon[35814]: pgmap v86: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 868 op/s 2024-09-12T02:17:49.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:49 smithi110 ceph-mon[30548]: pgmap v86: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 868 op/s 2024-09-12T02:17:49.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:49 smithi115 ceph-mon[35351]: pgmap v86: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 868 op/s 2024-09-12T02:17:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 145.0 s, 938.6 tps, lat 106.600 ms stddev 213.725 2024-09-12T02:17:51.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:51 smithi136 ceph-mon[35814]: pgmap v87: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 16 MiB/s wr, 1.17k op/s 2024-09-12T02:17:51.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:51 smithi110 ceph-mon[30548]: pgmap v87: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 16 MiB/s wr, 1.17k op/s 2024-09-12T02:17:51.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:51 smithi115 ceph-mon[35351]: pgmap v87: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 16 MiB/s wr, 1.17k op/s 2024-09-12T02:17:53.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:53 smithi136 ceph-mon[35814]: pgmap v88: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 15 MiB/s wr, 1.02k op/s 2024-09-12T02:17:53.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:53 smithi110 ceph-mon[30548]: pgmap v88: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 15 MiB/s wr, 1.02k op/s 2024-09-12T02:17:53.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:53 smithi115 ceph-mon[35351]: pgmap v88: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 15 MiB/s wr, 1.02k op/s 2024-09-12T02:17:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 150.0 s, 1143.8 tps, lat 86.853 ms stddev 91.487 2024-09-12T02:17:55.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:55 smithi136 ceph-mon[35814]: pgmap v89: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 1.23k op/s 2024-09-12T02:17:55.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:55 smithi110 ceph-mon[30548]: pgmap v89: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 1.23k op/s 2024-09-12T02:17:55.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:55 smithi115 ceph-mon[35351]: pgmap v89: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 MiB/s wr, 1.23k op/s 2024-09-12T02:17:57.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:57 smithi136 ceph-mon[35814]: pgmap v90: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-09-12T02:17:57.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:57 smithi110 ceph-mon[30548]: pgmap v90: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-09-12T02:17:57.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:57 smithi115 ceph-mon[35351]: pgmap v90: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-09-12T02:17:59.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:17:59 smithi136 ceph-mon[35814]: pgmap v91: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2024-09-12T02:17:59.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:17:59 smithi110 ceph-mon[30548]: pgmap v91: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2024-09-12T02:17:59.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:17:59 smithi115 ceph-mon[35351]: pgmap v91: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 1.10k op/s 2024-09-12T02:18:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 155.0 s, 1151.8 tps, lat 87.587 ms stddev 100.469 2024-09-12T02:18:00.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:00 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:18:00.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:00 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:18:00.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:00 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:18:01.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:01 smithi110 ceph-mon[30548]: pgmap v92: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.8 MiB/s wr, 874 op/s 2024-09-12T02:18:01.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:01 smithi115 ceph-mon[35351]: pgmap v92: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.8 MiB/s wr, 874 op/s 2024-09-12T02:18:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:01 smithi136 ceph-mon[35814]: pgmap v92: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.8 MiB/s wr, 874 op/s 2024-09-12T02:18:03.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:03 smithi110 ceph-mon[30548]: pgmap v93: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.1 MiB/s wr, 480 op/s 2024-09-12T02:18:03.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:03 smithi115 ceph-mon[35351]: pgmap v93: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.1 MiB/s wr, 480 op/s 2024-09-12T02:18:03.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:03 smithi136 ceph-mon[35814]: pgmap v93: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.1 MiB/s wr, 480 op/s 2024-09-12T02:18:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 160.0 s, 636.2 tps, lat 156.981 ms stddev 318.582 2024-09-12T02:18:05.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:05 smithi110 ceph-mon[30548]: pgmap v94: 129 pgs: 129 active+clean; 1.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 1.35k op/s 2024-09-12T02:18:05.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:05 smithi115 ceph-mon[35351]: pgmap v94: 129 pgs: 129 active+clean; 1.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 1.35k op/s 2024-09-12T02:18:05.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:05 smithi136 ceph-mon[35814]: pgmap v94: 129 pgs: 129 active+clean; 1.9 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 16 MiB/s wr, 1.35k op/s 2024-09-12T02:18:07.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:07 smithi110 ceph-mon[30548]: pgmap v95: 129 pgs: 129 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 1.30k op/s 2024-09-12T02:18:07.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:07 smithi115 ceph-mon[35351]: pgmap v95: 129 pgs: 129 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 1.30k op/s 2024-09-12T02:18:07.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:07 smithi136 ceph-mon[35814]: pgmap v95: 129 pgs: 129 active+clean; 1.9 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 1.30k op/s 2024-09-12T02:18:09.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:09 smithi115 ceph-mon[35351]: pgmap v96: 129 pgs: 129 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 1.35k op/s 2024-09-12T02:18:09.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:09 smithi136 ceph-mon[35814]: pgmap v96: 129 pgs: 129 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 1.35k op/s 2024-09-12T02:18:09.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:09 smithi110 ceph-mon[30548]: pgmap v96: 129 pgs: 129 active+clean; 1.9 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 1.35k op/s 2024-09-12T02:18:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 165.0 s, 1425.6 tps, lat 70.933 ms stddev 103.182 2024-09-12T02:18:10.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:10 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:18:10.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:10 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:18:10.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:10 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:18:11.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:11 smithi115 ceph-mon[35351]: pgmap v97: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 1.40k op/s 2024-09-12T02:18:11.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:11 smithi136 ceph-mon[35814]: pgmap v97: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 1.40k op/s 2024-09-12T02:18:11.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:11 smithi110 ceph-mon[30548]: pgmap v97: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 1.40k op/s 2024-09-12T02:18:12.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:12 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:18:12.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:12 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:18:12.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:12 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:18:13.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:13 smithi115 ceph-mon[35351]: pgmap v98: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 1.26k op/s 2024-09-12T02:18:13.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:13 smithi136 ceph-mon[35814]: pgmap v98: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 1.26k op/s 2024-09-12T02:18:13.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:13 smithi110 ceph-mon[30548]: pgmap v98: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 16 MiB/s wr, 1.26k op/s 2024-09-12T02:18:14.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:14 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:18:14.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:14 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:18:14.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:14 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:18:14.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:14 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:18:14.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:14 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:18:14.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:14 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:18:14.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:14 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:18:14.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:14 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:18:14.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:14 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:18:15.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 170.0 s, 1515.0 tps, lat 64.154 ms stddev 77.931 2024-09-12T02:18:15.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:15 smithi136 ceph-mon[35814]: pgmap v99: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 19 MiB/s wr, 1.48k op/s 2024-09-12T02:18:15.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:15 smithi110 ceph-mon[30548]: pgmap v99: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 19 MiB/s wr, 1.48k op/s 2024-09-12T02:18:15.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:15 smithi115 ceph-mon[35351]: pgmap v99: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 19 MiB/s wr, 1.48k op/s 2024-09-12T02:18:17.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:17 smithi136 ceph-mon[35814]: pgmap v100: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 634 op/s 2024-09-12T02:18:17.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:17 smithi110 ceph-mon[30548]: pgmap v100: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 634 op/s 2024-09-12T02:18:17.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:17 smithi115 ceph-mon[35351]: pgmap v100: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 634 op/s 2024-09-12T02:18:19.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:19 smithi136 ceph-mon[35814]: pgmap v101: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.6 MiB/s wr, 588 op/s 2024-09-12T02:18:19.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:19 smithi110 ceph-mon[30548]: pgmap v101: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.6 MiB/s wr, 588 op/s 2024-09-12T02:18:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:19 smithi115 ceph-mon[35351]: pgmap v101: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.6 MiB/s wr, 588 op/s 2024-09-12T02:18:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 175.0 s, 1110.6 tps, lat 91.661 ms stddev 113.711 2024-09-12T02:18:21.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:21 smithi136 ceph-mon[35814]: pgmap v102: 129 pgs: 129 active+clean; 2.0 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 682 op/s 2024-09-12T02:18:21.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:21 smithi110 ceph-mon[30548]: pgmap v102: 129 pgs: 129 active+clean; 2.0 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 682 op/s 2024-09-12T02:18:21.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:21 smithi115 ceph-mon[35351]: pgmap v102: 129 pgs: 129 active+clean; 2.0 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 682 op/s 2024-09-12T02:18:23.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:23 smithi136 ceph-mon[35814]: pgmap v103: 129 pgs: 129 active+clean; 2.0 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 538 op/s 2024-09-12T02:18:23.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:23 smithi110 ceph-mon[30548]: pgmap v103: 129 pgs: 129 active+clean; 2.0 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 538 op/s 2024-09-12T02:18:23.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:23 smithi115 ceph-mon[35351]: pgmap v103: 129 pgs: 129 active+clean; 2.0 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 538 op/s 2024-09-12T02:18:25.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 180.0 s, 1342.5 tps, lat 74.656 ms stddev 91.429 2024-09-12T02:18:25.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:25 smithi136 ceph-mon[35814]: pgmap v104: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 755 op/s 2024-09-12T02:18:25.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:25 smithi110 ceph-mon[30548]: pgmap v104: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 755 op/s 2024-09-12T02:18:25.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:25 smithi115 ceph-mon[35351]: pgmap v104: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.9 MiB/s wr, 755 op/s 2024-09-12T02:18:27.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:27 smithi136 ceph-mon[35814]: pgmap v105: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.5 MiB/s wr, 589 op/s 2024-09-12T02:18:27.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:27 smithi110 ceph-mon[30548]: pgmap v105: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.5 MiB/s wr, 589 op/s 2024-09-12T02:18:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:27 smithi115 ceph-mon[35351]: pgmap v105: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.5 MiB/s wr, 589 op/s 2024-09-12T02:18:29.596 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:29 smithi115 ceph-mon[35351]: pgmap v106: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.6 MiB/s wr, 698 op/s 2024-09-12T02:18:29.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:29 smithi136 ceph-mon[35814]: pgmap v106: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.6 MiB/s wr, 698 op/s 2024-09-12T02:18:29.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:29 smithi110 ceph-mon[30548]: pgmap v106: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.6 MiB/s wr, 698 op/s 2024-09-12T02:18:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 185.0 s, 1159.6 tps, lat 85.395 ms stddev 109.218 2024-09-12T02:18:31.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:31 smithi136 ceph-mon[35814]: pgmap v107: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 702 op/s 2024-09-12T02:18:31.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:31 smithi110 ceph-mon[30548]: pgmap v107: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 702 op/s 2024-09-12T02:18:31.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:31 smithi115 ceph-mon[35351]: pgmap v107: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 702 op/s 2024-09-12T02:18:33.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:33 smithi136 ceph-mon[35814]: pgmap v108: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 MiB/s wr, 521 op/s 2024-09-12T02:18:33.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:33 smithi110 ceph-mon[30548]: pgmap v108: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 MiB/s wr, 521 op/s 2024-09-12T02:18:33.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:33 smithi115 ceph-mon[35351]: pgmap v108: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 MiB/s wr, 521 op/s 2024-09-12T02:18:35.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 190.0 s, 772.8 tps, lat 129.911 ms stddev 176.587 2024-09-12T02:18:35.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:35 smithi136 ceph-mon[35814]: pgmap v109: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 744 op/s 2024-09-12T02:18:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:35 smithi110 ceph-mon[30548]: pgmap v109: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 744 op/s 2024-09-12T02:18:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:35 smithi115 ceph-mon[35351]: pgmap v109: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 744 op/s 2024-09-12T02:18:37.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:37 smithi136 ceph-mon[35814]: pgmap v110: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-09-12T02:18:37.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:37 smithi110 ceph-mon[30548]: pgmap v110: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-09-12T02:18:37.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:37 smithi115 ceph-mon[35351]: pgmap v110: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-09-12T02:18:39.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:39 smithi136 ceph-mon[35814]: pgmap v111: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.1 MiB/s wr, 679 op/s 2024-09-12T02:18:39.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:39 smithi110 ceph-mon[30548]: pgmap v111: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.1 MiB/s wr, 679 op/s 2024-09-12T02:18:39.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:39 smithi115 ceph-mon[35351]: pgmap v111: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.1 MiB/s wr, 679 op/s 2024-09-12T02:18:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 195.0 s, 912.8 tps, lat 110.733 ms stddev 152.762 2024-09-12T02:18:41.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:41 smithi136 ceph-mon[35814]: pgmap v112: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 677 op/s 2024-09-12T02:18:41.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:41 smithi110 ceph-mon[30548]: pgmap v112: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 677 op/s 2024-09-12T02:18:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:41 smithi115 ceph-mon[35351]: pgmap v112: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 677 op/s 2024-09-12T02:18:43.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:43 smithi136 ceph-mon[35814]: pgmap v113: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.1 MiB/s wr, 568 op/s 2024-09-12T02:18:43.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:43 smithi110 ceph-mon[30548]: pgmap v113: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.1 MiB/s wr, 568 op/s 2024-09-12T02:18:43.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:43 smithi115 ceph-mon[35351]: pgmap v113: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.1 MiB/s wr, 568 op/s 2024-09-12T02:18:45.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 200.0 s, 2260.8 tps, lat 44.142 ms stddev 50.020 2024-09-12T02:18:45.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:45 smithi136 ceph-mon[35814]: pgmap v114: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.3 MiB/s wr, 804 op/s 2024-09-12T02:18:45.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:45 smithi110 ceph-mon[30548]: pgmap v114: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.3 MiB/s wr, 804 op/s 2024-09-12T02:18:45.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:45 smithi115 ceph-mon[35351]: pgmap v114: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.3 MiB/s wr, 804 op/s 2024-09-12T02:18:47.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:47 smithi110 ceph-mon[30548]: pgmap v115: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.8 MiB/s wr, 612 op/s 2024-09-12T02:18:47.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:47 smithi115 ceph-mon[35351]: pgmap v115: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.8 MiB/s wr, 612 op/s 2024-09-12T02:18:47.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:47 smithi136 ceph-mon[35814]: pgmap v115: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.8 MiB/s wr, 612 op/s 2024-09-12T02:18:49.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:49 smithi110 ceph-mon[30548]: pgmap v116: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.3 MiB/s wr, 673 op/s 2024-09-12T02:18:49.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:49 smithi115 ceph-mon[35351]: pgmap v116: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.3 MiB/s wr, 673 op/s 2024-09-12T02:18:49.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:49 smithi136 ceph-mon[35814]: pgmap v116: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.3 MiB/s wr, 673 op/s 2024-09-12T02:18:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 205.0 s, 1391.4 tps, lat 70.842 ms stddev 86.572 2024-09-12T02:18:51.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:51 smithi110 ceph-mon[30548]: pgmap v117: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.3 MiB/s wr, 676 op/s 2024-09-12T02:18:51.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:51 smithi115 ceph-mon[35351]: pgmap v117: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.3 MiB/s wr, 676 op/s 2024-09-12T02:18:51.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:51 smithi136 ceph-mon[35814]: pgmap v117: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.3 MiB/s wr, 676 op/s 2024-09-12T02:18:53.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:53 smithi110 ceph-mon[30548]: pgmap v118: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.2 MiB/s wr, 536 op/s 2024-09-12T02:18:53.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:53 smithi115 ceph-mon[35351]: pgmap v118: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.2 MiB/s wr, 536 op/s 2024-09-12T02:18:53.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:53 smithi136 ceph-mon[35814]: pgmap v118: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.2 MiB/s wr, 536 op/s 2024-09-12T02:18:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 210.0 s, 775.6 tps, lat 129.893 ms stddev 138.531 2024-09-12T02:18:55.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:55 smithi110 ceph-mon[30548]: pgmap v119: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.9 MiB/s wr, 735 op/s 2024-09-12T02:18:55.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:55 smithi115 ceph-mon[35351]: pgmap v119: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.9 MiB/s wr, 735 op/s 2024-09-12T02:18:55.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:55 smithi136 ceph-mon[35814]: pgmap v119: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.9 MiB/s wr, 735 op/s 2024-09-12T02:18:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:57 smithi115 ceph-mon[35351]: pgmap v120: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 MiB/s wr, 528 op/s 2024-09-12T02:18:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:57 smithi136 ceph-mon[35814]: pgmap v120: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 MiB/s wr, 528 op/s 2024-09-12T02:18:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:57 smithi110 ceph-mon[30548]: pgmap v120: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.0 MiB/s wr, 528 op/s 2024-09-12T02:18:59.710 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:18:59 smithi136 ceph-mon[35814]: pgmap v121: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.4 MiB/s wr, 611 op/s 2024-09-12T02:18:59.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:18:59 smithi115 ceph-mon[35351]: pgmap v121: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.4 MiB/s wr, 611 op/s 2024-09-12T02:18:59.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:18:59 smithi110 ceph-mon[30548]: pgmap v121: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.4 MiB/s wr, 611 op/s 2024-09-12T02:19:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 215.0 s, 763.4 tps, lat 129.462 ms stddev 146.984 2024-09-12T02:19:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:01 smithi115 ceph-mon[35351]: pgmap v122: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 MiB/s wr, 624 op/s 2024-09-12T02:19:01.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:01 smithi136 ceph-mon[35814]: pgmap v122: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 MiB/s wr, 624 op/s 2024-09-12T02:19:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:01 smithi110 ceph-mon[30548]: pgmap v122: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 MiB/s wr, 624 op/s 2024-09-12T02:19:03.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:03 smithi115 ceph-mon[35351]: pgmap v123: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.8 MiB/s wr, 455 op/s 2024-09-12T02:19:03.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:03 smithi136 ceph-mon[35814]: pgmap v123: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.8 MiB/s wr, 455 op/s 2024-09-12T02:19:03.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:03 smithi110 ceph-mon[30548]: pgmap v123: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.8 MiB/s wr, 455 op/s 2024-09-12T02:19:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 220.0 s, 259.8 tps, lat 382.939 ms stddev 772.582 2024-09-12T02:19:05.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:05 smithi115 ceph-mon[35351]: pgmap v124: 129 pgs: 129 active+clean; 2.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 1.46k op/s 2024-09-12T02:19:05.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:05 smithi136 ceph-mon[35814]: pgmap v124: 129 pgs: 129 active+clean; 2.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 1.46k op/s 2024-09-12T02:19:05.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:05 smithi110 ceph-mon[30548]: pgmap v124: 129 pgs: 129 active+clean; 2.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 1.46k op/s 2024-09-12T02:19:07.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:07 smithi115 ceph-mon[35351]: pgmap v125: 129 pgs: 129 active+clean; 2.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 1.48k op/s 2024-09-12T02:19:07.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:07 smithi136 ceph-mon[35814]: pgmap v125: 129 pgs: 129 active+clean; 2.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 1.48k op/s 2024-09-12T02:19:07.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:07 smithi110 ceph-mon[30548]: pgmap v125: 129 pgs: 129 active+clean; 2.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 MiB/s wr, 1.48k op/s 2024-09-12T02:19:09.741 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:09 smithi110 ceph-mon[30548]: pgmap v126: 129 pgs: 129 active+clean; 2.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 1.54k op/s 2024-09-12T02:19:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:09 smithi115 ceph-mon[35351]: pgmap v126: 129 pgs: 129 active+clean; 2.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 1.54k op/s 2024-09-12T02:19:09.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:09 smithi136 ceph-mon[35814]: pgmap v126: 129 pgs: 129 active+clean; 2.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 1.54k op/s 2024-09-12T02:19:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 225.0 s, 758.8 tps, lat 133.356 ms stddev 169.765 2024-09-12T02:19:11.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:11 smithi115 ceph-mon[35351]: pgmap v127: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 1.57k op/s 2024-09-12T02:19:11.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:11 smithi136 ceph-mon[35814]: pgmap v127: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 1.57k op/s 2024-09-12T02:19:11.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:11 smithi110 ceph-mon[30548]: pgmap v127: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 1.57k op/s 2024-09-12T02:19:13.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:13 smithi115 ceph-mon[35351]: pgmap v128: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 1.46k op/s 2024-09-12T02:19:13.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:13 smithi136 ceph-mon[35814]: pgmap v128: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 1.46k op/s 2024-09-12T02:19:13.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:13 smithi110 ceph-mon[30548]: pgmap v128: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 1.46k op/s 2024-09-12T02:19:14.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:14 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:19:14.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:14 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:19:14.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:14 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:19:15.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 230.0 s, 646.0 tps, lat 153.065 ms stddev 173.330 2024-09-12T02:19:15.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:15 smithi115 ceph-mon[35351]: pgmap v129: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 18 MiB/s wr, 1.63k op/s 2024-09-12T02:19:15.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:15 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:19:15.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:15 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:19:15.797 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:15 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:19:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:15 smithi136 ceph-mon[35814]: pgmap v129: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 18 MiB/s wr, 1.63k op/s 2024-09-12T02:19:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:15 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:19:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:15 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:19:15.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:15 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:19:15.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:15 smithi110 ceph-mon[30548]: pgmap v129: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 18 MiB/s wr, 1.63k op/s 2024-09-12T02:19:15.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:15 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:19:15.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:15 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:19:15.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:15 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:19:17.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:17 smithi115 ceph-mon[35351]: pgmap v130: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-12T02:19:17.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:17 smithi136 ceph-mon[35814]: pgmap v130: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-12T02:19:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:17 smithi110 ceph-mon[30548]: pgmap v130: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.5 MiB/s wr, 675 op/s 2024-09-12T02:19:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:19 smithi115 ceph-mon[35351]: pgmap v131: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.9 MiB/s wr, 535 op/s 2024-09-12T02:19:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:19 smithi136 ceph-mon[35814]: pgmap v131: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.9 MiB/s wr, 535 op/s 2024-09-12T02:19:19.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:19 smithi110 ceph-mon[30548]: pgmap v131: 129 pgs: 129 active+clean; 2.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.9 MiB/s wr, 535 op/s 2024-09-12T02:19:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 235.0 s, 690.4 tps, lat 145.278 ms stddev 164.237 2024-09-12T02:19:21.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:21 smithi115 ceph-mon[35351]: pgmap v132: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.5 MiB/s wr, 587 op/s 2024-09-12T02:19:21.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:21 smithi136 ceph-mon[35814]: pgmap v132: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.5 MiB/s wr, 587 op/s 2024-09-12T02:19:21.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:21 smithi110 ceph-mon[30548]: pgmap v132: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.5 MiB/s wr, 587 op/s 2024-09-12T02:19:23.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:23 smithi115 ceph-mon[35351]: pgmap v133: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 447 op/s 2024-09-12T02:19:23.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:23 smithi136 ceph-mon[35814]: pgmap v133: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 447 op/s 2024-09-12T02:19:23.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:23 smithi110 ceph-mon[30548]: pgmap v133: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 5.1 MiB/s wr, 447 op/s 2024-09-12T02:19:25.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 240.0 s, 608.4 tps, lat 150.628 ms stddev 163.704 2024-09-12T02:19:25.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:25 smithi136 ceph-mon[35814]: pgmap v134: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 621 op/s 2024-09-12T02:19:25.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:25 smithi110 ceph-mon[30548]: pgmap v134: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 621 op/s 2024-09-12T02:19:26.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:25 smithi115 ceph-mon[35351]: pgmap v134: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.4 MiB/s wr, 621 op/s 2024-09-12T02:19:27.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:27 smithi136 ceph-mon[35814]: pgmap v135: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.8 MiB/s wr, 511 op/s 2024-09-12T02:19:27.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:27 smithi110 ceph-mon[30548]: pgmap v135: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.8 MiB/s wr, 511 op/s 2024-09-12T02:19:28.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:27 smithi115 ceph-mon[35351]: pgmap v135: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.8 MiB/s wr, 511 op/s 2024-09-12T02:19:29.846 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:29 smithi115 ceph-mon[35351]: pgmap v136: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.1 MiB/s wr, 557 op/s 2024-09-12T02:19:29.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:29 smithi136 ceph-mon[35814]: pgmap v136: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.1 MiB/s wr, 557 op/s 2024-09-12T02:19:29.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:29 smithi110 ceph-mon[30548]: pgmap v136: 129 pgs: 129 active+clean; 2.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.1 MiB/s wr, 557 op/s 2024-09-12T02:19:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 245.0 s, 556.2 tps, lat 166.753 ms stddev 219.701 2024-09-12T02:19:31.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:31 smithi136 ceph-mon[35814]: pgmap v137: 129 pgs: 129 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.1 MiB/s wr, 659 op/s 2024-09-12T02:19:31.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:31 smithi110 ceph-mon[30548]: pgmap v137: 129 pgs: 129 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.1 MiB/s wr, 659 op/s 2024-09-12T02:19:32.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:31 smithi115 ceph-mon[35351]: pgmap v137: 129 pgs: 129 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.1 MiB/s wr, 659 op/s 2024-09-12T02:19:33.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:33 smithi136 ceph-mon[35814]: pgmap v138: 129 pgs: 129 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.3 MiB/s wr, 546 op/s 2024-09-12T02:19:33.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:33 smithi110 ceph-mon[30548]: pgmap v138: 129 pgs: 129 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.3 MiB/s wr, 546 op/s 2024-09-12T02:19:34.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:33 smithi115 ceph-mon[35351]: pgmap v138: 129 pgs: 129 active+clean; 2.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.3 MiB/s wr, 546 op/s 2024-09-12T02:19:35.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 250.0 s, 1250.4 tps, lat 92.098 ms stddev 170.641 2024-09-12T02:19:35.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:35 smithi136 ceph-mon[35814]: pgmap v139: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 1.04k op/s 2024-09-12T02:19:35.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:35 smithi110 ceph-mon[30548]: pgmap v139: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 1.04k op/s 2024-09-12T02:19:36.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:35 smithi115 ceph-mon[35351]: pgmap v139: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 1.04k op/s 2024-09-12T02:19:37.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:37 smithi136 ceph-mon[35814]: pgmap v140: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 932 op/s 2024-09-12T02:19:37.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:37 smithi110 ceph-mon[30548]: pgmap v140: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 932 op/s 2024-09-12T02:19:38.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:37 smithi115 ceph-mon[35351]: pgmap v140: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 932 op/s 2024-09-12T02:19:39.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:39 smithi136 ceph-mon[35814]: pgmap v141: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 942 op/s 2024-09-12T02:19:39.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:39 smithi110 ceph-mon[30548]: pgmap v141: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 942 op/s 2024-09-12T02:19:40.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:39 smithi115 ceph-mon[35351]: pgmap v141: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 942 op/s 2024-09-12T02:19:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 255.0 s, 891.8 tps, lat 110.997 ms stddev 156.707 2024-09-12T02:19:41.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:41 smithi136 ceph-mon[35814]: pgmap v142: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 1k op/s 2024-09-12T02:19:41.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:41 smithi110 ceph-mon[30548]: pgmap v142: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 1k op/s 2024-09-12T02:19:42.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:41 smithi115 ceph-mon[35351]: pgmap v142: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 12 MiB/s wr, 1k op/s 2024-09-12T02:19:43.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:43 smithi136 ceph-mon[35814]: pgmap v143: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.8 MiB/s wr, 839 op/s 2024-09-12T02:19:43.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:43 smithi110 ceph-mon[30548]: pgmap v143: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.8 MiB/s wr, 839 op/s 2024-09-12T02:19:44.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:43 smithi115 ceph-mon[35351]: pgmap v143: 129 pgs: 129 active+clean; 2.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.8 MiB/s wr, 839 op/s 2024-09-12T02:19:45.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 260.0 s, 629.4 tps, lat 156.057 ms stddev 196.200 2024-09-12T02:19:45.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:45 smithi136 ceph-mon[35814]: pgmap v144: 129 pgs: 129 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 998 op/s 2024-09-12T02:19:45.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:45 smithi110 ceph-mon[30548]: pgmap v144: 129 pgs: 129 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 998 op/s 2024-09-12T02:19:46.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:45 smithi115 ceph-mon[35351]: pgmap v144: 129 pgs: 129 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 998 op/s 2024-09-12T02:19:47.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:47 smithi136 ceph-mon[35814]: pgmap v145: 129 pgs: 129 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 MiB/s wr, 533 op/s 2024-09-12T02:19:47.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:47 smithi110 ceph-mon[30548]: pgmap v145: 129 pgs: 129 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 MiB/s wr, 533 op/s 2024-09-12T02:19:48.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:47 smithi115 ceph-mon[35351]: pgmap v145: 129 pgs: 129 active+clean; 2.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.7 MiB/s wr, 533 op/s 2024-09-12T02:19:49.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:49 smithi136 ceph-mon[35814]: pgmap v146: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.5 MiB/s wr, 538 op/s 2024-09-12T02:19:49.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:49 smithi110 ceph-mon[30548]: pgmap v146: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.5 MiB/s wr, 538 op/s 2024-09-12T02:19:50.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:49 smithi115 ceph-mon[35351]: pgmap v146: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.5 MiB/s wr, 538 op/s 2024-09-12T02:19:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 265.0 s, 634.6 tps, lat 164.088 ms stddev 185.880 2024-09-12T02:19:51.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:51 smithi136 ceph-mon[35814]: pgmap v147: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.1 MiB/s wr, 602 op/s 2024-09-12T02:19:51.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:51 smithi110 ceph-mon[30548]: pgmap v147: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.1 MiB/s wr, 602 op/s 2024-09-12T02:19:52.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:51 smithi115 ceph-mon[35351]: pgmap v147: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.1 MiB/s wr, 602 op/s 2024-09-12T02:19:53.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:53 smithi136 ceph-mon[35814]: pgmap v148: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.8 MiB/s wr, 463 op/s 2024-09-12T02:19:53.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:53 smithi110 ceph-mon[30548]: pgmap v148: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.8 MiB/s wr, 463 op/s 2024-09-12T02:19:54.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:53 smithi115 ceph-mon[35351]: pgmap v148: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.8 MiB/s wr, 463 op/s 2024-09-12T02:19:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 270.0 s, 1009.0 tps, lat 99.801 ms stddev 120.106 2024-09-12T02:19:55.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:55 smithi110 ceph-mon[30548]: pgmap v149: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 639 op/s 2024-09-12T02:19:56.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:55 smithi115 ceph-mon[35351]: pgmap v149: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 639 op/s 2024-09-12T02:19:56.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:55 smithi136 ceph-mon[35814]: pgmap v149: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 639 op/s 2024-09-12T02:19:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:57 smithi110 ceph-mon[30548]: pgmap v150: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.0 MiB/s wr, 478 op/s 2024-09-12T02:19:58.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:57 smithi115 ceph-mon[35351]: pgmap v150: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.0 MiB/s wr, 478 op/s 2024-09-12T02:19:58.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:57 smithi136 ceph-mon[35814]: pgmap v150: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.0 MiB/s wr, 478 op/s 2024-09-12T02:19:59.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:19:59 smithi110 ceph-mon[30548]: pgmap v151: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.8 MiB/s wr, 557 op/s 2024-09-12T02:19:59.960 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:19:59 smithi136 ceph-mon[35814]: pgmap v151: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.8 MiB/s wr, 557 op/s 2024-09-12T02:20:00.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:19:59 smithi115 ceph-mon[35351]: pgmap v151: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 4.8 MiB/s wr, 557 op/s 2024-09-12T02:20:00.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 275.0 s, 1076.6 tps, lat 92.281 ms stddev 111.776 2024-09-12T02:20:01.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:00 smithi115 ceph-mon[35351]: overall HEALTH_OK 2024-09-12T02:20:01.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:00 smithi136 ceph-mon[35814]: overall HEALTH_OK 2024-09-12T02:20:01.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:00 smithi110 ceph-mon[30548]: overall HEALTH_OK 2024-09-12T02:20:02.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:01 smithi115 ceph-mon[35351]: pgmap v152: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.1 MiB/s wr, 597 op/s 2024-09-12T02:20:02.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:01 smithi136 ceph-mon[35814]: pgmap v152: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.1 MiB/s wr, 597 op/s 2024-09-12T02:20:02.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:01 smithi110 ceph-mon[30548]: pgmap v152: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.1 MiB/s wr, 597 op/s 2024-09-12T02:20:04.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:03 smithi115 ceph-mon[35351]: pgmap v153: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.4 MiB/s wr, 480 op/s 2024-09-12T02:20:04.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:03 smithi136 ceph-mon[35814]: pgmap v153: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.4 MiB/s wr, 480 op/s 2024-09-12T02:20:04.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:03 smithi110 ceph-mon[30548]: pgmap v153: 129 pgs: 129 active+clean; 2.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 4.4 MiB/s wr, 480 op/s 2024-09-12T02:20:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 280.0 s, 296.6 tps, lat 256.901 ms stddev 206.139 2024-09-12T02:20:06.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:05 smithi115 ceph-mon[35351]: pgmap v154: 129 pgs: 129 active+clean; 2.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 672 op/s 2024-09-12T02:20:06.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:05 smithi136 ceph-mon[35814]: pgmap v154: 129 pgs: 129 active+clean; 2.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 672 op/s 2024-09-12T02:20:06.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:05 smithi110 ceph-mon[30548]: pgmap v154: 129 pgs: 129 active+clean; 2.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 672 op/s 2024-09-12T02:20:08.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:07 smithi115 ceph-mon[35351]: pgmap v155: 129 pgs: 129 active+clean; 2.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 518 op/s 2024-09-12T02:20:08.161 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:07 smithi136 ceph-mon[35814]: pgmap v155: 129 pgs: 129 active+clean; 2.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 518 op/s 2024-09-12T02:20:08.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:07 smithi110 ceph-mon[30548]: pgmap v155: 129 pgs: 129 active+clean; 2.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 518 op/s 2024-09-12T02:20:09.990 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:09 smithi110 ceph-mon[30548]: pgmap v156: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 885 op/s 2024-09-12T02:20:10.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:09 smithi115 ceph-mon[35351]: pgmap v156: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 885 op/s 2024-09-12T02:20:10.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:09 smithi136 ceph-mon[35814]: pgmap v156: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 885 op/s 2024-09-12T02:20:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 285.0 s, 808.8 tps, lat 153.039 ms stddev 369.786 2024-09-12T02:20:12.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:11 smithi115 ceph-mon[35351]: pgmap v157: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 1.26k op/s 2024-09-12T02:20:12.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:11 smithi136 ceph-mon[35814]: pgmap v157: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 1.26k op/s 2024-09-12T02:20:12.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:11 smithi110 ceph-mon[30548]: pgmap v157: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 1.26k op/s 2024-09-12T02:20:14.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:13 smithi115 ceph-mon[35351]: pgmap v158: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 1.24k op/s 2024-09-12T02:20:14.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:13 smithi136 ceph-mon[35814]: pgmap v158: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 1.24k op/s 2024-09-12T02:20:14.189 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:13 smithi110 ceph-mon[30548]: pgmap v158: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 1.24k op/s 2024-09-12T02:20:15.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 290.0 s, 840.6 tps, lat 115.541 ms stddev 156.901 2024-09-12T02:20:16.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:15 smithi115 ceph-mon[35351]: pgmap v159: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 18 MiB/s wr, 1.43k op/s 2024-09-12T02:20:16.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:15 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:20:16.099 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:15 smithi110 ceph-mon[30548]: pgmap v159: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 18 MiB/s wr, 1.43k op/s 2024-09-12T02:20:16.100 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:16 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:20:16.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:15 smithi136 ceph-mon[35814]: pgmap v159: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 18 MiB/s wr, 1.43k op/s 2024-09-12T02:20:16.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:15 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:20:17.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:16 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:20:17.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:16 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:20:17.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:16 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:20:17.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:16 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:20:17.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:16 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:20:17.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:16 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:20:17.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:16 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:20:17.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:16 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:20:17.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:16 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:20:18.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:17 smithi115 ceph-mon[35351]: pgmap v160: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 1.23k op/s 2024-09-12T02:20:18.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:17 smithi136 ceph-mon[35814]: pgmap v160: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 1.23k op/s 2024-09-12T02:20:18.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:17 smithi110 ceph-mon[30548]: pgmap v160: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 1.23k op/s 2024-09-12T02:20:20.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:19 smithi115 ceph-mon[35351]: pgmap v161: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 1.24k op/s 2024-09-12T02:20:20.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:19 smithi136 ceph-mon[35814]: pgmap v161: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 1.24k op/s 2024-09-12T02:20:20.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 295.0 s, 586.8 tps, lat 173.003 ms stddev 280.370 2024-09-12T02:20:20.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:19 smithi110 ceph-mon[30548]: pgmap v161: 129 pgs: 129 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 15 MiB/s wr, 1.24k op/s 2024-09-12T02:20:22.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:21 smithi136 ceph-mon[35814]: pgmap v162: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-09-12T02:20:22.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:21 smithi110 ceph-mon[30548]: pgmap v162: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-09-12T02:20:22.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:21 smithi115 ceph-mon[35351]: pgmap v162: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 13 MiB/s wr, 1.02k op/s 2024-09-12T02:20:24.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:23 smithi136 ceph-mon[35814]: pgmap v163: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.0 MiB/s wr, 579 op/s 2024-09-12T02:20:24.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:23 smithi110 ceph-mon[30548]: pgmap v163: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.0 MiB/s wr, 579 op/s 2024-09-12T02:20:24.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:23 smithi115 ceph-mon[35351]: pgmap v163: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 8.0 MiB/s wr, 579 op/s 2024-09-12T02:20:25.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 300.0 s, 670.3 tps, lat 150.251 ms stddev 182.289 2024-09-12T02:20:26.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:25 smithi136 ceph-mon[35814]: pgmap v164: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 12 MiB/s wr, 702 op/s 2024-09-12T02:20:26.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:25 smithi110 ceph-mon[30548]: pgmap v164: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 12 MiB/s wr, 702 op/s 2024-09-12T02:20:26.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:25 smithi115 ceph-mon[35351]: pgmap v164: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 12 MiB/s wr, 702 op/s 2024-09-12T02:20:27.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:26 smithi136 ceph-mon[35814]: pgmap v165: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 514 op/s 2024-09-12T02:20:27.189 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:26 smithi110 ceph-mon[30548]: pgmap v165: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 514 op/s 2024-09-12T02:20:27.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:26 smithi115 ceph-mon[35351]: pgmap v165: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 10 MiB/s wr, 514 op/s 2024-09-12T02:20:29.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:28 smithi110 ceph-mon[30548]: pgmap v166: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 11 MiB/s wr, 591 op/s 2024-09-12T02:20:29.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:28 smithi115 ceph-mon[35351]: pgmap v166: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 11 MiB/s wr, 591 op/s 2024-09-12T02:20:29.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:28 smithi136 ceph-mon[35814]: pgmap v166: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 11 MiB/s wr, 591 op/s 2024-09-12T02:20:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 305.0 s, 679.0 tps, lat 146.798 ms stddev 171.959 2024-09-12T02:20:31.210 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:30 smithi136 ceph-mon[35814]: pgmap v167: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 15 MiB/s wr, 692 op/s 2024-09-12T02:20:31.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:30 smithi115 ceph-mon[35351]: pgmap v167: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 15 MiB/s wr, 692 op/s 2024-09-12T02:20:31.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:30 smithi110 ceph-mon[30548]: pgmap v167: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 15 MiB/s wr, 692 op/s 2024-09-12T02:20:33.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:32 smithi115 ceph-mon[35351]: pgmap v168: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 558 op/s 2024-09-12T02:20:33.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:32 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:20:33.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:32 smithi136 ceph-mon[35814]: pgmap v168: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 558 op/s 2024-09-12T02:20:33.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:32 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:20:33.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:32 smithi110 ceph-mon[30548]: pgmap v168: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 558 op/s 2024-09-12T02:20:33.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:32 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:20:35.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 310.0 s, 842.2 tps, lat 119.488 ms stddev 151.719 2024-09-12T02:20:35.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:34 smithi115 ceph-mon[35351]: pgmap v169: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 795 op/s 2024-09-12T02:20:35.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:34 smithi136 ceph-mon[35814]: pgmap v169: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 795 op/s 2024-09-12T02:20:35.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:34 smithi110 ceph-mon[30548]: pgmap v169: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 795 op/s 2024-09-12T02:20:37.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:36 smithi110 ceph-mon[30548]: pgmap v170: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 602 op/s 2024-09-12T02:20:37.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:36 smithi115 ceph-mon[35351]: pgmap v170: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 602 op/s 2024-09-12T02:20:37.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:36 smithi136 ceph-mon[35814]: pgmap v170: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 MiB/s wr, 602 op/s 2024-09-12T02:20:39.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:38 smithi115 ceph-mon[35351]: pgmap v171: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 621 op/s 2024-09-12T02:20:39.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:38 smithi136 ceph-mon[35814]: pgmap v171: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 621 op/s 2024-09-12T02:20:39.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:38 smithi110 ceph-mon[30548]: pgmap v171: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 14 MiB/s wr, 621 op/s 2024-09-12T02:20:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 315.0 s, 631.0 tps, lat 156.024 ms stddev 210.700 2024-09-12T02:20:41.242 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:40 smithi110 ceph-mon[30548]: pgmap v172: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 17 MiB/s wr, 708 op/s 2024-09-12T02:20:41.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:40 smithi115 ceph-mon[35351]: pgmap v172: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 17 MiB/s wr, 708 op/s 2024-09-12T02:20:41.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:40 smithi136 ceph-mon[35814]: pgmap v172: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 17 MiB/s wr, 708 op/s 2024-09-12T02:20:43.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:42 smithi115 ceph-mon[35351]: pgmap v173: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 14 MiB/s wr, 600 op/s 2024-09-12T02:20:43.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:42 smithi136 ceph-mon[35814]: pgmap v173: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 14 MiB/s wr, 600 op/s 2024-09-12T02:20:43.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:42 smithi110 ceph-mon[30548]: pgmap v173: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 14 MiB/s wr, 600 op/s 2024-09-12T02:20:45.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 320.0 s, 768.0 tps, lat 131.679 ms stddev 162.528 2024-09-12T02:20:45.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:45 smithi115 ceph-mon[35351]: pgmap v174: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 17 MiB/s wr, 754 op/s 2024-09-12T02:20:45.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:45 smithi136 ceph-mon[35814]: pgmap v174: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 17 MiB/s wr, 754 op/s 2024-09-12T02:20:45.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:45 smithi110 ceph-mon[30548]: pgmap v174: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 17 MiB/s wr, 754 op/s 2024-09-12T02:20:47.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:47 smithi115 ceph-mon[35351]: pgmap v175: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 491 op/s 2024-09-12T02:20:47.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:47 smithi136 ceph-mon[35814]: pgmap v175: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 491 op/s 2024-09-12T02:20:47.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:47 smithi110 ceph-mon[30548]: pgmap v175: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 491 op/s 2024-09-12T02:20:48.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:48 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:20:48.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:48 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:20:48.632 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:48 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:20:49.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:49 smithi136 ceph-mon[35814]: pgmap v176: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 503 op/s 2024-09-12T02:20:49.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:49 smithi115 ceph-mon[35351]: pgmap v176: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 503 op/s 2024-09-12T02:20:49.591 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:49 smithi110 ceph-mon[30548]: pgmap v176: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 503 op/s 2024-09-12T02:20:50.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 325.0 s, 754.8 tps, lat 133.685 ms stddev 167.339 2024-09-12T02:20:51.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:51 smithi136 ceph-mon[35814]: pgmap v177: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 16 MiB/s wr, 642 op/s 2024-09-12T02:20:51.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:51 smithi110 ceph-mon[30548]: pgmap v177: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 16 MiB/s wr, 642 op/s 2024-09-12T02:20:51.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:51 smithi115 ceph-mon[35351]: pgmap v177: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 16 MiB/s wr, 642 op/s 2024-09-12T02:20:53.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:53 smithi136 ceph-mon[35814]: pgmap v178: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 501 op/s 2024-09-12T02:20:53.440 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:53 smithi110 ceph-mon[30548]: pgmap v178: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 501 op/s 2024-09-12T02:20:53.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:53 smithi115 ceph-mon[35351]: pgmap v178: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 501 op/s 2024-09-12T02:20:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 330.0 s, 871.2 tps, lat 114.787 ms stddev 161.868 2024-09-12T02:20:55.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:55 smithi136 ceph-mon[35814]: pgmap v179: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 15 MiB/s wr, 655 op/s 2024-09-12T02:20:55.439 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:55 smithi110 ceph-mon[30548]: pgmap v179: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 15 MiB/s wr, 655 op/s 2024-09-12T02:20:55.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:55 smithi115 ceph-mon[35351]: pgmap v179: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 15 MiB/s wr, 655 op/s 2024-09-12T02:20:57.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:57 smithi136 ceph-mon[35814]: pgmap v180: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 477 op/s 2024-09-12T02:20:57.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:57 smithi110 ceph-mon[30548]: pgmap v180: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 477 op/s 2024-09-12T02:20:57.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:57 smithi115 ceph-mon[35351]: pgmap v180: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 11 MiB/s wr, 477 op/s 2024-09-12T02:20:59.346 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:20:59 smithi115 ceph-mon[35351]: pgmap v181: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 498 op/s 2024-09-12T02:20:59.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:20:59 smithi136 ceph-mon[35814]: pgmap v181: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 498 op/s 2024-09-12T02:20:59.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:20:59 smithi110 ceph-mon[30548]: pgmap v181: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 11 MiB/s wr, 498 op/s 2024-09-12T02:21:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 335.0 s, 659.8 tps, lat 152.051 ms stddev 182.305 2024-09-12T02:21:01.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:01 smithi136 ceph-mon[35814]: pgmap v182: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 15 MiB/s wr, 639 op/s 2024-09-12T02:21:01.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:01 smithi110 ceph-mon[30548]: pgmap v182: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 15 MiB/s wr, 639 op/s 2024-09-12T02:21:01.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:01 smithi115 ceph-mon[35351]: pgmap v182: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 15 MiB/s wr, 639 op/s 2024-09-12T02:21:03.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:03 smithi136 ceph-mon[35814]: pgmap v183: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 478 op/s 2024-09-12T02:21:03.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:03 smithi110 ceph-mon[30548]: pgmap v183: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 478 op/s 2024-09-12T02:21:03.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:03 smithi115 ceph-mon[35351]: pgmap v183: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 478 op/s 2024-09-12T02:21:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 340.0 s, 372.0 tps, lat 264.715 ms stddev 397.764 2024-09-12T02:21:05.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:05 smithi136 ceph-mon[35814]: pgmap v184: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 17 MiB/s wr, 1.04k op/s 2024-09-12T02:21:05.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:05 smithi110 ceph-mon[30548]: pgmap v184: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 17 MiB/s wr, 1.04k op/s 2024-09-12T02:21:05.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:05 smithi115 ceph-mon[35351]: pgmap v184: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 17 MiB/s wr, 1.04k op/s 2024-09-12T02:21:07.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:07 smithi136 ceph-mon[35814]: pgmap v185: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 899 op/s 2024-09-12T02:21:07.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:07 smithi110 ceph-mon[30548]: pgmap v185: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 899 op/s 2024-09-12T02:21:07.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:07 smithi115 ceph-mon[35351]: pgmap v185: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 899 op/s 2024-09-12T02:21:09.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:09 smithi136 ceph-mon[35814]: pgmap v186: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 923 op/s 2024-09-12T02:21:09.438 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:09 smithi110 ceph-mon[30548]: pgmap v186: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 923 op/s 2024-09-12T02:21:09.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:09 smithi115 ceph-mon[35351]: pgmap v186: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 923 op/s 2024-09-12T02:21:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 345.0 s, 603.6 tps, lat 168.129 ms stddev 230.534 2024-09-12T02:21:11.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:11 smithi136 ceph-mon[35814]: pgmap v187: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-09-12T02:21:11.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:11 smithi110 ceph-mon[30548]: pgmap v187: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-09-12T02:21:11.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:11 smithi115 ceph-mon[35351]: pgmap v187: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 16 MiB/s wr, 1.06k op/s 2024-09-12T02:21:13.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:13 smithi136 ceph-mon[35814]: pgmap v188: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 12 MiB/s wr, 894 op/s 2024-09-12T02:21:13.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:13 smithi110 ceph-mon[30548]: pgmap v188: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 12 MiB/s wr, 894 op/s 2024-09-12T02:21:13.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:13 smithi115 ceph-mon[35351]: pgmap v188: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 12 MiB/s wr, 894 op/s 2024-09-12T02:21:15.173 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 350.0 s, 659.6 tps, lat 151.097 ms stddev 202.291 2024-09-12T02:21:15.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:15 smithi136 ceph-mon[35814]: pgmap v189: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 14 MiB/s wr, 1.07k op/s 2024-09-12T02:21:15.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:15 smithi110 ceph-mon[30548]: pgmap v189: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 14 MiB/s wr, 1.07k op/s 2024-09-12T02:21:15.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:15 smithi115 ceph-mon[35351]: pgmap v189: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 14 MiB/s wr, 1.07k op/s 2024-09-12T02:21:17.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:17 smithi110 ceph-mon[30548]: pgmap v190: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.3 MiB/s wr, 492 op/s 2024-09-12T02:21:17.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:17 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:21:17.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:17 smithi115 ceph-mon[35351]: pgmap v190: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.3 MiB/s wr, 492 op/s 2024-09-12T02:21:17.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:17 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:21:17.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:17 smithi136 ceph-mon[35814]: pgmap v190: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.3 MiB/s wr, 492 op/s 2024-09-12T02:21:17.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:17 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:21:19.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:19 smithi110 ceph-mon[30548]: pgmap v191: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.8 MiB/s wr, 480 op/s 2024-09-12T02:21:19.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:19 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:21:19.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:19 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:21:19.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:19 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:21:19.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:19 smithi115 ceph-mon[35351]: pgmap v191: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.8 MiB/s wr, 480 op/s 2024-09-12T02:21:19.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:19 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:21:19.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:19 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:21:19.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:19 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:21:19.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:19 smithi136 ceph-mon[35814]: pgmap v191: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.8 MiB/s wr, 480 op/s 2024-09-12T02:21:19.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:19 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:21:19.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:19 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:21:19.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:19 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:21:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 355.0 s, 647.8 tps, lat 151.963 ms stddev 203.951 2024-09-12T02:21:21.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:21 smithi110 ceph-mon[30548]: pgmap v192: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 11 MiB/s wr, 605 op/s 2024-09-12T02:21:21.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:21 smithi115 ceph-mon[35351]: pgmap v192: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 11 MiB/s wr, 605 op/s 2024-09-12T02:21:21.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:21 smithi136 ceph-mon[35814]: pgmap v192: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 11 MiB/s wr, 605 op/s 2024-09-12T02:21:23.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:23 smithi110 ceph-mon[30548]: pgmap v193: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.4 MiB/s wr, 451 op/s 2024-09-12T02:21:23.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:23 smithi115 ceph-mon[35351]: pgmap v193: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.4 MiB/s wr, 451 op/s 2024-09-12T02:21:23.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:23 smithi136 ceph-mon[35814]: pgmap v193: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 7.4 MiB/s wr, 451 op/s 2024-09-12T02:21:25.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 360.0 s, 758.2 tps, lat 132.008 ms stddev 152.303 2024-09-12T02:21:25.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:25 smithi110 ceph-mon[30548]: pgmap v194: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 11 MiB/s wr, 652 op/s 2024-09-12T02:21:25.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:25 smithi115 ceph-mon[35351]: pgmap v194: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 11 MiB/s wr, 652 op/s 2024-09-12T02:21:25.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:25 smithi136 ceph-mon[35814]: pgmap v194: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 11 MiB/s wr, 652 op/s 2024-09-12T02:21:27.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:27 smithi115 ceph-mon[35351]: pgmap v195: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.2 MiB/s wr, 473 op/s 2024-09-12T02:21:27.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:27 smithi136 ceph-mon[35814]: pgmap v195: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.2 MiB/s wr, 473 op/s 2024-09-12T02:21:27.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:27 smithi110 ceph-mon[30548]: pgmap v195: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.2 MiB/s wr, 473 op/s 2024-09-12T02:21:29.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:29 smithi115 ceph-mon[35351]: pgmap v196: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.0 MiB/s wr, 486 op/s 2024-09-12T02:21:29.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:29 smithi136 ceph-mon[35814]: pgmap v196: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.0 MiB/s wr, 486 op/s 2024-09-12T02:21:29.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:29 smithi110 ceph-mon[30548]: pgmap v196: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 9.0 MiB/s wr, 486 op/s 2024-09-12T02:21:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 365.0 s, 628.6 tps, lat 159.545 ms stddev 202.757 2024-09-12T02:21:31.460 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:31 smithi136 ceph-mon[35814]: pgmap v197: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 12 MiB/s wr, 622 op/s 2024-09-12T02:21:31.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:31 smithi115 ceph-mon[35351]: pgmap v197: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 12 MiB/s wr, 622 op/s 2024-09-12T02:21:31.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:31 smithi110 ceph-mon[30548]: pgmap v197: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 12 MiB/s wr, 622 op/s 2024-09-12T02:21:33.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:33 smithi115 ceph-mon[35351]: pgmap v198: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.6 MiB/s wr, 468 op/s 2024-09-12T02:21:33.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:33 smithi136 ceph-mon[35814]: pgmap v198: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.6 MiB/s wr, 468 op/s 2024-09-12T02:21:33.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:33 smithi110 ceph-mon[30548]: pgmap v198: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.6 MiB/s wr, 468 op/s 2024-09-12T02:21:35.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 370.0 s, 594.0 tps, lat 166.069 ms stddev 191.047 2024-09-12T02:21:35.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:35 smithi115 ceph-mon[35351]: pgmap v199: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 13 MiB/s wr, 731 op/s 2024-09-12T02:21:35.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:35 smithi136 ceph-mon[35814]: pgmap v199: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 13 MiB/s wr, 731 op/s 2024-09-12T02:21:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:35 smithi110 ceph-mon[30548]: pgmap v199: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 13 MiB/s wr, 731 op/s 2024-09-12T02:21:37.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:37 smithi115 ceph-mon[35351]: pgmap v200: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 539 op/s 2024-09-12T02:21:37.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:37 smithi136 ceph-mon[35814]: pgmap v200: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 539 op/s 2024-09-12T02:21:37.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:37 smithi110 ceph-mon[30548]: pgmap v200: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.8 MiB/s wr, 539 op/s 2024-09-12T02:21:39.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:39 smithi115 ceph-mon[35351]: pgmap v201: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 540 op/s 2024-09-12T02:21:39.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:39 smithi136 ceph-mon[35814]: pgmap v201: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 540 op/s 2024-09-12T02:21:39.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:39 smithi110 ceph-mon[30548]: pgmap v201: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.8 MiB/s wr, 540 op/s 2024-09-12T02:21:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 375.0 s, 752.6 tps, lat 134.121 ms stddev 167.370 2024-09-12T02:21:41.490 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:41 smithi110 ceph-mon[30548]: pgmap v202: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 707 op/s 2024-09-12T02:21:41.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:41 smithi115 ceph-mon[35351]: pgmap v202: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 707 op/s 2024-09-12T02:21:41.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:41 smithi136 ceph-mon[35814]: pgmap v202: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 11 MiB/s wr, 707 op/s 2024-09-12T02:21:43.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:43 smithi115 ceph-mon[35351]: pgmap v203: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.6 MiB/s wr, 548 op/s 2024-09-12T02:21:43.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:43 smithi136 ceph-mon[35814]: pgmap v203: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.6 MiB/s wr, 548 op/s 2024-09-12T02:21:43.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:43 smithi110 ceph-mon[30548]: pgmap v203: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.6 MiB/s wr, 548 op/s 2024-09-12T02:21:45.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 380.0 s, 559.2 tps, lat 179.041 ms stddev 212.100 2024-09-12T02:21:45.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:45 smithi115 ceph-mon[35351]: pgmap v204: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-12T02:21:45.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:45 smithi136 ceph-mon[35814]: pgmap v204: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-12T02:21:45.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:45 smithi110 ceph-mon[30548]: pgmap v204: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 745 op/s 2024-09-12T02:21:47.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:47 smithi115 ceph-mon[35351]: pgmap v205: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 482 op/s 2024-09-12T02:21:47.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:47 smithi136 ceph-mon[35814]: pgmap v205: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 482 op/s 2024-09-12T02:21:47.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:47 smithi110 ceph-mon[30548]: pgmap v205: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 482 op/s 2024-09-12T02:21:49.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:49 smithi115 ceph-mon[35351]: pgmap v206: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.4 MiB/s wr, 481 op/s 2024-09-12T02:21:49.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:49 smithi136 ceph-mon[35814]: pgmap v206: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.4 MiB/s wr, 481 op/s 2024-09-12T02:21:49.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:49 smithi110 ceph-mon[30548]: pgmap v206: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.4 MiB/s wr, 481 op/s 2024-09-12T02:21:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 385.0 s, 682.2 tps, lat 145.008 ms stddev 170.867 2024-09-12T02:21:51.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:51 smithi115 ceph-mon[35351]: pgmap v207: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 656 op/s 2024-09-12T02:21:51.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:51 smithi136 ceph-mon[35814]: pgmap v207: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 656 op/s 2024-09-12T02:21:51.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:51 smithi110 ceph-mon[30548]: pgmap v207: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 656 op/s 2024-09-12T02:21:53.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:53 smithi115 ceph-mon[35351]: pgmap v208: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.0 MiB/s wr, 471 op/s 2024-09-12T02:21:53.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:53 smithi136 ceph-mon[35814]: pgmap v208: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.0 MiB/s wr, 471 op/s 2024-09-12T02:21:53.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:53 smithi110 ceph-mon[30548]: pgmap v208: 129 pgs: 129 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.0 MiB/s wr, 471 op/s 2024-09-12T02:21:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 390.0 s, 697.2 tps, lat 141.831 ms stddev 166.606 2024-09-12T02:21:55.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:55 smithi115 ceph-mon[35351]: pgmap v209: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 653 op/s 2024-09-12T02:21:55.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:55 smithi136 ceph-mon[35814]: pgmap v209: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 653 op/s 2024-09-12T02:21:55.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:55 smithi110 ceph-mon[30548]: pgmap v209: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 653 op/s 2024-09-12T02:21:57.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:57 smithi115 ceph-mon[35351]: pgmap v210: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 478 op/s 2024-09-12T02:21:57.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:57 smithi136 ceph-mon[35814]: pgmap v210: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 478 op/s 2024-09-12T02:21:57.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:57 smithi110 ceph-mon[30548]: pgmap v210: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 478 op/s 2024-09-12T02:21:59.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:21:59 smithi136 ceph-mon[35814]: pgmap v211: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 480 op/s 2024-09-12T02:21:59.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:21:59 smithi110 ceph-mon[30548]: pgmap v211: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 480 op/s 2024-09-12T02:21:59.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:21:59 smithi115 ceph-mon[35351]: pgmap v211: 129 pgs: 129 active+clean; 3.4 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.7 MiB/s wr, 480 op/s 2024-09-12T02:22:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 395.0 s, 496.8 tps, lat 204.800 ms stddev 282.488 2024-09-12T02:22:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:01 smithi136 ceph-mon[35814]: pgmap v212: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.4 MiB/s wr, 653 op/s 2024-09-12T02:22:01.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:01 smithi110 ceph-mon[30548]: pgmap v212: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.4 MiB/s wr, 653 op/s 2024-09-12T02:22:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:01 smithi115 ceph-mon[35351]: pgmap v212: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.4 MiB/s wr, 653 op/s 2024-09-12T02:22:03.649 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:03 smithi110 ceph-mon[30548]: pgmap v213: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.6 MiB/s wr, 489 op/s 2024-09-12T02:22:03.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:03 smithi136 ceph-mon[35814]: pgmap v213: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.6 MiB/s wr, 489 op/s 2024-09-12T02:22:03.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:03 smithi115 ceph-mon[35351]: pgmap v213: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.6 MiB/s wr, 489 op/s 2024-09-12T02:22:05.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 400.0 s, 426.0 tps, lat 229.167 ms stddev 248.253 2024-09-12T02:22:05.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:05 smithi136 ceph-mon[35814]: pgmap v214: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 10 MiB/s wr, 884 op/s 2024-09-12T02:22:05.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:05 smithi136 ceph-mon[35814]: osdmap e99: 12 total, 12 up, 12 in 2024-09-12T02:22:05.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:05 smithi110 ceph-mon[30548]: pgmap v214: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 10 MiB/s wr, 884 op/s 2024-09-12T02:22:05.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:05 smithi110 ceph-mon[30548]: osdmap e99: 12 total, 12 up, 12 in 2024-09-12T02:22:05.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:05 smithi115 ceph-mon[35351]: pgmap v214: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 10 MiB/s wr, 884 op/s 2024-09-12T02:22:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:05 smithi115 ceph-mon[35351]: osdmap e99: 12 total, 12 up, 12 in 2024-09-12T02:22:07.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:07 smithi136 ceph-mon[35814]: pgmap v216: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.9 MiB/s wr, 862 op/s 2024-09-12T02:22:07.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:07 smithi110 ceph-mon[30548]: pgmap v216: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.9 MiB/s wr, 862 op/s 2024-09-12T02:22:07.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:07 smithi115 ceph-mon[35351]: pgmap v216: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.9 MiB/s wr, 862 op/s 2024-09-12T02:22:09.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:09 smithi136 ceph-mon[35814]: pgmap v217: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.8 MiB/s wr, 858 op/s 2024-09-12T02:22:09.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:09 smithi110 ceph-mon[30548]: pgmap v217: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.8 MiB/s wr, 858 op/s 2024-09-12T02:22:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:09 smithi115 ceph-mon[35351]: pgmap v217: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.8 MiB/s wr, 858 op/s 2024-09-12T02:22:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 405.0 s, 562.4 tps, lat 179.964 ms stddev 226.020 2024-09-12T02:22:11.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:11 smithi136 ceph-mon[35814]: pgmap v218: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 7.8 MiB/s wr, 836 op/s 2024-09-12T02:22:11.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:11 smithi110 ceph-mon[30548]: pgmap v218: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 7.8 MiB/s wr, 836 op/s 2024-09-12T02:22:11.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:11 smithi115 ceph-mon[35351]: pgmap v218: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 7.8 MiB/s wr, 836 op/s 2024-09-12T02:22:13.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:13 smithi136 ceph-mon[35814]: pgmap v219: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 7.7 MiB/s wr, 821 op/s 2024-09-12T02:22:13.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:13 smithi110 ceph-mon[30548]: pgmap v219: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 7.7 MiB/s wr, 821 op/s 2024-09-12T02:22:13.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:13 smithi115 ceph-mon[35351]: pgmap v219: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 7.7 MiB/s wr, 821 op/s 2024-09-12T02:22:15.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 410.0 s, 844.2 tps, lat 119.262 ms stddev 163.745 2024-09-12T02:22:15.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:15 smithi136 ceph-mon[35814]: pgmap v220: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 5.6 MiB/s wr, 523 op/s 2024-09-12T02:22:15.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:15 smithi136 ceph-mon[35814]: osdmap e100: 12 total, 12 up, 12 in 2024-09-12T02:22:15.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:15 smithi110 ceph-mon[30548]: pgmap v220: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 5.6 MiB/s wr, 523 op/s 2024-09-12T02:22:15.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:15 smithi110 ceph-mon[30548]: osdmap e100: 12 total, 12 up, 12 in 2024-09-12T02:22:15.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:15 smithi115 ceph-mon[35351]: pgmap v220: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 5.6 MiB/s wr, 523 op/s 2024-09-12T02:22:15.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:15 smithi115 ceph-mon[35351]: osdmap e100: 12 total, 12 up, 12 in 2024-09-12T02:22:17.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:17 smithi136 ceph-mon[35814]: pgmap v222: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 5.3 MiB/s wr, 520 op/s 2024-09-12T02:22:17.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:17 smithi110 ceph-mon[30548]: pgmap v222: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 5.3 MiB/s wr, 520 op/s 2024-09-12T02:22:17.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:17 smithi115 ceph-mon[35351]: pgmap v222: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 5.3 MiB/s wr, 520 op/s 2024-09-12T02:22:19.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:19 smithi136 ceph-mon[35814]: pgmap v223: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 5.3 MiB/s wr, 521 op/s 2024-09-12T02:22:19.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:19 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:19.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:19 smithi110 ceph-mon[30548]: pgmap v223: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 5.3 MiB/s wr, 521 op/s 2024-09-12T02:22:19.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:19 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:19 smithi115 ceph-mon[35351]: pgmap v223: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 5.3 MiB/s wr, 521 op/s 2024-09-12T02:22:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:19 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:22:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 415.0 s, 684.8 tps, lat 148.734 ms stddev 204.605 2024-09-12T02:22:21.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:21 smithi136 ceph-mon[35814]: pgmap v224: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 6.0 MiB/s wr, 549 op/s 2024-09-12T02:22:21.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:21 smithi110 ceph-mon[30548]: pgmap v224: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 6.0 MiB/s wr, 549 op/s 2024-09-12T02:22:21.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:21 smithi115 ceph-mon[35351]: pgmap v224: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 6.0 MiB/s wr, 549 op/s 2024-09-12T02:22:23.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:23 smithi110 ceph-mon[30548]: pgmap v225: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 5.9 MiB/s wr, 547 op/s 2024-09-12T02:22:23.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:23 smithi115 ceph-mon[35351]: pgmap v225: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 5.9 MiB/s wr, 547 op/s 2024-09-12T02:22:23.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:23 smithi136 ceph-mon[35814]: pgmap v225: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 5.9 MiB/s wr, 547 op/s 2024-09-12T02:22:24.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:24 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:24.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:24 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:24.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:24 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:22:24.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:24 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:24.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:24 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:24.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:24 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:22:24.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:24 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:22:24.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:24 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:22:24.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:24 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:22:25.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 420.0 s, 567.8 tps, lat 167.458 ms stddev 200.095 2024-09-12T02:22:25.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:25 smithi115 ceph-mon[35351]: pgmap v226: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 6.0 MiB/s wr, 547 op/s 2024-09-12T02:22:25.917 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:25 smithi136 ceph-mon[35814]: pgmap v226: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 6.0 MiB/s wr, 547 op/s 2024-09-12T02:22:25.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:25 smithi110 ceph-mon[30548]: pgmap v226: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 6.0 MiB/s wr, 547 op/s 2024-09-12T02:22:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:27 smithi115 ceph-mon[35351]: pgmap v227: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 5.7 MiB/s wr, 525 op/s 2024-09-12T02:22:27.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:27 smithi136 ceph-mon[35814]: pgmap v227: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 5.7 MiB/s wr, 525 op/s 2024-09-12T02:22:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:27 smithi110 ceph-mon[30548]: pgmap v227: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 5.7 MiB/s wr, 525 op/s 2024-09-12T02:22:29.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:29 smithi115 ceph-mon[35351]: pgmap v228: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 5.2 MiB/s wr, 465 op/s 2024-09-12T02:22:29.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:29 smithi136 ceph-mon[35814]: pgmap v228: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 5.2 MiB/s wr, 465 op/s 2024-09-12T02:22:29.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:29 smithi110 ceph-mon[30548]: pgmap v228: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 5.2 MiB/s wr, 465 op/s 2024-09-12T02:22:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 425.0 s, 551.4 tps, lat 186.311 ms stddev 231.916 2024-09-12T02:22:31.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:31 smithi115 ceph-mon[35351]: pgmap v229: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 7.0 MiB/s wr, 614 op/s 2024-09-12T02:22:31.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:31 smithi136 ceph-mon[35814]: pgmap v229: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 7.0 MiB/s wr, 614 op/s 2024-09-12T02:22:31.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:31 smithi110 ceph-mon[30548]: pgmap v229: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 7.0 MiB/s wr, 614 op/s 2024-09-12T02:22:33.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:33 smithi115 ceph-mon[35351]: pgmap v230: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.3 MiB/s wr, 444 op/s 2024-09-12T02:22:33.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:33 smithi136 ceph-mon[35814]: pgmap v230: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.3 MiB/s wr, 444 op/s 2024-09-12T02:22:33.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:33 smithi110 ceph-mon[30548]: pgmap v230: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.3 MiB/s wr, 444 op/s 2024-09-12T02:22:35.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 430.0 s, 511.6 tps, lat 197.004 ms stddev 228.902 2024-09-12T02:22:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:35 smithi115 ceph-mon[35351]: pgmap v231: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.2 MiB/s wr, 554 op/s 2024-09-12T02:22:35.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:35 smithi136 ceph-mon[35814]: pgmap v231: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.2 MiB/s wr, 554 op/s 2024-09-12T02:22:35.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:35 smithi110 ceph-mon[30548]: pgmap v231: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.2 MiB/s wr, 554 op/s 2024-09-12T02:22:37.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:37 smithi115 ceph-mon[35351]: pgmap v232: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.1 MiB/s wr, 467 op/s 2024-09-12T02:22:37.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:37 smithi136 ceph-mon[35814]: pgmap v232: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.1 MiB/s wr, 467 op/s 2024-09-12T02:22:37.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:37 smithi110 ceph-mon[30548]: pgmap v232: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.1 MiB/s wr, 467 op/s 2024-09-12T02:22:39.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:39 smithi115 ceph-mon[35351]: pgmap v233: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 MiB/s wr, 429 op/s 2024-09-12T02:22:39.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:39 smithi136 ceph-mon[35814]: pgmap v233: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 MiB/s wr, 429 op/s 2024-09-12T02:22:39.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:39 smithi110 ceph-mon[30548]: pgmap v233: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.8 MiB/s wr, 429 op/s 2024-09-12T02:22:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 435.0 s, 586.6 tps, lat 169.863 ms stddev 221.431 2024-09-12T02:22:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:41 smithi115 ceph-mon[35351]: pgmap v234: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 631 op/s 2024-09-12T02:22:41.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:41 smithi136 ceph-mon[35814]: pgmap v234: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 631 op/s 2024-09-12T02:22:41.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:41 smithi110 ceph-mon[30548]: pgmap v234: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 631 op/s 2024-09-12T02:22:43.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:43 smithi115 ceph-mon[35351]: pgmap v235: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.9 MiB/s wr, 483 op/s 2024-09-12T02:22:43.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:43 smithi136 ceph-mon[35814]: pgmap v235: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.9 MiB/s wr, 483 op/s 2024-09-12T02:22:43.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:43 smithi110 ceph-mon[30548]: pgmap v235: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.9 MiB/s wr, 483 op/s 2024-09-12T02:22:45.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 440.0 s, 619.5 tps, lat 162.728 ms stddev 188.312 2024-09-12T02:22:45.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:45 smithi115 ceph-mon[35351]: pgmap v236: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 605 op/s 2024-09-12T02:22:45.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:45 smithi136 ceph-mon[35814]: pgmap v236: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 605 op/s 2024-09-12T02:22:45.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:45 smithi110 ceph-mon[30548]: pgmap v236: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 605 op/s 2024-09-12T02:22:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:47 smithi115 ceph-mon[35351]: pgmap v237: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.3 MiB/s wr, 543 op/s 2024-09-12T02:22:47.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:47 smithi136 ceph-mon[35814]: pgmap v237: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.3 MiB/s wr, 543 op/s 2024-09-12T02:22:47.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:47 smithi110 ceph-mon[30548]: pgmap v237: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.3 MiB/s wr, 543 op/s 2024-09-12T02:22:49.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:49 smithi110 ceph-mon[30548]: pgmap v238: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 492 op/s 2024-09-12T02:22:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:49 smithi136 ceph-mon[35814]: pgmap v238: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 492 op/s 2024-09-12T02:22:50.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:49 smithi115 ceph-mon[35351]: pgmap v238: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 492 op/s 2024-09-12T02:22:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 445.0 s, 516.7 tps, lat 190.823 ms stddev 215.461 2024-09-12T02:22:51.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:51 smithi136 ceph-mon[35814]: pgmap v239: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 655 op/s 2024-09-12T02:22:51.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:51 smithi110 ceph-mon[30548]: pgmap v239: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 655 op/s 2024-09-12T02:22:52.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:51 smithi115 ceph-mon[35351]: pgmap v239: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 655 op/s 2024-09-12T02:22:53.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:53 smithi136 ceph-mon[35814]: pgmap v240: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.6 MiB/s wr, 458 op/s 2024-09-12T02:22:53.941 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:53 smithi110 ceph-mon[30548]: pgmap v240: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.6 MiB/s wr, 458 op/s 2024-09-12T02:22:54.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:53 smithi115 ceph-mon[35351]: pgmap v240: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.6 MiB/s wr, 458 op/s 2024-09-12T02:22:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 450.0 s, 474.0 tps, lat 203.480 ms stddev 248.949 2024-09-12T02:22:55.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:55 smithi136 ceph-mon[35814]: pgmap v241: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.5 MiB/s wr, 579 op/s 2024-09-12T02:22:55.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:55 smithi110 ceph-mon[30548]: pgmap v241: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.5 MiB/s wr, 579 op/s 2024-09-12T02:22:56.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:55 smithi115 ceph-mon[35351]: pgmap v241: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.5 MiB/s wr, 579 op/s 2024-09-12T02:22:57.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:57 smithi136 ceph-mon[35814]: pgmap v242: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.6 MiB/s wr, 491 op/s 2024-09-12T02:22:57.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:57 smithi110 ceph-mon[30548]: pgmap v242: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.6 MiB/s wr, 491 op/s 2024-09-12T02:22:58.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:57 smithi115 ceph-mon[35351]: pgmap v242: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.6 MiB/s wr, 491 op/s 2024-09-12T02:22:59.846 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:22:59 smithi115 ceph-mon[35351]: pgmap v243: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.2 MiB/s wr, 443 op/s 2024-09-12T02:22:59.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:22:59 smithi136 ceph-mon[35814]: pgmap v243: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.2 MiB/s wr, 443 op/s 2024-09-12T02:22:59.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:22:59 smithi110 ceph-mon[30548]: pgmap v243: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.2 MiB/s wr, 443 op/s 2024-09-12T02:23:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 455.0 s, 520.2 tps, lat 198.092 ms stddev 266.949 2024-09-12T02:23:01.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:01 smithi136 ceph-mon[35814]: pgmap v244: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.5 MiB/s wr, 589 op/s 2024-09-12T02:23:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:01 smithi110 ceph-mon[30548]: pgmap v244: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.5 MiB/s wr, 589 op/s 2024-09-12T02:23:02.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:01 smithi115 ceph-mon[35351]: pgmap v244: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.5 MiB/s wr, 589 op/s 2024-09-12T02:23:03.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:03 smithi136 ceph-mon[35814]: pgmap v245: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.9 MiB/s wr, 421 op/s 2024-09-12T02:23:03.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:03 smithi110 ceph-mon[30548]: pgmap v245: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.9 MiB/s wr, 421 op/s 2024-09-12T02:23:04.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:03 smithi115 ceph-mon[35351]: pgmap v245: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.9 MiB/s wr, 421 op/s 2024-09-12T02:23:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 460.0 s, 399.6 tps, lat 244.944 ms stddev 308.877 2024-09-12T02:23:05.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:05 smithi136 ceph-mon[35814]: pgmap v246: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 636 op/s 2024-09-12T02:23:05.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:05 smithi110 ceph-mon[30548]: pgmap v246: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 636 op/s 2024-09-12T02:23:06.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:05 smithi115 ceph-mon[35351]: pgmap v246: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 636 op/s 2024-09-12T02:23:07.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:07 smithi136 ceph-mon[35814]: pgmap v247: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.7 MiB/s wr, 610 op/s 2024-09-12T02:23:07.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:07 smithi110 ceph-mon[30548]: pgmap v247: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.7 MiB/s wr, 610 op/s 2024-09-12T02:23:08.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:07 smithi115 ceph-mon[35351]: pgmap v247: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.7 MiB/s wr, 610 op/s 2024-09-12T02:23:09.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:09 smithi136 ceph-mon[35814]: pgmap v248: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 563 op/s 2024-09-12T02:23:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:09 smithi110 ceph-mon[30548]: pgmap v248: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 563 op/s 2024-09-12T02:23:10.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:09 smithi115 ceph-mon[35351]: pgmap v248: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.1 MiB/s wr, 563 op/s 2024-09-12T02:23:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 465.0 s, 537.8 tps, lat 184.310 ms stddev 227.061 2024-09-12T02:23:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:10 smithi136 ceph-mon[35814]: osdmap e101: 12 total, 12 up, 12 in 2024-09-12T02:23:10.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:10 smithi110 ceph-mon[30548]: osdmap e101: 12 total, 12 up, 12 in 2024-09-12T02:23:11.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:10 smithi115 ceph-mon[35351]: osdmap e101: 12 total, 12 up, 12 in 2024-09-12T02:23:11.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:11 smithi136 ceph-mon[35814]: pgmap v250: 129 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 125 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 657 op/s 2024-09-12T02:23:11.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:11 smithi110 ceph-mon[30548]: pgmap v250: 129 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 125 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 657 op/s 2024-09-12T02:23:12.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:11 smithi115 ceph-mon[35351]: pgmap v250: 129 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 125 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.0 MiB/s wr, 657 op/s 2024-09-12T02:23:13.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:13 smithi136 ceph-mon[35814]: pgmap v251: 129 pgs: 4 active+clean+snaptrim, 9 active+clean+snaptrim_wait, 116 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.2 MiB/s wr, 678 op/s 2024-09-12T02:23:13.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:13 smithi110 ceph-mon[30548]: pgmap v251: 129 pgs: 4 active+clean+snaptrim, 9 active+clean+snaptrim_wait, 116 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.2 MiB/s wr, 678 op/s 2024-09-12T02:23:14.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:13 smithi115 ceph-mon[35351]: pgmap v251: 129 pgs: 4 active+clean+snaptrim, 9 active+clean+snaptrim_wait, 116 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.2 MiB/s wr, 678 op/s 2024-09-12T02:23:15.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 470.0 s, 660.4 tps, lat 156.009 ms stddev 169.567 2024-09-12T02:23:15.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:15 smithi110 ceph-mon[30548]: pgmap v252: 129 pgs: 4 active+clean+snaptrim, 9 active+clean+snaptrim_wait, 116 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.3 MiB/s wr, 585 op/s 2024-09-12T02:23:16.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:15 smithi115 ceph-mon[35351]: pgmap v252: 129 pgs: 4 active+clean+snaptrim, 9 active+clean+snaptrim_wait, 116 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.3 MiB/s wr, 585 op/s 2024-09-12T02:23:16.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:15 smithi136 ceph-mon[35814]: pgmap v252: 129 pgs: 4 active+clean+snaptrim, 9 active+clean+snaptrim_wait, 116 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 5.3 MiB/s wr, 585 op/s 2024-09-12T02:23:17.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:17 smithi110 ceph-mon[30548]: pgmap v253: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.0 MiB/s wr, 527 op/s 2024-09-12T02:23:18.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:17 smithi115 ceph-mon[35351]: pgmap v253: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.0 MiB/s wr, 527 op/s 2024-09-12T02:23:18.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:17 smithi136 ceph-mon[35814]: pgmap v253: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.0 MiB/s wr, 527 op/s 2024-09-12T02:23:19.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:19 smithi110 ceph-mon[30548]: pgmap v254: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.0 MiB/s wr, 530 op/s 2024-09-12T02:23:20.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:19 smithi115 ceph-mon[35351]: pgmap v254: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.0 MiB/s wr, 530 op/s 2024-09-12T02:23:20.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:19 smithi136 ceph-mon[35814]: pgmap v254: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.0 MiB/s wr, 530 op/s 2024-09-12T02:23:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 475.0 s, 456.6 tps, lat 219.820 ms stddev 276.449 2024-09-12T02:23:21.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:21 smithi136 ceph-mon[35814]: pgmap v255: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.4 MiB/s wr, 568 op/s 2024-09-12T02:23:21.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:21 smithi136 ceph-mon[35814]: osdmap e102: 12 total, 12 up, 12 in 2024-09-12T02:23:21.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:21 smithi110 ceph-mon[30548]: pgmap v255: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.4 MiB/s wr, 568 op/s 2024-09-12T02:23:21.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:21 smithi110 ceph-mon[30548]: osdmap e102: 12 total, 12 up, 12 in 2024-09-12T02:23:21.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:21 smithi115 ceph-mon[35351]: pgmap v255: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.4 MiB/s wr, 568 op/s 2024-09-12T02:23:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:21 smithi115 ceph-mon[35351]: osdmap e102: 12 total, 12 up, 12 in 2024-09-12T02:23:23.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:23 smithi136 ceph-mon[35814]: pgmap v257: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.4 MiB/s wr, 567 op/s 2024-09-12T02:23:23.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:23 smithi110 ceph-mon[30548]: pgmap v257: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.4 MiB/s wr, 567 op/s 2024-09-12T02:23:23.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:23 smithi115 ceph-mon[35351]: pgmap v257: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.4 MiB/s wr, 567 op/s 2024-09-12T02:23:25.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 480.0 s, 474.4 tps, lat 208.762 ms stddev 235.227 2024-09-12T02:23:25.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:25 smithi136 ceph-mon[35814]: pgmap v258: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.6 MiB/s wr, 528 op/s 2024-09-12T02:23:25.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:25 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:25.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:25 smithi110 ceph-mon[30548]: pgmap v258: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.6 MiB/s wr, 528 op/s 2024-09-12T02:23:25.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:25 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:25.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:25 smithi115 ceph-mon[35351]: pgmap v258: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.6 MiB/s wr, 528 op/s 2024-09-12T02:23:25.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:25 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:23:27.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:27 smithi136 ceph-mon[35814]: pgmap v259: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 5.0 MiB/s wr, 533 op/s 2024-09-12T02:23:27.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:27 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:27.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:27 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:27.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:27 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:23:27.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:27 smithi110 ceph-mon[30548]: pgmap v259: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 5.0 MiB/s wr, 533 op/s 2024-09-12T02:23:27.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:27 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:27.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:27 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:27.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:27 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:23:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:27 smithi115 ceph-mon[35351]: pgmap v259: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 5.0 MiB/s wr, 533 op/s 2024-09-12T02:23:27.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:27 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:23:27.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:27 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:23:27.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:27 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:23:29.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:29 smithi136 ceph-mon[35814]: pgmap v260: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 4.9 MiB/s wr, 527 op/s 2024-09-12T02:23:29.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:29 smithi110 ceph-mon[30548]: pgmap v260: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 4.9 MiB/s wr, 527 op/s 2024-09-12T02:23:29.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:29 smithi115 ceph-mon[35351]: pgmap v260: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 4.9 MiB/s wr, 527 op/s 2024-09-12T02:23:30.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 485.0 s, 646.1 tps, lat 158.341 ms stddev 213.728 2024-09-12T02:23:31.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:31 smithi136 ceph-mon[35814]: pgmap v261: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.6 MiB/s wr, 496 op/s 2024-09-12T02:23:31.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:31 smithi110 ceph-mon[30548]: pgmap v261: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.6 MiB/s wr, 496 op/s 2024-09-12T02:23:31.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:31 smithi115 ceph-mon[35351]: pgmap v261: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.6 MiB/s wr, 496 op/s 2024-09-12T02:23:33.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:33 smithi110 ceph-mon[30548]: pgmap v262: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 441 op/s 2024-09-12T02:23:33.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:33 smithi115 ceph-mon[35351]: pgmap v262: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 441 op/s 2024-09-12T02:23:33.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:33 smithi136 ceph-mon[35814]: pgmap v262: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.0 MiB/s wr, 441 op/s 2024-09-12T02:23:35.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 490.0 s, 601.7 tps, lat 167.015 ms stddev 216.439 2024-09-12T02:23:35.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:35 smithi110 ceph-mon[30548]: pgmap v263: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.3 MiB/s wr, 570 op/s 2024-09-12T02:23:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:35 smithi115 ceph-mon[35351]: pgmap v263: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.3 MiB/s wr, 570 op/s 2024-09-12T02:23:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:35 smithi136 ceph-mon[35814]: pgmap v263: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.3 MiB/s wr, 570 op/s 2024-09-12T02:23:37.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:37 smithi110 ceph-mon[30548]: pgmap v264: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.7 MiB/s wr, 492 op/s 2024-09-12T02:23:37.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:37 smithi115 ceph-mon[35351]: pgmap v264: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.7 MiB/s wr, 492 op/s 2024-09-12T02:23:37.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:37 smithi136 ceph-mon[35814]: pgmap v264: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.7 MiB/s wr, 492 op/s 2024-09-12T02:23:39.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:39 smithi110 ceph-mon[30548]: pgmap v265: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.2 MiB/s wr, 455 op/s 2024-09-12T02:23:39.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:39 smithi115 ceph-mon[35351]: pgmap v265: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.2 MiB/s wr, 455 op/s 2024-09-12T02:23:39.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:39 smithi136 ceph-mon[35814]: pgmap v265: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.2 MiB/s wr, 455 op/s 2024-09-12T02:23:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 495.0 s, 596.0 tps, lat 163.479 ms stddev 202.528 2024-09-12T02:23:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:41 smithi115 ceph-mon[35351]: pgmap v266: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.8 MiB/s wr, 616 op/s 2024-09-12T02:23:41.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:41 smithi136 ceph-mon[35814]: pgmap v266: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.8 MiB/s wr, 616 op/s 2024-09-12T02:23:41.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:41 smithi110 ceph-mon[30548]: pgmap v266: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.8 MiB/s wr, 616 op/s 2024-09-12T02:23:43.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:43 smithi115 ceph-mon[35351]: pgmap v267: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 482 op/s 2024-09-12T02:23:43.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:43 smithi136 ceph-mon[35814]: pgmap v267: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 482 op/s 2024-09-12T02:23:43.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:43 smithi110 ceph-mon[30548]: pgmap v267: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.4 MiB/s wr, 482 op/s 2024-09-12T02:23:45.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 500.0 s, 527.0 tps, lat 188.350 ms stddev 253.975 2024-09-12T02:23:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:45 smithi115 ceph-mon[35351]: pgmap v268: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 599 op/s 2024-09-12T02:23:45.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:45 smithi136 ceph-mon[35814]: pgmap v268: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 599 op/s 2024-09-12T02:23:45.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:45 smithi110 ceph-mon[30548]: pgmap v268: 129 pgs: 129 active+clean; 3.0 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 599 op/s 2024-09-12T02:23:47.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:47 smithi115 ceph-mon[35351]: pgmap v269: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 486 op/s 2024-09-12T02:23:47.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:47 smithi136 ceph-mon[35814]: pgmap v269: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 486 op/s 2024-09-12T02:23:47.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:47 smithi110 ceph-mon[30548]: pgmap v269: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 4.4 MiB/s wr, 486 op/s 2024-09-12T02:23:49.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:49 smithi115 ceph-mon[35351]: pgmap v270: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 467 op/s 2024-09-12T02:23:49.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:49 smithi136 ceph-mon[35814]: pgmap v270: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 467 op/s 2024-09-12T02:23:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:49 smithi110 ceph-mon[30548]: pgmap v270: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.2 MiB/s wr, 467 op/s 2024-09-12T02:23:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 505.0 s, 453.8 tps, lat 223.184 ms stddev 320.608 2024-09-12T02:23:51.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:51 smithi115 ceph-mon[35351]: pgmap v271: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.1 MiB/s wr, 569 op/s 2024-09-12T02:23:51.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:51 smithi136 ceph-mon[35814]: pgmap v271: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.1 MiB/s wr, 569 op/s 2024-09-12T02:23:51.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:51 smithi110 ceph-mon[30548]: pgmap v271: 129 pgs: 129 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.1 MiB/s wr, 569 op/s 2024-09-12T02:23:53.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:53 smithi115 ceph-mon[35351]: pgmap v272: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.2 MiB/s wr, 471 op/s 2024-09-12T02:23:53.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:53 smithi136 ceph-mon[35814]: pgmap v272: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.2 MiB/s wr, 471 op/s 2024-09-12T02:23:53.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:53 smithi110 ceph-mon[30548]: pgmap v272: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.2 MiB/s wr, 471 op/s 2024-09-12T02:23:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 510.0 s, 668.2 tps, lat 151.847 ms stddev 169.676 2024-09-12T02:23:55.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:55 smithi115 ceph-mon[35351]: pgmap v273: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 616 op/s 2024-09-12T02:23:55.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:55 smithi136 ceph-mon[35814]: pgmap v273: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 616 op/s 2024-09-12T02:23:55.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:55 smithi110 ceph-mon[30548]: pgmap v273: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 616 op/s 2024-09-12T02:23:57.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:57 smithi115 ceph-mon[35351]: pgmap v274: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.6 MiB/s wr, 513 op/s 2024-09-12T02:23:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:57 smithi136 ceph-mon[35814]: pgmap v274: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.6 MiB/s wr, 513 op/s 2024-09-12T02:23:57.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:57 smithi110 ceph-mon[30548]: pgmap v274: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.6 MiB/s wr, 513 op/s 2024-09-12T02:23:59.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:23:59 smithi115 ceph-mon[35351]: pgmap v275: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.5 MiB/s wr, 499 op/s 2024-09-12T02:23:59.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:23:59 smithi136 ceph-mon[35814]: pgmap v275: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.5 MiB/s wr, 499 op/s 2024-09-12T02:23:59.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:23:59 smithi110 ceph-mon[30548]: pgmap v275: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 4.5 MiB/s wr, 499 op/s 2024-09-12T02:24:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 515.0 s, 1014.4 tps, lat 99.340 ms stddev 107.963 2024-09-12T02:24:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:01 smithi115 ceph-mon[35351]: pgmap v276: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.0 MiB/s wr, 634 op/s 2024-09-12T02:24:01.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:01 smithi136 ceph-mon[35814]: pgmap v276: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.0 MiB/s wr, 634 op/s 2024-09-12T02:24:01.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:01 smithi110 ceph-mon[30548]: pgmap v276: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.0 MiB/s wr, 634 op/s 2024-09-12T02:24:03.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:03 smithi115 ceph-mon[35351]: pgmap v277: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.4 MiB/s wr, 572 op/s 2024-09-12T02:24:03.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:03 smithi136 ceph-mon[35814]: pgmap v277: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.4 MiB/s wr, 572 op/s 2024-09-12T02:24:03.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:03 smithi110 ceph-mon[30548]: pgmap v277: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.4 MiB/s wr, 572 op/s 2024-09-12T02:24:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 520.0 s, 677.0 tps, lat 141.237 ms stddev 222.621 2024-09-12T02:24:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:05 smithi115 ceph-mon[35351]: pgmap v278: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.5 MiB/s wr, 808 op/s 2024-09-12T02:24:05.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:05 smithi136 ceph-mon[35814]: pgmap v278: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.5 MiB/s wr, 808 op/s 2024-09-12T02:24:05.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:05 smithi110 ceph-mon[30548]: pgmap v278: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.5 MiB/s wr, 808 op/s 2024-09-12T02:24:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:07 smithi136 ceph-mon[35814]: pgmap v279: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.7 MiB/s wr, 733 op/s 2024-09-12T02:24:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:07 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:24:07.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:07 smithi110 ceph-mon[30548]: pgmap v279: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.7 MiB/s wr, 733 op/s 2024-09-12T02:24:07.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:07 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:24:08.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:07 smithi115 ceph-mon[35351]: pgmap v279: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.7 MiB/s wr, 733 op/s 2024-09-12T02:24:08.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:07 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:24:09.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:09 smithi136 ceph-mon[35814]: pgmap v280: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.5 MiB/s wr, 719 op/s 2024-09-12T02:24:09.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:09 smithi110 ceph-mon[30548]: pgmap v280: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.5 MiB/s wr, 719 op/s 2024-09-12T02:24:10.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:09 smithi115 ceph-mon[35351]: pgmap v280: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.5 MiB/s wr, 719 op/s 2024-09-12T02:24:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 525.0 s, 534.8 tps, lat 179.127 ms stddev 259.722 2024-09-12T02:24:10.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:10 smithi136 ceph-mon[35814]: osdmap e103: 12 total, 12 up, 12 in 2024-09-12T02:24:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:10 smithi110 ceph-mon[30548]: osdmap e103: 12 total, 12 up, 12 in 2024-09-12T02:24:11.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:10 smithi115 ceph-mon[35351]: osdmap e103: 12 total, 12 up, 12 in 2024-09-12T02:24:11.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:11 smithi136 ceph-mon[35814]: pgmap v282: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.1 MiB/s wr, 810 op/s 2024-09-12T02:24:11.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:11 smithi110 ceph-mon[30548]: pgmap v282: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.1 MiB/s wr, 810 op/s 2024-09-12T02:24:12.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:11 smithi115 ceph-mon[35351]: pgmap v282: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.1 MiB/s wr, 810 op/s 2024-09-12T02:24:13.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:13 smithi136 ceph-mon[35814]: pgmap v283: 129 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 115 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.9 MiB/s wr, 782 op/s 2024-09-12T02:24:13.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:13 smithi110 ceph-mon[30548]: pgmap v283: 129 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 115 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.9 MiB/s wr, 782 op/s 2024-09-12T02:24:14.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:13 smithi115 ceph-mon[35351]: pgmap v283: 129 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 115 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.9 MiB/s wr, 782 op/s 2024-09-12T02:24:15.173 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 530.0 s, 568.7 tps, lat 187.110 ms stddev 230.626 2024-09-12T02:24:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:15 smithi136 ceph-mon[35814]: pgmap v284: 129 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 115 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 5.1 MiB/s wr, 592 op/s 2024-09-12T02:24:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:15 smithi110 ceph-mon[30548]: pgmap v284: 129 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 115 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 5.1 MiB/s wr, 592 op/s 2024-09-12T02:24:16.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:15 smithi115 ceph-mon[35351]: pgmap v284: 129 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 115 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 5.1 MiB/s wr, 592 op/s 2024-09-12T02:24:17.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:17 smithi136 ceph-mon[35814]: pgmap v285: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.5 MiB/s wr, 515 op/s 2024-09-12T02:24:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:17 smithi110 ceph-mon[30548]: pgmap v285: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.5 MiB/s wr, 515 op/s 2024-09-12T02:24:18.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:17 smithi115 ceph-mon[35351]: pgmap v285: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.5 MiB/s wr, 515 op/s 2024-09-12T02:24:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:19 smithi136 ceph-mon[35814]: pgmap v286: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 4.4 MiB/s wr, 498 op/s 2024-09-12T02:24:19.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:19 smithi110 ceph-mon[30548]: pgmap v286: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 4.4 MiB/s wr, 498 op/s 2024-09-12T02:24:20.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:19 smithi115 ceph-mon[35351]: pgmap v286: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 4.4 MiB/s wr, 498 op/s 2024-09-12T02:24:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 535.0 s, 477.7 tps, lat 205.314 ms stddev 273.996 2024-09-12T02:24:21.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:21 smithi136 ceph-mon[35814]: pgmap v287: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 4.4 MiB/s wr, 504 op/s 2024-09-12T02:24:21.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:21 smithi136 ceph-mon[35814]: osdmap e104: 12 total, 12 up, 12 in 2024-09-12T02:24:21.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:21 smithi110 ceph-mon[30548]: pgmap v287: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 4.4 MiB/s wr, 504 op/s 2024-09-12T02:24:21.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:21 smithi110 ceph-mon[30548]: osdmap e104: 12 total, 12 up, 12 in 2024-09-12T02:24:21.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:21 smithi115 ceph-mon[35351]: pgmap v287: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 4.4 MiB/s wr, 504 op/s 2024-09-12T02:24:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:21 smithi115 ceph-mon[35351]: osdmap e104: 12 total, 12 up, 12 in 2024-09-12T02:24:23.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:23 smithi136 ceph-mon[35814]: pgmap v289: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 4.9 MiB/s wr, 552 op/s 2024-09-12T02:24:23.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:23 smithi110 ceph-mon[30548]: pgmap v289: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 4.9 MiB/s wr, 552 op/s 2024-09-12T02:24:23.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:23 smithi115 ceph-mon[35351]: pgmap v289: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 4.9 MiB/s wr, 552 op/s 2024-09-12T02:24:25.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 540.0 s, 465.6 tps, lat 222.894 ms stddev 271.566 2024-09-12T02:24:25.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:25 smithi136 ceph-mon[35814]: pgmap v290: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.9 MiB/s wr, 579 op/s 2024-09-12T02:24:25.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:25 smithi110 ceph-mon[30548]: pgmap v290: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.9 MiB/s wr, 579 op/s 2024-09-12T02:24:25.855 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:25 smithi115 ceph-mon[35351]: pgmap v290: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 4.9 MiB/s wr, 579 op/s 2024-09-12T02:24:27.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:27 smithi136 ceph-mon[35814]: pgmap v291: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.3 MiB/s wr, 595 op/s 2024-09-12T02:24:27.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:27 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:27.690 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:27 smithi110 ceph-mon[30548]: pgmap v291: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.3 MiB/s wr, 595 op/s 2024-09-12T02:24:27.690 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:27 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:27 smithi115 ceph-mon[35351]: pgmap v291: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.3 MiB/s wr, 595 op/s 2024-09-12T02:24:27.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:27 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:24:29.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:29 smithi136 ceph-mon[35814]: pgmap v292: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.2 MiB/s wr, 593 op/s 2024-09-12T02:24:29.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:29 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:29.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:29 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:29.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:29 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:24:29.690 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:29 smithi110 ceph-mon[30548]: pgmap v292: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.2 MiB/s wr, 593 op/s 2024-09-12T02:24:29.690 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:29 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:29.690 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:29 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:29.690 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:29 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:24:29.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:29 smithi115 ceph-mon[35351]: pgmap v292: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 5.2 MiB/s wr, 593 op/s 2024-09-12T02:24:29.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:29 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:24:29.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:29 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:24:29.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:29 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:24:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 545.0 s, 481.6 tps, lat 204.127 ms stddev 232.455 2024-09-12T02:24:31.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:31 smithi136 ceph-mon[35814]: pgmap v293: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.0 MiB/s wr, 550 op/s 2024-09-12T02:24:31.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:31 smithi110 ceph-mon[30548]: pgmap v293: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.0 MiB/s wr, 550 op/s 2024-09-12T02:24:31.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:31 smithi115 ceph-mon[35351]: pgmap v293: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.0 MiB/s wr, 550 op/s 2024-09-12T02:24:33.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:33 smithi110 ceph-mon[30548]: pgmap v294: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.8 MiB/s wr, 531 op/s 2024-09-12T02:24:33.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:33 smithi115 ceph-mon[35351]: pgmap v294: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.8 MiB/s wr, 531 op/s 2024-09-12T02:24:33.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:33 smithi136 ceph-mon[35814]: pgmap v294: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.8 MiB/s wr, 531 op/s 2024-09-12T02:24:35.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 550.0 s, 592.8 tps, lat 171.819 ms stddev 197.955 2024-09-12T02:24:35.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:35 smithi110 ceph-mon[30548]: pgmap v295: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.4 MiB/s wr, 591 op/s 2024-09-12T02:24:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:35 smithi115 ceph-mon[35351]: pgmap v295: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.4 MiB/s wr, 591 op/s 2024-09-12T02:24:35.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:35 smithi136 ceph-mon[35814]: pgmap v295: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.4 MiB/s wr, 591 op/s 2024-09-12T02:24:37.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:37 smithi110 ceph-mon[30548]: pgmap v296: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.2 MiB/s wr, 443 op/s 2024-09-12T02:24:37.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:37 smithi115 ceph-mon[35351]: pgmap v296: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.2 MiB/s wr, 443 op/s 2024-09-12T02:24:37.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:37 smithi136 ceph-mon[35814]: pgmap v296: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.2 MiB/s wr, 443 op/s 2024-09-12T02:24:39.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:39 smithi110 ceph-mon[30548]: pgmap v297: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.9 MiB/s wr, 423 op/s 2024-09-12T02:24:39.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:39 smithi115 ceph-mon[35351]: pgmap v297: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.9 MiB/s wr, 423 op/s 2024-09-12T02:24:39.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:39 smithi136 ceph-mon[35814]: pgmap v297: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.9 MiB/s wr, 423 op/s 2024-09-12T02:24:40.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 555.0 s, 683.0 tps, lat 146.482 ms stddev 175.126 2024-09-12T02:24:41.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:41 smithi115 ceph-mon[35351]: pgmap v298: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 562 op/s 2024-09-12T02:24:41.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:41 smithi136 ceph-mon[35814]: pgmap v298: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 562 op/s 2024-09-12T02:24:41.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:41 smithi110 ceph-mon[30548]: pgmap v298: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 562 op/s 2024-09-12T02:24:43.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:43 smithi115 ceph-mon[35351]: pgmap v299: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.2 MiB/s wr, 478 op/s 2024-09-12T02:24:43.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:43 smithi136 ceph-mon[35814]: pgmap v299: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.2 MiB/s wr, 478 op/s 2024-09-12T02:24:43.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:43 smithi110 ceph-mon[30548]: pgmap v299: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 4.2 MiB/s wr, 478 op/s 2024-09-12T02:24:45.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 560.0 s, 486.0 tps, lat 200.969 ms stddev 202.426 2024-09-12T02:24:45.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:45 smithi115 ceph-mon[35351]: pgmap v300: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.2 MiB/s wr, 587 op/s 2024-09-12T02:24:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:45 smithi136 ceph-mon[35814]: pgmap v300: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.2 MiB/s wr, 587 op/s 2024-09-12T02:24:45.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:45 smithi110 ceph-mon[30548]: pgmap v300: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 5.2 MiB/s wr, 587 op/s 2024-09-12T02:24:47.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:47 smithi115 ceph-mon[35351]: pgmap v301: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.2 MiB/s wr, 473 op/s 2024-09-12T02:24:47.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:47 smithi136 ceph-mon[35814]: pgmap v301: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.2 MiB/s wr, 473 op/s 2024-09-12T02:24:47.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:47 smithi110 ceph-mon[30548]: pgmap v301: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.2 MiB/s wr, 473 op/s 2024-09-12T02:24:49.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:49 smithi115 ceph-mon[35351]: pgmap v302: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.3 MiB/s wr, 481 op/s 2024-09-12T02:24:49.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:49 smithi136 ceph-mon[35814]: pgmap v302: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.3 MiB/s wr, 481 op/s 2024-09-12T02:24:49.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:49 smithi110 ceph-mon[30548]: pgmap v302: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.3 MiB/s wr, 481 op/s 2024-09-12T02:24:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 565.0 s, 497.0 tps, lat 203.743 ms stddev 210.981 2024-09-12T02:24:51.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:51 smithi115 ceph-mon[35351]: pgmap v303: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.0 MiB/s wr, 568 op/s 2024-09-12T02:24:51.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:51 smithi136 ceph-mon[35814]: pgmap v303: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.0 MiB/s wr, 568 op/s 2024-09-12T02:24:51.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:51 smithi110 ceph-mon[30548]: pgmap v303: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.0 MiB/s wr, 568 op/s 2024-09-12T02:24:52.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:52 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:24:52.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:52 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:24:52.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:52 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:24:53.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:53 smithi115 ceph-mon[35351]: pgmap v304: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.2 MiB/s wr, 476 op/s 2024-09-12T02:24:53.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:53 smithi136 ceph-mon[35814]: pgmap v304: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.2 MiB/s wr, 476 op/s 2024-09-12T02:24:53.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:53 smithi110 ceph-mon[30548]: pgmap v304: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.2 MiB/s wr, 476 op/s 2024-09-12T02:24:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 570.0 s, 493.6 tps, lat 201.676 ms stddev 229.096 2024-09-12T02:24:55.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:55 smithi115 ceph-mon[35351]: pgmap v305: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.4 MiB/s wr, 625 op/s 2024-09-12T02:24:55.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:55 smithi136 ceph-mon[35814]: pgmap v305: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.4 MiB/s wr, 625 op/s 2024-09-12T02:24:55.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:55 smithi110 ceph-mon[30548]: pgmap v305: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.4 MiB/s wr, 625 op/s 2024-09-12T02:24:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:57 smithi115 ceph-mon[35351]: pgmap v306: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.2 MiB/s wr, 492 op/s 2024-09-12T02:24:57.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:57 smithi136 ceph-mon[35814]: pgmap v306: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.2 MiB/s wr, 492 op/s 2024-09-12T02:24:57.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:57 smithi110 ceph-mon[30548]: pgmap v306: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.2 MiB/s wr, 492 op/s 2024-09-12T02:24:59.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:24:59 smithi115 ceph-mon[35351]: pgmap v307: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 484 op/s 2024-09-12T02:24:59.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:24:59 smithi136 ceph-mon[35814]: pgmap v307: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 484 op/s 2024-09-12T02:24:59.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:24:59 smithi110 ceph-mon[30548]: pgmap v307: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.0 MiB/s wr, 484 op/s 2024-09-12T02:25:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 575.0 s, 454.2 tps, lat 215.619 ms stddev 254.102 2024-09-12T02:25:01.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:01 smithi136 ceph-mon[35814]: pgmap v308: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.1 MiB/s wr, 592 op/s 2024-09-12T02:25:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:01 smithi115 ceph-mon[35351]: pgmap v308: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.1 MiB/s wr, 592 op/s 2024-09-12T02:25:01.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:01 smithi110 ceph-mon[30548]: pgmap v308: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.1 MiB/s wr, 592 op/s 2024-09-12T02:25:03.824 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:03 smithi136 ceph-mon[35814]: pgmap v309: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.4 MiB/s wr, 521 op/s 2024-09-12T02:25:03.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:03 smithi110 ceph-mon[30548]: pgmap v309: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.4 MiB/s wr, 521 op/s 2024-09-12T02:25:04.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:03 smithi115 ceph-mon[35351]: pgmap v309: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 4.4 MiB/s wr, 521 op/s 2024-09-12T02:25:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 580.0 s, 454.2 tps, lat 221.347 ms stddev 317.052 2024-09-12T02:25:05.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:05 smithi136 ceph-mon[35814]: pgmap v310: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.0 MiB/s wr, 594 op/s 2024-09-12T02:25:05.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:05 smithi110 ceph-mon[30548]: pgmap v310: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.0 MiB/s wr, 594 op/s 2024-09-12T02:25:06.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:05 smithi115 ceph-mon[35351]: pgmap v310: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 5.0 MiB/s wr, 594 op/s 2024-09-12T02:25:07.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:07 smithi136 ceph-mon[35814]: pgmap v311: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 3.5 MiB/s wr, 406 op/s 2024-09-12T02:25:07.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:07 smithi110 ceph-mon[30548]: pgmap v311: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 3.5 MiB/s wr, 406 op/s 2024-09-12T02:25:08.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:07 smithi115 ceph-mon[35351]: pgmap v311: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 3.5 MiB/s wr, 406 op/s 2024-09-12T02:25:09.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:09 smithi136 ceph-mon[35814]: pgmap v312: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 3.8 MiB/s wr, 430 op/s 2024-09-12T02:25:09.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:09 smithi110 ceph-mon[30548]: pgmap v312: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 3.8 MiB/s wr, 430 op/s 2024-09-12T02:25:10.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:09 smithi115 ceph-mon[35351]: pgmap v312: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 3.8 MiB/s wr, 430 op/s 2024-09-12T02:25:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 585.0 s, 424.4 tps, lat 213.552 ms stddev 266.532 2024-09-12T02:25:10.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:10 smithi136 ceph-mon[35814]: osdmap e105: 12 total, 12 up, 12 in 2024-09-12T02:25:10.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:10 smithi110 ceph-mon[30548]: osdmap e105: 12 total, 12 up, 12 in 2024-09-12T02:25:11.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:10 smithi115 ceph-mon[35351]: osdmap e105: 12 total, 12 up, 12 in 2024-09-12T02:25:11.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:11 smithi136 ceph-mon[35814]: pgmap v314: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 3.9 MiB/s wr, 457 op/s 2024-09-12T02:25:11.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:11 smithi110 ceph-mon[30548]: pgmap v314: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 3.9 MiB/s wr, 457 op/s 2024-09-12T02:25:12.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:11 smithi115 ceph-mon[35351]: pgmap v314: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 3.9 MiB/s wr, 457 op/s 2024-09-12T02:25:13.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:13 smithi136 ceph-mon[35814]: pgmap v315: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.1 MiB/s wr, 448 op/s 2024-09-12T02:25:13.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:13 smithi110 ceph-mon[30548]: pgmap v315: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.1 MiB/s wr, 448 op/s 2024-09-12T02:25:14.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:13 smithi115 ceph-mon[35351]: pgmap v315: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.1 MiB/s wr, 448 op/s 2024-09-12T02:25:15.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 590.0 s, 512.8 tps, lat 215.478 ms stddev 266.888 2024-09-12T02:25:15.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:15 smithi136 ceph-mon[35814]: pgmap v316: 129 pgs: 129 active+clean; 2.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.7 MiB/s wr, 435 op/s 2024-09-12T02:25:15.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:15 smithi136 ceph-mon[35814]: osdmap e106: 12 total, 12 up, 12 in 2024-09-12T02:25:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:15 smithi110 ceph-mon[30548]: pgmap v316: 129 pgs: 129 active+clean; 2.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.7 MiB/s wr, 435 op/s 2024-09-12T02:25:15.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:15 smithi110 ceph-mon[30548]: osdmap e106: 12 total, 12 up, 12 in 2024-09-12T02:25:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:15 smithi115 ceph-mon[35351]: pgmap v316: 129 pgs: 129 active+clean; 2.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 3.7 MiB/s wr, 435 op/s 2024-09-12T02:25:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:15 smithi115 ceph-mon[35351]: osdmap e106: 12 total, 12 up, 12 in 2024-09-12T02:25:17.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:17 smithi136 ceph-mon[35814]: pgmap v318: 129 pgs: 129 active+clean; 2.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.8 MiB/s wr, 459 op/s 2024-09-12T02:25:17.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:17 smithi110 ceph-mon[30548]: pgmap v318: 129 pgs: 129 active+clean; 2.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.8 MiB/s wr, 459 op/s 2024-09-12T02:25:18.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:17 smithi115 ceph-mon[35351]: pgmap v318: 129 pgs: 129 active+clean; 2.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 3.8 MiB/s wr, 459 op/s 2024-09-12T02:25:19.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:19 smithi136 ceph-mon[35814]: pgmap v319: 129 pgs: 129 active+clean; 2.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.8 MiB/s wr, 345 op/s 2024-09-12T02:25:19.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:19 smithi110 ceph-mon[30548]: pgmap v319: 129 pgs: 129 active+clean; 2.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.8 MiB/s wr, 345 op/s 2024-09-12T02:25:20.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:19 smithi115 ceph-mon[35351]: pgmap v319: 129 pgs: 129 active+clean; 2.7 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.8 MiB/s wr, 345 op/s 2024-09-12T02:25:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 595.0 s, 471.4 tps, lat 208.469 ms stddev 252.297 2024-09-12T02:25:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:21 smithi110 ceph-mon[30548]: pgmap v320: 129 pgs: 129 active+clean; 2.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.0 MiB/s wr, 496 op/s 2024-09-12T02:25:22.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:21 smithi115 ceph-mon[35351]: pgmap v320: 129 pgs: 129 active+clean; 2.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.0 MiB/s wr, 496 op/s 2024-09-12T02:25:22.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:21 smithi136 ceph-mon[35814]: pgmap v320: 129 pgs: 129 active+clean; 2.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.0 MiB/s wr, 496 op/s 2024-09-12T02:25:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:23 smithi110 ceph-mon[30548]: pgmap v321: 129 pgs: 129 active+clean; 2.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.0 MiB/s wr, 513 op/s 2024-09-12T02:25:24.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:23 smithi115 ceph-mon[35351]: pgmap v321: 129 pgs: 129 active+clean; 2.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.0 MiB/s wr, 513 op/s 2024-09-12T02:25:24.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:23 smithi136 ceph-mon[35814]: pgmap v321: 129 pgs: 129 active+clean; 2.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 6.0 MiB/s wr, 513 op/s 2024-09-12T02:25:25.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 600.0 s, 506.8 tps, lat 201.817 ms stddev 259.015 2024-09-12T02:25:25.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:25 smithi110 ceph-mon[30548]: pgmap v322: 129 pgs: 129 active+clean; 2.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 7.6 MiB/s wr, 546 op/s 2024-09-12T02:25:26.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:25 smithi115 ceph-mon[35351]: pgmap v322: 129 pgs: 129 active+clean; 2.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 7.6 MiB/s wr, 546 op/s 2024-09-12T02:25:26.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:25 smithi136 ceph-mon[35814]: pgmap v322: 129 pgs: 129 active+clean; 2.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 7.6 MiB/s wr, 546 op/s 2024-09-12T02:25:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:27 smithi110 ceph-mon[30548]: pgmap v323: 129 pgs: 129 active+clean; 2.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.7 MiB/s wr, 544 op/s 2024-09-12T02:25:28.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:27 smithi115 ceph-mon[35351]: pgmap v323: 129 pgs: 129 active+clean; 2.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.7 MiB/s wr, 544 op/s 2024-09-12T02:25:28.161 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:27 smithi136 ceph-mon[35814]: pgmap v323: 129 pgs: 129 active+clean; 2.8 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.7 MiB/s wr, 544 op/s 2024-09-12T02:25:29.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:29 smithi110 ceph-mon[30548]: pgmap v324: 129 pgs: 129 active+clean; 2.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.5 MiB/s wr, 529 op/s 2024-09-12T02:25:29.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:29 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:29.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:29 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:29.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:29 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:30.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:29 smithi115 ceph-mon[35351]: pgmap v324: 129 pgs: 129 active+clean; 2.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.5 MiB/s wr, 529 op/s 2024-09-12T02:25:30.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:29 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:30.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:29 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:30.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:29 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:30.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:29 smithi136 ceph-mon[35814]: pgmap v324: 129 pgs: 129 active+clean; 2.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.5 MiB/s wr, 529 op/s 2024-09-12T02:25:30.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:29 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:25:30.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:29 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:30.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:29 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 605.0 s, 504.4 tps, lat 190.406 ms stddev 216.078 2024-09-12T02:25:30.852 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:30 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:30.852 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:30 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:31.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:30 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:31.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:30 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:31.189 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:30 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:31.189 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:30 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:31 smithi136 ceph-mon[35814]: pgmap v325: 129 pgs: 129 active+clean; 2.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 8.9 MiB/s wr, 618 op/s 2024-09-12T02:25:32.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:31 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:31 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:31 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:31 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:31 smithi110 ceph-mon[30548]: pgmap v325: 129 pgs: 129 active+clean; 2.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 8.9 MiB/s wr, 618 op/s 2024-09-12T02:25:32.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:31 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:31 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:31 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:31 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:31 smithi115 ceph-mon[35351]: pgmap v325: 129 pgs: 129 active+clean; 2.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 8.9 MiB/s wr, 618 op/s 2024-09-12T02:25:32.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:31 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:31 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:31 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:31 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:32.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:32 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:32.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:32 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:32.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:32 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:32.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:32 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:32.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:32 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:32.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:32 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:32.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:32 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:32.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:32 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:32 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:32 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:32 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:32 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:32 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:32 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:32 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:32 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:32 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:32 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:32 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:32 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:32 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:32 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:32 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:33.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:32 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:34.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:33 smithi136 ceph-mon[35814]: pgmap v326: 129 pgs: 129 active+clean; 2.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.8 MiB/s wr, 471 op/s 2024-09-12T02:25:34.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:33 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi115 to 176.0M 2024-09-12T02:25:34.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:33 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi136 to 176.0M 2024-09-12T02:25:34.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:33 smithi136 ceph-mon[35814]: Unable to set osd_memory_target on smithi115 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T02:25:34.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:33 smithi136 ceph-mon[35814]: Unable to set osd_memory_target on smithi136 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T02:25:34.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:33 smithi110 ceph-mon[30548]: pgmap v326: 129 pgs: 129 active+clean; 2.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.8 MiB/s wr, 471 op/s 2024-09-12T02:25:34.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:33 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi115 to 176.0M 2024-09-12T02:25:34.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:33 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi136 to 176.0M 2024-09-12T02:25:34.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:33 smithi110 ceph-mon[30548]: Unable to set osd_memory_target on smithi115 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T02:25:34.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:33 smithi110 ceph-mon[30548]: Unable to set osd_memory_target on smithi136 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T02:25:34.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:33 smithi115 ceph-mon[35351]: pgmap v326: 129 pgs: 129 active+clean; 2.8 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.8 MiB/s wr, 471 op/s 2024-09-12T02:25:34.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:33 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi115 to 176.0M 2024-09-12T02:25:34.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:33 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi136 to 176.0M 2024-09-12T02:25:34.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:33 smithi115 ceph-mon[35351]: Unable to set osd_memory_target on smithi115 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T02:25:34.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:33 smithi115 ceph-mon[35351]: Unable to set osd_memory_target on smithi136 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-12T02:25:35.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 610.0 s, 521.0 tps, lat 192.643 ms stddev 222.931 2024-09-12T02:25:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:35 smithi115 ceph-mon[35351]: pgmap v327: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.4 MiB/s wr, 558 op/s 2024-09-12T02:25:35.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:35 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:35.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:35 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:35 smithi136 ceph-mon[35814]: pgmap v327: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.4 MiB/s wr, 558 op/s 2024-09-12T02:25:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:35 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:35 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:35.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:35 smithi110 ceph-mon[30548]: pgmap v327: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.4 MiB/s wr, 558 op/s 2024-09-12T02:25:35.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:35 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:35.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:35 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:36.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:36 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:36.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:36 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:36.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:36 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:36.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:36 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:36.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:36 smithi115 ceph-mon[35351]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-09-12T02:25:36.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:36 smithi115 ceph-mon[35351]: Unable to set osd_memory_target on smithi110 to 185014681: error parsing value: Value '185014681' is below minimum 939524096 2024-09-12T02:25:36.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:36 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:36.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:36 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:36.796 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:36 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:36 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:36 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:36 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:36 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:36 smithi136 ceph-mon[35814]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-09-12T02:25:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:36 smithi136 ceph-mon[35814]: Unable to set osd_memory_target on smithi110 to 185014681: error parsing value: Value '185014681' is below minimum 939524096 2024-09-12T02:25:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:36 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:36 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:36.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:36 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:36 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:36 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:36 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:36 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-12T02:25:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:36 smithi110 ceph-mon[30548]: Adjusting osd_memory_target on smithi110 to 176.4M 2024-09-12T02:25:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:36 smithi110 ceph-mon[30548]: Unable to set osd_memory_target on smithi110 to 185014681: error parsing value: Value '185014681' is below minimum 939524096 2024-09-12T02:25:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:36 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:25:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:36 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:25:36.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:36 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:25:38.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:37 smithi136 ceph-mon[35814]: pgmap v328: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.0 MiB/s wr, 425 op/s 2024-09-12T02:25:38.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:37 smithi110 ceph-mon[30548]: pgmap v328: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.0 MiB/s wr, 425 op/s 2024-09-12T02:25:38.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:37 smithi115 ceph-mon[35351]: pgmap v328: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.0 MiB/s wr, 425 op/s 2024-09-12T02:25:40.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:39 smithi136 ceph-mon[35814]: pgmap v329: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 451 op/s 2024-09-12T02:25:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 615.0 s, 472.0 tps, lat 215.756 ms stddev 266.980 2024-09-12T02:25:40.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:39 smithi110 ceph-mon[30548]: pgmap v329: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 451 op/s 2024-09-12T02:25:40.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:39 smithi115 ceph-mon[35351]: pgmap v329: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 451 op/s 2024-09-12T02:25:42.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:41 smithi136 ceph-mon[35814]: pgmap v330: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 518 op/s 2024-09-12T02:25:42.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:41 smithi110 ceph-mon[30548]: pgmap v330: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 518 op/s 2024-09-12T02:25:42.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:41 smithi115 ceph-mon[35351]: pgmap v330: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 518 op/s 2024-09-12T02:25:44.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:43 smithi136 ceph-mon[35814]: pgmap v331: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 397 op/s 2024-09-12T02:25:44.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:43 smithi110 ceph-mon[30548]: pgmap v331: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 397 op/s 2024-09-12T02:25:44.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:43 smithi115 ceph-mon[35351]: pgmap v331: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 397 op/s 2024-09-12T02:25:45.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 620.0 s, 491.0 tps, lat 200.172 ms stddev 232.761 2024-09-12T02:25:46.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:45 smithi136 ceph-mon[35814]: pgmap v332: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.8 MiB/s wr, 494 op/s 2024-09-12T02:25:46.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:45 smithi110 ceph-mon[30548]: pgmap v332: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.8 MiB/s wr, 494 op/s 2024-09-12T02:25:46.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:45 smithi115 ceph-mon[35351]: pgmap v332: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.8 MiB/s wr, 494 op/s 2024-09-12T02:25:47.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:47 smithi110 ceph-mon[30548]: pgmap v333: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 394 op/s 2024-09-12T02:25:48.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:47 smithi136 ceph-mon[35814]: pgmap v333: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 394 op/s 2024-09-12T02:25:48.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:47 smithi115 ceph-mon[35351]: pgmap v333: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.1 MiB/s wr, 394 op/s 2024-09-12T02:25:50.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:49 smithi136 ceph-mon[35814]: pgmap v334: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.0 MiB/s wr, 429 op/s 2024-09-12T02:25:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 625.0 s, 509.8 tps, lat 203.058 ms stddev 214.632 2024-09-12T02:25:50.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:49 smithi110 ceph-mon[30548]: pgmap v334: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.0 MiB/s wr, 429 op/s 2024-09-12T02:25:50.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:49 smithi115 ceph-mon[35351]: pgmap v334: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.0 MiB/s wr, 429 op/s 2024-09-12T02:25:52.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:51 smithi136 ceph-mon[35814]: pgmap v335: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.1 MiB/s wr, 510 op/s 2024-09-12T02:25:52.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:51 smithi110 ceph-mon[30548]: pgmap v335: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.1 MiB/s wr, 510 op/s 2024-09-12T02:25:52.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:51 smithi115 ceph-mon[35351]: pgmap v335: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.1 MiB/s wr, 510 op/s 2024-09-12T02:25:54.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:53 smithi136 ceph-mon[35814]: pgmap v336: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 418 op/s 2024-09-12T02:25:54.188 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:53 smithi110 ceph-mon[30548]: pgmap v336: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 418 op/s 2024-09-12T02:25:54.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:53 smithi115 ceph-mon[35351]: pgmap v336: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 418 op/s 2024-09-12T02:25:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 630.0 s, 581.4 tps, lat 172.470 ms stddev 202.628 2024-09-12T02:25:56.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:55 smithi136 ceph-mon[35814]: pgmap v337: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.4 MiB/s wr, 522 op/s 2024-09-12T02:25:56.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:55 smithi110 ceph-mon[30548]: pgmap v337: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.4 MiB/s wr, 522 op/s 2024-09-12T02:25:56.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:55 smithi115 ceph-mon[35351]: pgmap v337: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.4 MiB/s wr, 522 op/s 2024-09-12T02:25:58.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:57 smithi110 ceph-mon[30548]: pgmap v338: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 462 op/s 2024-09-12T02:25:58.296 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:57 smithi115 ceph-mon[35351]: pgmap v338: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 462 op/s 2024-09-12T02:25:58.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:57 smithi136 ceph-mon[35814]: pgmap v338: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 462 op/s 2024-09-12T02:26:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 635.0 s, 489.4 tps, lat 200.743 ms stddev 217.251 2024-09-12T02:26:00.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:25:59 smithi110 ceph-mon[30548]: pgmap v339: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.1 MiB/s wr, 479 op/s 2024-09-12T02:26:00.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:25:59 smithi115 ceph-mon[35351]: pgmap v339: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.1 MiB/s wr, 479 op/s 2024-09-12T02:26:00.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:25:59 smithi136 ceph-mon[35814]: pgmap v339: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.1 MiB/s wr, 479 op/s 2024-09-12T02:26:02.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:01 smithi115 ceph-mon[35351]: pgmap v340: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 7.9 MiB/s wr, 561 op/s 2024-09-12T02:26:02.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:01 smithi110 ceph-mon[30548]: pgmap v340: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 7.9 MiB/s wr, 561 op/s 2024-09-12T02:26:02.210 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:01 smithi136 ceph-mon[35814]: pgmap v340: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 7.9 MiB/s wr, 561 op/s 2024-09-12T02:26:04.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:03 smithi115 ceph-mon[35351]: pgmap v341: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.6 MiB/s wr, 460 op/s 2024-09-12T02:26:04.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:03 smithi136 ceph-mon[35814]: pgmap v341: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.6 MiB/s wr, 460 op/s 2024-09-12T02:26:04.439 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:03 smithi110 ceph-mon[30548]: pgmap v341: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.6 MiB/s wr, 460 op/s 2024-09-12T02:26:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 640.0 s, 394.0 tps, lat 253.643 ms stddev 286.862 2024-09-12T02:26:05.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:04 smithi115 ceph-mon[35351]: osdmap e107: 12 total, 12 up, 12 in 2024-09-12T02:26:05.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:04 smithi136 ceph-mon[35814]: osdmap e107: 12 total, 12 up, 12 in 2024-09-12T02:26:05.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:04 smithi110 ceph-mon[30548]: osdmap e107: 12 total, 12 up, 12 in 2024-09-12T02:26:06.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:05 smithi115 ceph-mon[35351]: pgmap v343: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.1 MiB/s wr, 510 op/s 2024-09-12T02:26:06.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:05 smithi136 ceph-mon[35814]: pgmap v343: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.1 MiB/s wr, 510 op/s 2024-09-12T02:26:06.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:05 smithi110 ceph-mon[30548]: pgmap v343: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.1 MiB/s wr, 510 op/s 2024-09-12T02:26:08.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:07 smithi115 ceph-mon[35351]: pgmap v344: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 6.5 MiB/s wr, 494 op/s 2024-09-12T02:26:08.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:07 smithi136 ceph-mon[35814]: pgmap v344: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 6.5 MiB/s wr, 494 op/s 2024-09-12T02:26:08.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:07 smithi110 ceph-mon[30548]: pgmap v344: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 6.5 MiB/s wr, 494 op/s 2024-09-12T02:26:10.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 645.0 s, 498.2 tps, lat 202.368 ms stddev 247.547 2024-09-12T02:26:10.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:09 smithi115 ceph-mon[35351]: pgmap v345: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 6.0 MiB/s wr, 479 op/s 2024-09-12T02:26:10.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:09 smithi136 ceph-mon[35814]: pgmap v345: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 6.0 MiB/s wr, 479 op/s 2024-09-12T02:26:10.438 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:09 smithi110 ceph-mon[30548]: pgmap v345: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 6.0 MiB/s wr, 479 op/s 2024-09-12T02:26:12.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:12 smithi115 ceph-mon[35351]: pgmap v346: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.3 MiB/s wr, 467 op/s 2024-09-12T02:26:12.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:12 smithi136 ceph-mon[35814]: pgmap v346: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.3 MiB/s wr, 467 op/s 2024-09-12T02:26:12.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:12 smithi110 ceph-mon[30548]: pgmap v346: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 6.3 MiB/s wr, 467 op/s 2024-09-12T02:26:14.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:14 smithi115 ceph-mon[35351]: pgmap v347: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.9 MiB/s wr, 460 op/s 2024-09-12T02:26:14.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:14 smithi136 ceph-mon[35814]: pgmap v347: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.9 MiB/s wr, 460 op/s 2024-09-12T02:26:14.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:14 smithi110 ceph-mon[30548]: pgmap v347: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 5.9 MiB/s wr, 460 op/s 2024-09-12T02:26:15.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 650.0 s, 407.2 tps, lat 245.897 ms stddev 309.931 2024-09-12T02:26:15.408 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:15 smithi136 ceph-mon[35814]: pgmap v348: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.5 MiB/s wr, 432 op/s 2024-09-12T02:26:15.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:15 smithi110 ceph-mon[30548]: pgmap v348: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.5 MiB/s wr, 432 op/s 2024-09-12T02:26:15.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:15 smithi115 ceph-mon[35351]: pgmap v348: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.5 MiB/s wr, 432 op/s 2024-09-12T02:26:16.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:16 smithi110 ceph-mon[30548]: osdmap e108: 12 total, 12 up, 12 in 2024-09-12T02:26:16.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:16 smithi115 ceph-mon[35351]: osdmap e108: 12 total, 12 up, 12 in 2024-09-12T02:26:16.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:16 smithi136 ceph-mon[35814]: osdmap e108: 12 total, 12 up, 12 in 2024-09-12T02:26:17.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:17 smithi110 ceph-mon[30548]: pgmap v350: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 428 op/s 2024-09-12T02:26:17.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:17 smithi115 ceph-mon[35351]: pgmap v350: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 428 op/s 2024-09-12T02:26:17.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:17 smithi136 ceph-mon[35814]: pgmap v350: 129 pgs: 129 active+clean; 2.8 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 428 op/s 2024-09-12T02:26:19.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:19 smithi115 ceph-mon[35351]: pgmap v351: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.9 MiB/s wr, 443 op/s 2024-09-12T02:26:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:19 smithi136 ceph-mon[35814]: pgmap v351: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.9 MiB/s wr, 443 op/s 2024-09-12T02:26:19.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:19 smithi110 ceph-mon[30548]: pgmap v351: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.9 MiB/s wr, 443 op/s 2024-09-12T02:26:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 655.0 s, 440.6 tps, lat 230.887 ms stddev 298.600 2024-09-12T02:26:21.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:21 smithi115 ceph-mon[35351]: pgmap v352: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 5.4 MiB/s wr, 435 op/s 2024-09-12T02:26:21.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:21 smithi136 ceph-mon[35814]: pgmap v352: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 5.4 MiB/s wr, 435 op/s 2024-09-12T02:26:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:21 smithi110 ceph-mon[30548]: pgmap v352: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 5.4 MiB/s wr, 435 op/s 2024-09-12T02:26:23.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:23 smithi115 ceph-mon[35351]: pgmap v353: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 5.8 MiB/s wr, 441 op/s 2024-09-12T02:26:23.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:23 smithi136 ceph-mon[35814]: pgmap v353: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 5.8 MiB/s wr, 441 op/s 2024-09-12T02:26:23.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:23 smithi110 ceph-mon[30548]: pgmap v353: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 5.8 MiB/s wr, 441 op/s 2024-09-12T02:26:25.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 660.0 s, 439.8 tps, lat 218.350 ms stddev 261.930 2024-09-12T02:26:25.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:25 smithi115 ceph-mon[35351]: pgmap v354: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 6.4 MiB/s wr, 447 op/s 2024-09-12T02:26:25.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:25 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:26:25.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:25 smithi136 ceph-mon[35814]: pgmap v354: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 6.4 MiB/s wr, 447 op/s 2024-09-12T02:26:25.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:25 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:26:25.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:25 smithi110 ceph-mon[30548]: pgmap v354: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 6.4 MiB/s wr, 447 op/s 2024-09-12T02:26:25.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:25 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:26:27.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:27 smithi115 ceph-mon[35351]: pgmap v355: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 6.3 MiB/s wr, 430 op/s 2024-09-12T02:26:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:27 smithi136 ceph-mon[35814]: pgmap v355: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 6.3 MiB/s wr, 430 op/s 2024-09-12T02:26:27.943 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:27 smithi110 ceph-mon[30548]: pgmap v355: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 6.3 MiB/s wr, 430 op/s 2024-09-12T02:26:29.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:29 smithi115 ceph-mon[35351]: pgmap v356: 129 pgs: 129 active+clean; 2.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 6.9 MiB/s wr, 452 op/s 2024-09-12T02:26:29.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:29 smithi136 ceph-mon[35814]: pgmap v356: 129 pgs: 129 active+clean; 2.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 6.9 MiB/s wr, 452 op/s 2024-09-12T02:26:29.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:29 smithi110 ceph-mon[30548]: pgmap v356: 129 pgs: 129 active+clean; 2.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 6.9 MiB/s wr, 452 op/s 2024-09-12T02:26:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 665.0 s, 527.6 tps, lat 187.924 ms stddev 229.776 2024-09-12T02:26:31.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:31 smithi115 ceph-mon[35351]: pgmap v357: 129 pgs: 129 active+clean; 2.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 7.1 MiB/s wr, 519 op/s 2024-09-12T02:26:31.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:31 smithi136 ceph-mon[35814]: pgmap v357: 129 pgs: 129 active+clean; 2.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 7.1 MiB/s wr, 519 op/s 2024-09-12T02:26:31.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:31 smithi110 ceph-mon[30548]: pgmap v357: 129 pgs: 129 active+clean; 2.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 7.1 MiB/s wr, 519 op/s 2024-09-12T02:26:33.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:33 smithi115 ceph-mon[35351]: pgmap v358: 129 pgs: 129 active+clean; 2.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 5.9 MiB/s wr, 424 op/s 2024-09-12T02:26:33.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:33 smithi136 ceph-mon[35814]: pgmap v358: 129 pgs: 129 active+clean; 2.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 5.9 MiB/s wr, 424 op/s 2024-09-12T02:26:33.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:33 smithi110 ceph-mon[30548]: pgmap v358: 129 pgs: 129 active+clean; 2.9 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 5.9 MiB/s wr, 424 op/s 2024-09-12T02:26:35.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 670.0 s, 553.2 tps, lat 188.167 ms stddev 236.362 2024-09-12T02:26:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:35 smithi115 ceph-mon[35351]: pgmap v359: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 6.9 MiB/s wr, 527 op/s 2024-09-12T02:26:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:35 smithi136 ceph-mon[35814]: pgmap v359: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 6.9 MiB/s wr, 527 op/s 2024-09-12T02:26:35.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:35 smithi110 ceph-mon[30548]: pgmap v359: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 6.9 MiB/s wr, 527 op/s 2024-09-12T02:26:36.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:36 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:36.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:36 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:36.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:36 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:37.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:37 smithi136 ceph-mon[35814]: pgmap v360: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 6.0 MiB/s wr, 473 op/s 2024-09-12T02:26:37.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:37 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:26:37.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:37 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:26:37.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:37 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:37.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:37 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:37.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:37 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:26:37.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:37 smithi110 ceph-mon[30548]: pgmap v360: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 6.0 MiB/s wr, 473 op/s 2024-09-12T02:26:37.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:37 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:26:37.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:37 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:26:37.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:37 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:37.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:37 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:37.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:37 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:26:38.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:37 smithi115 ceph-mon[35351]: pgmap v360: 129 pgs: 129 active+clean; 3.0 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 6.0 MiB/s wr, 473 op/s 2024-09-12T02:26:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:37 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:26:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:37 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:26:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:37 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:37 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:38.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:37 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:26:39.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:39 smithi136 ceph-mon[35814]: pgmap v361: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.1 MiB/s wr, 473 op/s 2024-09-12T02:26:39.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:39 smithi110 ceph-mon[30548]: pgmap v361: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.1 MiB/s wr, 473 op/s 2024-09-12T02:26:40.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:39 smithi115 ceph-mon[35351]: pgmap v361: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.1 MiB/s wr, 473 op/s 2024-09-12T02:26:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 675.0 s, 452.0 tps, lat 220.341 ms stddev 283.033 2024-09-12T02:26:41.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:41 smithi136 ceph-mon[35814]: pgmap v362: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.3 MiB/s wr, 544 op/s 2024-09-12T02:26:41.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:41 smithi110 ceph-mon[30548]: pgmap v362: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.3 MiB/s wr, 544 op/s 2024-09-12T02:26:42.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:41 smithi115 ceph-mon[35351]: pgmap v362: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 6.3 MiB/s wr, 544 op/s 2024-09-12T02:26:43.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:43 smithi136 ceph-mon[35814]: pgmap v363: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.4 MiB/s wr, 429 op/s 2024-09-12T02:26:44.008 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:43 smithi110 ceph-mon[30548]: pgmap v363: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.4 MiB/s wr, 429 op/s 2024-09-12T02:26:44.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:43 smithi115 ceph-mon[35351]: pgmap v363: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.4 MiB/s wr, 429 op/s 2024-09-12T02:26:45.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 680.0 s, 476.0 tps, lat 207.866 ms stddev 237.906 2024-09-12T02:26:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:45 smithi110 ceph-mon[30548]: pgmap v364: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.1 MiB/s wr, 520 op/s 2024-09-12T02:26:46.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:45 smithi115 ceph-mon[35351]: pgmap v364: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.1 MiB/s wr, 520 op/s 2024-09-12T02:26:46.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:45 smithi136 ceph-mon[35814]: pgmap v364: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.1 MiB/s wr, 520 op/s 2024-09-12T02:26:47.946 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:47 smithi110 ceph-mon[30548]: pgmap v365: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.4 MiB/s wr, 440 op/s 2024-09-12T02:26:48.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:47 smithi115 ceph-mon[35351]: pgmap v365: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.4 MiB/s wr, 440 op/s 2024-09-12T02:26:48.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:47 smithi136 ceph-mon[35814]: pgmap v365: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.4 MiB/s wr, 440 op/s 2024-09-12T02:26:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:49 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:26:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:49 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:26:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:49 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:26:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:49 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:49 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:49 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:49 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:26:50.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:49 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:26:50.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:49 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:26:50.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:49 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:26:50.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:49 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:50.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:49 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:50.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:49 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:50.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:49 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:26:50.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:49 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-12T02:26:50.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:49 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-12T02:26:50.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:49 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-12T02:26:50.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:49 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:26:50.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:49 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:26:50.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:49 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:26:50.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:49 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:26:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 685.0 s, 473.2 tps, lat 203.213 ms stddev 249.448 2024-09-12T02:26:53.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:53 smithi136 ceph-mon[35814]: pgmap v367: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.2 MiB/s wr, 528 op/s 2024-09-12T02:26:53.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:53 smithi136 ceph-mon[35814]: pgmap v368: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.2 MiB/s wr, 404 op/s 2024-09-12T02:26:53.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:53 smithi110 ceph-mon[30548]: pgmap v367: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.2 MiB/s wr, 528 op/s 2024-09-12T02:26:53.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:53 smithi110 ceph-mon[30548]: pgmap v368: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.2 MiB/s wr, 404 op/s 2024-09-12T02:26:54.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:53 smithi115 ceph-mon[35351]: pgmap v367: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.2 MiB/s wr, 528 op/s 2024-09-12T02:26:54.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:53 smithi115 ceph-mon[35351]: pgmap v368: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.2 MiB/s wr, 404 op/s 2024-09-12T02:26:54.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:54 smithi136 ceph-mon[35814]: pgmap v369: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.8 MiB/s wr, 523 op/s 2024-09-12T02:26:54.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:54 smithi110 ceph-mon[30548]: pgmap v369: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.8 MiB/s wr, 523 op/s 2024-09-12T02:26:55.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:54 smithi115 ceph-mon[35351]: pgmap v369: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.8 MiB/s wr, 523 op/s 2024-09-12T02:26:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 690.0 s, 495.2 tps, lat 207.873 ms stddev 244.928 2024-09-12T02:26:57.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:57 smithi110 ceph-mon[30548]: pgmap v370: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.9 MiB/s wr, 465 op/s 2024-09-12T02:26:57.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:57 smithi115 ceph-mon[35351]: pgmap v370: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.9 MiB/s wr, 465 op/s 2024-09-12T02:26:57.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:57 smithi136 ceph-mon[35814]: pgmap v370: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.9 MiB/s wr, 465 op/s 2024-09-12T02:26:59.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:26:59 smithi115 ceph-mon[35351]: pgmap v371: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.2 MiB/s wr, 454 op/s 2024-09-12T02:26:59.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:26:59 smithi136 ceph-mon[35814]: pgmap v371: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.2 MiB/s wr, 454 op/s 2024-09-12T02:26:59.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:26:59 smithi110 ceph-mon[30548]: pgmap v371: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.2 MiB/s wr, 454 op/s 2024-09-12T02:27:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 695.0 s, 508.6 tps, lat 199.271 ms stddev 223.823 2024-09-12T02:27:01.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:01 smithi115 ceph-mon[35351]: pgmap v372: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.6 MiB/s wr, 570 op/s 2024-09-12T02:27:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:01 smithi136 ceph-mon[35814]: pgmap v372: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.6 MiB/s wr, 570 op/s 2024-09-12T02:27:01.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:01 smithi110 ceph-mon[30548]: pgmap v372: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 6.6 MiB/s wr, 570 op/s 2024-09-12T02:27:03.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:03 smithi115 ceph-mon[35351]: pgmap v373: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.1 MiB/s wr, 431 op/s 2024-09-12T02:27:03.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:03 smithi136 ceph-mon[35814]: pgmap v373: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.1 MiB/s wr, 431 op/s 2024-09-12T02:27:03.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:03 smithi110 ceph-mon[30548]: pgmap v373: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 5.1 MiB/s wr, 431 op/s 2024-09-12T02:27:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 700.0 s, 398.0 tps, lat 238.545 ms stddev 256.226 2024-09-12T02:27:05.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:05 smithi115 ceph-mon[35351]: pgmap v374: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.8 MiB/s wr, 551 op/s 2024-09-12T02:27:05.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:05 smithi115 ceph-mon[35351]: osdmap e109: 12 total, 12 up, 12 in 2024-09-12T02:27:05.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:05 smithi136 ceph-mon[35814]: pgmap v374: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.8 MiB/s wr, 551 op/s 2024-09-12T02:27:05.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:05 smithi136 ceph-mon[35814]: osdmap e109: 12 total, 12 up, 12 in 2024-09-12T02:27:05.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:05 smithi110 ceph-mon[30548]: pgmap v374: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.8 MiB/s wr, 551 op/s 2024-09-12T02:27:05.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:05 smithi110 ceph-mon[30548]: osdmap e109: 12 total, 12 up, 12 in 2024-09-12T02:27:07.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:07 smithi115 ceph-mon[35351]: pgmap v376: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 4.9 MiB/s wr, 479 op/s 2024-09-12T02:27:07.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:07 smithi136 ceph-mon[35814]: pgmap v376: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 4.9 MiB/s wr, 479 op/s 2024-09-12T02:27:07.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:07 smithi110 ceph-mon[30548]: pgmap v376: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 4.9 MiB/s wr, 479 op/s 2024-09-12T02:27:09.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:09 smithi115 ceph-mon[35351]: pgmap v377: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.2 MiB/s wr, 479 op/s 2024-09-12T02:27:09.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:09 smithi136 ceph-mon[35814]: pgmap v377: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.2 MiB/s wr, 479 op/s 2024-09-12T02:27:09.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:09 smithi110 ceph-mon[30548]: pgmap v377: 129 pgs: 4 active+clean+snaptrim, 13 active+clean+snaptrim_wait, 112 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.2 MiB/s wr, 479 op/s 2024-09-12T02:27:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 705.0 s, 526.6 tps, lat 196.180 ms stddev 273.190 2024-09-12T02:27:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:11 smithi115 ceph-mon[35351]: pgmap v378: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 5.4 MiB/s wr, 464 op/s 2024-09-12T02:27:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:11 smithi115 ceph-mon[35351]: osdmap e110: 12 total, 12 up, 12 in 2024-09-12T02:27:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:11 smithi136 ceph-mon[35814]: pgmap v378: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 5.4 MiB/s wr, 464 op/s 2024-09-12T02:27:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:11 smithi136 ceph-mon[35814]: osdmap e110: 12 total, 12 up, 12 in 2024-09-12T02:27:11.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:11 smithi110 ceph-mon[30548]: pgmap v378: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 5.4 MiB/s wr, 464 op/s 2024-09-12T02:27:11.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:11 smithi110 ceph-mon[30548]: osdmap e110: 12 total, 12 up, 12 in 2024-09-12T02:27:13.740 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:13 smithi110 ceph-mon[30548]: pgmap v380: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 4.5 MiB/s wr, 368 op/s 2024-09-12T02:27:13.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:13 smithi115 ceph-mon[35351]: pgmap v380: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 4.5 MiB/s wr, 368 op/s 2024-09-12T02:27:13.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:13 smithi136 ceph-mon[35814]: pgmap v380: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 4.5 MiB/s wr, 368 op/s 2024-09-12T02:27:15.174 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 710.0 s, 501.2 tps, lat 199.756 ms stddev 233.172 2024-09-12T02:27:15.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:15 smithi115 ceph-mon[35351]: pgmap v381: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 5.4 MiB/s wr, 475 op/s 2024-09-12T02:27:15.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:15 smithi136 ceph-mon[35814]: pgmap v381: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 5.4 MiB/s wr, 475 op/s 2024-09-12T02:27:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:15 smithi110 ceph-mon[30548]: pgmap v381: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 5.4 MiB/s wr, 475 op/s 2024-09-12T02:27:17.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:17 smithi115 ceph-mon[35351]: pgmap v382: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 5.8 MiB/s wr, 487 op/s 2024-09-12T02:27:17.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:17 smithi136 ceph-mon[35814]: pgmap v382: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 5.8 MiB/s wr, 487 op/s 2024-09-12T02:27:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:17 smithi110 ceph-mon[30548]: pgmap v382: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 5.8 MiB/s wr, 487 op/s 2024-09-12T02:27:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:19 smithi115 ceph-mon[35351]: pgmap v383: 129 pgs: 129 active+clean; 2.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 5.2 MiB/s wr, 467 op/s 2024-09-12T02:27:19.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:19 smithi136 ceph-mon[35814]: pgmap v383: 129 pgs: 129 active+clean; 2.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 5.2 MiB/s wr, 467 op/s 2024-09-12T02:27:19.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:19 smithi110 ceph-mon[30548]: pgmap v383: 129 pgs: 129 active+clean; 2.9 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 5.2 MiB/s wr, 467 op/s 2024-09-12T02:27:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 715.0 s, 429.2 tps, lat 235.350 ms stddev 257.666 2024-09-12T02:27:21.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:21 smithi115 ceph-mon[35351]: pgmap v384: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 5.1 MiB/s wr, 497 op/s 2024-09-12T02:27:21.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:21 smithi136 ceph-mon[35814]: pgmap v384: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 5.1 MiB/s wr, 497 op/s 2024-09-12T02:27:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:21 smithi110 ceph-mon[30548]: pgmap v384: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 5.1 MiB/s wr, 497 op/s 2024-09-12T02:27:23.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:23 smithi115 ceph-mon[35351]: pgmap v385: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.5 MiB/s wr, 435 op/s 2024-09-12T02:27:23.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:23 smithi136 ceph-mon[35814]: pgmap v385: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.5 MiB/s wr, 435 op/s 2024-09-12T02:27:23.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:23 smithi110 ceph-mon[30548]: pgmap v385: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.5 MiB/s wr, 435 op/s 2024-09-12T02:27:25.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 720.0 s, 653.8 tps, lat 153.600 ms stddev 214.323 2024-09-12T02:27:25.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:25 smithi115 ceph-mon[35351]: pgmap v386: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 6.2 MiB/s wr, 565 op/s 2024-09-12T02:27:25.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:25 smithi136 ceph-mon[35814]: pgmap v386: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 6.2 MiB/s wr, 565 op/s 2024-09-12T02:27:25.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:25 smithi110 ceph-mon[30548]: pgmap v386: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 6.2 MiB/s wr, 565 op/s 2024-09-12T02:27:27.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:27 smithi115 ceph-mon[35351]: pgmap v387: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.1 MiB/s wr, 468 op/s 2024-09-12T02:27:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:27 smithi136 ceph-mon[35814]: pgmap v387: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.1 MiB/s wr, 468 op/s 2024-09-12T02:27:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:27 smithi110 ceph-mon[30548]: pgmap v387: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.1 MiB/s wr, 468 op/s 2024-09-12T02:27:29.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:29 smithi115 ceph-mon[35351]: pgmap v388: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 4.7 MiB/s wr, 442 op/s 2024-09-12T02:27:29.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:29 smithi136 ceph-mon[35814]: pgmap v388: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 4.7 MiB/s wr, 442 op/s 2024-09-12T02:27:29.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:29 smithi110 ceph-mon[30548]: pgmap v388: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 4.7 MiB/s wr, 442 op/s 2024-09-12T02:27:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 725.0 s, 627.6 tps, lat 155.293 ms stddev 202.267 2024-09-12T02:27:31.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:31 smithi136 ceph-mon[35814]: pgmap v389: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.8 MiB/s wr, 609 op/s 2024-09-12T02:27:31.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:31 smithi110 ceph-mon[30548]: pgmap v389: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.8 MiB/s wr, 609 op/s 2024-09-12T02:27:32.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:31 smithi115 ceph-mon[35351]: pgmap v389: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.8 MiB/s wr, 609 op/s 2024-09-12T02:27:33.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:33 smithi136 ceph-mon[35814]: pgmap v390: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 5.1 MiB/s wr, 446 op/s 2024-09-12T02:27:33.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:33 smithi110 ceph-mon[30548]: pgmap v390: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 5.1 MiB/s wr, 446 op/s 2024-09-12T02:27:34.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:33 smithi115 ceph-mon[35351]: pgmap v390: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 5.1 MiB/s wr, 446 op/s 2024-09-12T02:27:34.809 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:34 smithi110 ceph-mon[30548]: pgmap v391: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.8 MiB/s wr, 606 op/s 2024-09-12T02:27:34.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:34 smithi136 ceph-mon[35814]: pgmap v391: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.8 MiB/s wr, 606 op/s 2024-09-12T02:27:35.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:34 smithi115 ceph-mon[35351]: pgmap v391: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.8 MiB/s wr, 606 op/s 2024-09-12T02:27:35.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 730.0 s, 484.6 tps, lat 206.282 ms stddev 279.295 2024-09-12T02:27:37.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:37 smithi110 ceph-mon[30548]: pgmap v392: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 5.3 MiB/s wr, 526 op/s 2024-09-12T02:27:37.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:37 smithi115 ceph-mon[35351]: pgmap v392: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 5.3 MiB/s wr, 526 op/s 2024-09-12T02:27:37.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:37 smithi136 ceph-mon[35814]: pgmap v392: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 5.3 MiB/s wr, 526 op/s 2024-09-12T02:27:39.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:39 smithi115 ceph-mon[35351]: pgmap v393: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.3 MiB/s wr, 517 op/s 2024-09-12T02:27:39.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:39 smithi136 ceph-mon[35814]: pgmap v393: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.3 MiB/s wr, 517 op/s 2024-09-12T02:27:39.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:39 smithi110 ceph-mon[30548]: pgmap v393: 129 pgs: 129 active+clean; 3.0 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 5.3 MiB/s wr, 517 op/s 2024-09-12T02:27:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 735.0 s, 482.6 tps, lat 216.796 ms stddev 329.386 2024-09-12T02:27:41.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:41 smithi115 ceph-mon[35351]: pgmap v394: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 7.3 MiB/s wr, 694 op/s 2024-09-12T02:27:41.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:41 smithi136 ceph-mon[35814]: pgmap v394: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 7.3 MiB/s wr, 694 op/s 2024-09-12T02:27:41.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:41 smithi110 ceph-mon[30548]: pgmap v394: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 7.3 MiB/s wr, 694 op/s 2024-09-12T02:27:43.489 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:43 smithi110 ceph-mon[30548]: pgmap v395: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.1 MiB/s wr, 510 op/s 2024-09-12T02:27:43.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:43 smithi115 ceph-mon[35351]: pgmap v395: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.1 MiB/s wr, 510 op/s 2024-09-12T02:27:43.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:43 smithi136 ceph-mon[35814]: pgmap v395: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.1 MiB/s wr, 510 op/s 2024-09-12T02:27:44.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:44 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:27:44.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:44 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:27:44.690 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:44 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:27:45.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 740.0 s, 498.8 tps, lat 196.815 ms stddev 212.142 2024-09-12T02:27:45.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:45 smithi115 ceph-mon[35351]: pgmap v396: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 6.5 MiB/s wr, 630 op/s 2024-09-12T02:27:45.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:45 smithi136 ceph-mon[35814]: pgmap v396: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 6.5 MiB/s wr, 630 op/s 2024-09-12T02:27:45.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:45 smithi110 ceph-mon[30548]: pgmap v396: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 6.5 MiB/s wr, 630 op/s 2024-09-12T02:27:47.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:47 smithi115 ceph-mon[35351]: pgmap v397: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 5.2 MiB/s wr, 525 op/s 2024-09-12T02:27:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:47 smithi136 ceph-mon[35814]: pgmap v397: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 5.2 MiB/s wr, 525 op/s 2024-09-12T02:27:47.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:47 smithi110 ceph-mon[30548]: pgmap v397: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 5.2 MiB/s wr, 525 op/s 2024-09-12T02:27:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:49 smithi115 ceph-mon[35351]: pgmap v398: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 4.9 MiB/s wr, 480 op/s 2024-09-12T02:27:49.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:49 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:49 smithi136 ceph-mon[35814]: pgmap v398: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 4.9 MiB/s wr, 480 op/s 2024-09-12T02:27:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:49 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:49.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:49 smithi110 ceph-mon[30548]: pgmap v398: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 4.9 MiB/s wr, 480 op/s 2024-09-12T02:27:49.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:49 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:27:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 745.0 s, 464.4 tps, lat 211.593 ms stddev 224.538 2024-09-12T02:27:51.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:51 smithi115 ceph-mon[35351]: pgmap v399: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 6.4 MiB/s wr, 615 op/s 2024-09-12T02:27:51.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:51 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:51.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:51 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:51.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:51 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:27:51.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:51 smithi136 ceph-mon[35814]: pgmap v399: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 6.4 MiB/s wr, 615 op/s 2024-09-12T02:27:51.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:51 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:51.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:51 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:51.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:51 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:27:51.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:51 smithi110 ceph-mon[30548]: pgmap v399: 129 pgs: 129 active+clean; 3.1 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 6.4 MiB/s wr, 615 op/s 2024-09-12T02:27:51.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:51 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:27:51.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:51 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:27:51.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:51 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:27:53.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:53 smithi115 ceph-mon[35351]: pgmap v400: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 4.2 MiB/s wr, 415 op/s 2024-09-12T02:27:53.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:53 smithi136 ceph-mon[35814]: pgmap v400: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 4.2 MiB/s wr, 415 op/s 2024-09-12T02:27:53.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:53 smithi110 ceph-mon[30548]: pgmap v400: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 4.2 MiB/s wr, 415 op/s 2024-09-12T02:27:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 750.0 s, 502.8 tps, lat 198.476 ms stddev 224.102 2024-09-12T02:27:55.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:55 smithi115 ceph-mon[35351]: pgmap v401: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 5.5 MiB/s wr, 530 op/s 2024-09-12T02:27:55.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:55 smithi136 ceph-mon[35814]: pgmap v401: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 5.5 MiB/s wr, 530 op/s 2024-09-12T02:27:55.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:55 smithi110 ceph-mon[30548]: pgmap v401: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 5.5 MiB/s wr, 530 op/s 2024-09-12T02:27:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:57 smithi115 ceph-mon[35351]: pgmap v402: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 4.4 MiB/s wr, 459 op/s 2024-09-12T02:27:57.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:57 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:27:57.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:57 smithi136 ceph-mon[35814]: pgmap v402: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 4.4 MiB/s wr, 459 op/s 2024-09-12T02:27:57.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:57 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:27:57.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:57 smithi110 ceph-mon[30548]: pgmap v402: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 4.4 MiB/s wr, 459 op/s 2024-09-12T02:27:57.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:57 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:27:58.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:58 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:27:58.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:58 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:27:59.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:58 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:27:59.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:27:59 smithi136 ceph-mon[35814]: pgmap v403: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 4.4 MiB/s wr, 428 op/s 2024-09-12T02:27:59.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:27:59 smithi110 ceph-mon[30548]: pgmap v403: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 4.4 MiB/s wr, 428 op/s 2024-09-12T02:28:00.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:27:59 smithi115 ceph-mon[35351]: pgmap v403: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 4.4 MiB/s wr, 428 op/s 2024-09-12T02:28:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 755.0 s, 468.2 tps, lat 215.107 ms stddev 260.784 2024-09-12T02:28:01.846 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:01 smithi115 ceph-mon[35351]: pgmap v404: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 5.7 MiB/s wr, 561 op/s 2024-09-12T02:28:01.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:01 smithi136 ceph-mon[35814]: pgmap v404: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 5.7 MiB/s wr, 561 op/s 2024-09-12T02:28:01.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:01 smithi110 ceph-mon[30548]: pgmap v404: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 5.7 MiB/s wr, 561 op/s 2024-09-12T02:28:02.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:02 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:28:02.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:02 smithi136 ceph-mon[35814]: pgmap v405: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 3.9 MiB/s wr, 386 op/s 2024-09-12T02:28:02.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:02 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:28:02.940 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:02 smithi110 ceph-mon[30548]: pgmap v405: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 3.9 MiB/s wr, 386 op/s 2024-09-12T02:28:03.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:02 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:28:03.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:02 smithi115 ceph-mon[35351]: pgmap v405: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 3.9 MiB/s wr, 386 op/s 2024-09-12T02:28:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 760.0 s, 467.8 tps, lat 213.008 ms stddev 233.040 2024-09-12T02:28:05.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:05 smithi115 ceph-mon[35351]: pgmap v406: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 5.2 MiB/s wr, 511 op/s 2024-09-12T02:28:05.610 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:05 smithi136 ceph-mon[35814]: pgmap v406: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 5.2 MiB/s wr, 511 op/s 2024-09-12T02:28:05.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:05 smithi110 ceph-mon[30548]: pgmap v406: 129 pgs: 129 active+clean; 3.2 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 5.2 MiB/s wr, 511 op/s 2024-09-12T02:28:07.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:07 smithi115 ceph-mon[35351]: pgmap v407: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 4.4 MiB/s wr, 464 op/s 2024-09-12T02:28:07.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:07 smithi136 ceph-mon[35814]: pgmap v407: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 4.4 MiB/s wr, 464 op/s 2024-09-12T02:28:07.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:07 smithi110 ceph-mon[30548]: pgmap v407: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 4.4 MiB/s wr, 464 op/s 2024-09-12T02:28:09.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:09 smithi115 ceph-mon[35351]: pgmap v408: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 4.1 MiB/s wr, 418 op/s 2024-09-12T02:28:09.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:09 smithi136 ceph-mon[35814]: pgmap v408: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 4.1 MiB/s wr, 418 op/s 2024-09-12T02:28:09.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:09 smithi110 ceph-mon[30548]: pgmap v408: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 4.1 MiB/s wr, 418 op/s 2024-09-12T02:28:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 765.0 s, 370.4 tps, lat 235.611 ms stddev 307.478 2024-09-12T02:28:10.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:10 smithi115 ceph-mon[35351]: osdmap e111: 12 total, 12 up, 12 in 2024-09-12T02:28:10.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:10 smithi136 ceph-mon[35814]: osdmap e111: 12 total, 12 up, 12 in 2024-09-12T02:28:10.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:10 smithi110 ceph-mon[30548]: osdmap e111: 12 total, 12 up, 12 in 2024-09-12T02:28:11.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:11 smithi115 ceph-mon[35351]: pgmap v410: 129 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 109 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 4.7 MiB/s wr, 493 op/s 2024-09-12T02:28:11.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:11 smithi136 ceph-mon[35814]: pgmap v410: 129 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 109 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 4.7 MiB/s wr, 493 op/s 2024-09-12T02:28:11.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:11 smithi110 ceph-mon[30548]: pgmap v410: 129 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 109 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 4.7 MiB/s wr, 493 op/s 2024-09-12T02:28:13.494 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:13 smithi110 ceph-mon[30548]: pgmap v411: 129 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 109 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 4.7 MiB/s wr, 493 op/s 2024-09-12T02:28:13.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:13 smithi115 ceph-mon[35351]: pgmap v411: 129 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 109 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 4.7 MiB/s wr, 493 op/s 2024-09-12T02:28:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:13 smithi136 ceph-mon[35814]: pgmap v411: 129 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 109 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 4.7 MiB/s wr, 493 op/s 2024-09-12T02:28:15.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 770.0 s, 442.2 tps, lat 256.065 ms stddev 421.912 2024-09-12T02:28:15.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:15 smithi115 ceph-mon[35351]: pgmap v412: 129 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 109 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.2 MiB/s wr, 454 op/s 2024-09-12T02:28:15.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:15 smithi136 ceph-mon[35814]: pgmap v412: 129 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 109 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.2 MiB/s wr, 454 op/s 2024-09-12T02:28:15.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:15 smithi110 ceph-mon[30548]: pgmap v412: 129 pgs: 6 active+clean+snaptrim, 14 active+clean+snaptrim_wait, 109 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.2 MiB/s wr, 454 op/s 2024-09-12T02:28:17.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:17 smithi115 ceph-mon[35351]: pgmap v413: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 4.4 MiB/s wr, 432 op/s 2024-09-12T02:28:17.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:17 smithi136 ceph-mon[35814]: pgmap v413: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 4.4 MiB/s wr, 432 op/s 2024-09-12T02:28:17.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:17 smithi110 ceph-mon[30548]: pgmap v413: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 4.4 MiB/s wr, 432 op/s 2024-09-12T02:28:19.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:19 smithi115 ceph-mon[35351]: pgmap v414: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 4.3 MiB/s wr, 428 op/s 2024-09-12T02:28:19.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:19 smithi136 ceph-mon[35814]: pgmap v414: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 4.3 MiB/s wr, 428 op/s 2024-09-12T02:28:19.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:19 smithi110 ceph-mon[30548]: pgmap v414: 129 pgs: 129 active+clean; 2.9 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 4.3 MiB/s wr, 428 op/s 2024-09-12T02:28:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 775.0 s, 478.6 tps, lat 208.446 ms stddev 234.171 2024-09-12T02:28:21.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:21 smithi115 ceph-mon[35351]: pgmap v415: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 4.3 MiB/s wr, 448 op/s 2024-09-12T02:28:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:21 smithi115 ceph-mon[35351]: osdmap e112: 12 total, 12 up, 12 in 2024-09-12T02:28:21.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:21 smithi136 ceph-mon[35814]: pgmap v415: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 4.3 MiB/s wr, 448 op/s 2024-09-12T02:28:21.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:21 smithi136 ceph-mon[35814]: osdmap e112: 12 total, 12 up, 12 in 2024-09-12T02:28:21.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:21 smithi110 ceph-mon[30548]: pgmap v415: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 4.3 MiB/s wr, 448 op/s 2024-09-12T02:28:21.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:21 smithi110 ceph-mon[30548]: osdmap e112: 12 total, 12 up, 12 in 2024-09-12T02:28:23.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:23 smithi115 ceph-mon[35351]: pgmap v417: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 4.1 MiB/s wr, 418 op/s 2024-09-12T02:28:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:23 smithi136 ceph-mon[35814]: pgmap v417: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 4.1 MiB/s wr, 418 op/s 2024-09-12T02:28:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:23 smithi110 ceph-mon[30548]: pgmap v417: 129 pgs: 129 active+clean; 2.9 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 4.1 MiB/s wr, 418 op/s 2024-09-12T02:28:25.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 780.0 s, 477.2 tps, lat 213.879 ms stddev 271.102 2024-09-12T02:28:25.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:25 smithi115 ceph-mon[35351]: pgmap v418: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 4.7 MiB/s wr, 459 op/s 2024-09-12T02:28:25.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:25 smithi136 ceph-mon[35814]: pgmap v418: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 4.7 MiB/s wr, 459 op/s 2024-09-12T02:28:25.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:25 smithi110 ceph-mon[30548]: pgmap v418: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 4.7 MiB/s wr, 459 op/s 2024-09-12T02:28:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:27 smithi115 ceph-mon[35351]: pgmap v419: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 4.4 MiB/s wr, 460 op/s 2024-09-12T02:28:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:27 smithi136 ceph-mon[35814]: pgmap v419: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 4.4 MiB/s wr, 460 op/s 2024-09-12T02:28:27.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:27 smithi110 ceph-mon[30548]: pgmap v419: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 4.4 MiB/s wr, 460 op/s 2024-09-12T02:28:29.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:29 smithi115 ceph-mon[35351]: pgmap v420: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.4 MiB/s wr, 458 op/s 2024-09-12T02:28:29.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:29 smithi136 ceph-mon[35814]: pgmap v420: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.4 MiB/s wr, 458 op/s 2024-09-12T02:28:29.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:29 smithi110 ceph-mon[30548]: pgmap v420: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.4 MiB/s wr, 458 op/s 2024-09-12T02:28:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 785.0 s, 493.2 tps, lat 197.563 ms stddev 237.626 2024-09-12T02:28:31.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:31 smithi115 ceph-mon[35351]: pgmap v421: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 4.6 MiB/s wr, 467 op/s 2024-09-12T02:28:31.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:31 smithi136 ceph-mon[35814]: pgmap v421: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 4.6 MiB/s wr, 467 op/s 2024-09-12T02:28:31.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:31 smithi110 ceph-mon[30548]: pgmap v421: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 4.6 MiB/s wr, 467 op/s 2024-09-12T02:28:33.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:33 smithi115 ceph-mon[35351]: pgmap v422: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 4.0 MiB/s wr, 416 op/s 2024-09-12T02:28:33.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:33 smithi136 ceph-mon[35814]: pgmap v422: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 4.0 MiB/s wr, 416 op/s 2024-09-12T02:28:33.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:33 smithi110 ceph-mon[30548]: pgmap v422: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 4.0 MiB/s wr, 416 op/s 2024-09-12T02:28:35.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 790.0 s, 489.2 tps, lat 211.656 ms stddev 267.038 2024-09-12T02:28:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:35 smithi115 ceph-mon[35351]: pgmap v423: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.3 MiB/s wr, 536 op/s 2024-09-12T02:28:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:35 smithi136 ceph-mon[35814]: pgmap v423: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.3 MiB/s wr, 536 op/s 2024-09-12T02:28:35.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:35 smithi110 ceph-mon[30548]: pgmap v423: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 5.3 MiB/s wr, 536 op/s 2024-09-12T02:28:37.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:37 smithi115 ceph-mon[35351]: pgmap v424: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 4.3 MiB/s wr, 456 op/s 2024-09-12T02:28:37.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:37 smithi136 ceph-mon[35814]: pgmap v424: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 4.3 MiB/s wr, 456 op/s 2024-09-12T02:28:37.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:37 smithi110 ceph-mon[30548]: pgmap v424: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 4.3 MiB/s wr, 456 op/s 2024-09-12T02:28:39.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:39 smithi115 ceph-mon[35351]: pgmap v425: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 3.9 MiB/s wr, 404 op/s 2024-09-12T02:28:39.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:39 smithi136 ceph-mon[35814]: pgmap v425: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 3.9 MiB/s wr, 404 op/s 2024-09-12T02:28:39.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:39 smithi110 ceph-mon[30548]: pgmap v425: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 3.9 MiB/s wr, 404 op/s 2024-09-12T02:28:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 795.0 s, 454.6 tps, lat 214.487 ms stddev 248.057 2024-09-12T02:28:41.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:41 smithi136 ceph-mon[35814]: pgmap v426: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 5.7 MiB/s wr, 582 op/s 2024-09-12T02:28:41.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:41 smithi110 ceph-mon[30548]: pgmap v426: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 5.7 MiB/s wr, 582 op/s 2024-09-12T02:28:42.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:41 smithi115 ceph-mon[35351]: pgmap v426: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 5.7 MiB/s wr, 582 op/s 2024-09-12T02:28:43.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:43 smithi136 ceph-mon[35814]: pgmap v427: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 3.9 MiB/s wr, 412 op/s 2024-09-12T02:28:43.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:43 smithi110 ceph-mon[30548]: pgmap v427: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 3.9 MiB/s wr, 412 op/s 2024-09-12T02:28:44.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:43 smithi115 ceph-mon[35351]: pgmap v427: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 3.9 MiB/s wr, 412 op/s 2024-09-12T02:28:45.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 800.0 s, 517.2 tps, lat 192.761 ms stddev 237.286 2024-09-12T02:28:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:45 smithi136 ceph-mon[35814]: pgmap v428: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-09-12T02:28:45.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:45 smithi110 ceph-mon[30548]: pgmap v428: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-09-12T02:28:46.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:45 smithi115 ceph-mon[35351]: pgmap v428: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 4.7 MiB/s wr, 510 op/s 2024-09-12T02:28:47.741 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:47 smithi110 ceph-mon[30548]: pgmap v429: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 4.2 MiB/s wr, 451 op/s 2024-09-12T02:28:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:47 smithi136 ceph-mon[35814]: pgmap v429: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 4.2 MiB/s wr, 451 op/s 2024-09-12T02:28:48.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:47 smithi115 ceph-mon[35351]: pgmap v429: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 4.2 MiB/s wr, 451 op/s 2024-09-12T02:28:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:49 smithi136 ceph-mon[35814]: pgmap v430: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 3.8 MiB/s wr, 405 op/s 2024-09-12T02:28:49.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:49 smithi110 ceph-mon[30548]: pgmap v430: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 3.8 MiB/s wr, 405 op/s 2024-09-12T02:28:50.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:49 smithi115 ceph-mon[35351]: pgmap v430: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 3.8 MiB/s wr, 405 op/s 2024-09-12T02:28:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 805.0 s, 486.6 tps, lat 203.298 ms stddev 223.109 2024-09-12T02:28:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:50 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:28:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:50 smithi136 ceph-mon[35814]: pgmap v431: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 5.4 MiB/s wr, 568 op/s 2024-09-12T02:28:50.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:50 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:28:50.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:50 smithi110 ceph-mon[30548]: pgmap v431: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 5.4 MiB/s wr, 568 op/s 2024-09-12T02:28:51.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:50 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:28:51.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:50 smithi115 ceph-mon[35351]: pgmap v431: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 5.4 MiB/s wr, 568 op/s 2024-09-12T02:28:51.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:51 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:51.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:51 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:52.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:51 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:28:52.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:52 smithi136 ceph-mon[35814]: pgmap v432: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 3.8 MiB/s wr, 418 op/s 2024-09-12T02:28:52.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:52 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:52.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:52 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:52.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:52 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:28:52.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:52 smithi110 ceph-mon[30548]: pgmap v432: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 3.8 MiB/s wr, 418 op/s 2024-09-12T02:28:52.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:52 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:52.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:52 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:52.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:52 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:28:53.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:52 smithi115 ceph-mon[35351]: pgmap v432: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 3.8 MiB/s wr, 418 op/s 2024-09-12T02:28:53.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:52 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:28:53.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:52 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:28:53.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:52 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:28:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 810.0 s, 452.8 tps, lat 220.566 ms stddev 269.551 2024-09-12T02:28:55.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:55 smithi115 ceph-mon[35351]: pgmap v433: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 5.0 MiB/s wr, 534 op/s 2024-09-12T02:28:55.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:55 smithi136 ceph-mon[35814]: pgmap v433: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 5.0 MiB/s wr, 534 op/s 2024-09-12T02:28:55.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:55 smithi110 ceph-mon[30548]: pgmap v433: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 5.0 MiB/s wr, 534 op/s 2024-09-12T02:28:57.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:57 smithi115 ceph-mon[35351]: pgmap v434: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 4.5 MiB/s wr, 482 op/s 2024-09-12T02:28:57.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:57 smithi136 ceph-mon[35814]: pgmap v434: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 4.5 MiB/s wr, 482 op/s 2024-09-12T02:28:57.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:57 smithi110 ceph-mon[30548]: pgmap v434: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 4.5 MiB/s wr, 482 op/s 2024-09-12T02:28:59.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:28:59 smithi115 ceph-mon[35351]: pgmap v435: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 4.1 MiB/s wr, 427 op/s 2024-09-12T02:28:59.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:28:59 smithi136 ceph-mon[35814]: pgmap v435: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 4.1 MiB/s wr, 427 op/s 2024-09-12T02:28:59.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:28:59 smithi110 ceph-mon[30548]: pgmap v435: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 4.1 MiB/s wr, 427 op/s 2024-09-12T02:29:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 815.0 s, 516.4 tps, lat 199.914 ms stddev 260.092 2024-09-12T02:29:01.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:01 smithi115 ceph-mon[35351]: pgmap v436: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 5.2 MiB/s wr, 566 op/s 2024-09-12T02:29:01.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:01 smithi136 ceph-mon[35814]: pgmap v436: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 5.2 MiB/s wr, 566 op/s 2024-09-12T02:29:01.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:01 smithi110 ceph-mon[30548]: pgmap v436: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 5.2 MiB/s wr, 566 op/s 2024-09-12T02:29:03.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:03 smithi115 ceph-mon[35351]: pgmap v437: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 3.8 MiB/s wr, 445 op/s 2024-09-12T02:29:03.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:03 smithi136 ceph-mon[35814]: pgmap v437: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 3.8 MiB/s wr, 445 op/s 2024-09-12T02:29:03.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:03 smithi110 ceph-mon[30548]: pgmap v437: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 3.8 MiB/s wr, 445 op/s 2024-09-12T02:29:05.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 820.0 s, 586.3 tps, lat 168.445 ms stddev 203.568 2024-09-12T02:29:05.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:05 smithi115 ceph-mon[35351]: pgmap v438: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 4.6 MiB/s wr, 538 op/s 2024-09-12T02:29:05.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:05 smithi136 ceph-mon[35814]: pgmap v438: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 4.6 MiB/s wr, 538 op/s 2024-09-12T02:29:05.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:05 smithi110 ceph-mon[30548]: pgmap v438: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 4.6 MiB/s wr, 538 op/s 2024-09-12T02:29:07.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:07 smithi115 ceph-mon[35351]: pgmap v439: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 4.2 MiB/s wr, 477 op/s 2024-09-12T02:29:07.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:07 smithi136 ceph-mon[35814]: pgmap v439: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 4.2 MiB/s wr, 477 op/s 2024-09-12T02:29:07.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:07 smithi110 ceph-mon[30548]: pgmap v439: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 4.2 MiB/s wr, 477 op/s 2024-09-12T02:29:09.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:09 smithi136 ceph-mon[35814]: pgmap v440: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 3.9 MiB/s wr, 440 op/s 2024-09-12T02:29:09.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:09 smithi110 ceph-mon[30548]: pgmap v440: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 3.9 MiB/s wr, 440 op/s 2024-09-12T02:29:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:09 smithi115 ceph-mon[35351]: pgmap v440: 129 pgs: 129 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 3.9 MiB/s wr, 440 op/s 2024-09-12T02:29:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 825.0 s, 400.7 tps, lat 229.185 ms stddev 234.499 2024-09-12T02:29:10.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:10 smithi136 ceph-mon[35814]: osdmap e113: 12 total, 12 up, 12 in 2024-09-12T02:29:10.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:10 smithi110 ceph-mon[30548]: osdmap e113: 12 total, 12 up, 12 in 2024-09-12T02:29:10.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:10 smithi115 ceph-mon[35351]: osdmap e113: 12 total, 12 up, 12 in 2024-09-12T02:29:11.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:11 smithi136 ceph-mon[35814]: pgmap v442: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 4.5 MiB/s wr, 510 op/s 2024-09-12T02:29:11.690 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:11 smithi110 ceph-mon[30548]: pgmap v442: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 4.5 MiB/s wr, 510 op/s 2024-09-12T02:29:11.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:11 smithi115 ceph-mon[35351]: pgmap v442: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 4.5 MiB/s wr, 510 op/s 2024-09-12T02:29:13.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:13 smithi136 ceph-mon[35814]: pgmap v443: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 4.5 MiB/s wr, 477 op/s 2024-09-12T02:29:13.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:13 smithi110 ceph-mon[30548]: pgmap v443: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 4.5 MiB/s wr, 477 op/s 2024-09-12T02:29:13.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:13 smithi115 ceph-mon[35351]: pgmap v443: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 4.5 MiB/s wr, 477 op/s 2024-09-12T02:29:15.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 830.0 s, 408.2 tps, lat 264.166 ms stddev 342.407 2024-09-12T02:29:15.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:15 smithi136 ceph-mon[35814]: pgmap v444: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 4.3 MiB/s wr, 442 op/s 2024-09-12T02:29:15.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:15 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:29:15.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:15 smithi110 ceph-mon[30548]: pgmap v444: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 4.3 MiB/s wr, 442 op/s 2024-09-12T02:29:15.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:15 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:29:15.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:15 smithi115 ceph-mon[35351]: pgmap v444: 129 pgs: 2 active+clean+snaptrim, 4 active+clean+snaptrim_wait, 123 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 4.3 MiB/s wr, 442 op/s 2024-09-12T02:29:15.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:15 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:29:17.661 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:17 smithi136 ceph-mon[35814]: pgmap v445: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 3.7 MiB/s wr, 403 op/s 2024-09-12T02:29:17.689 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:17 smithi110 ceph-mon[30548]: pgmap v445: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 3.7 MiB/s wr, 403 op/s 2024-09-12T02:29:17.806 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:17 smithi115 ceph-mon[35351]: pgmap v445: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 3.7 MiB/s wr, 403 op/s 2024-09-12T02:29:19.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:19 smithi136 ceph-mon[35814]: pgmap v446: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 3.6 MiB/s wr, 393 op/s 2024-09-12T02:29:19.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:19 smithi110 ceph-mon[30548]: pgmap v446: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 3.6 MiB/s wr, 393 op/s 2024-09-12T02:29:19.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:19 smithi115 ceph-mon[35351]: pgmap v446: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 3.6 MiB/s wr, 393 op/s 2024-09-12T02:29:20.176 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 835.0 s, 418.0 tps, lat 242.738 ms stddev 286.054 2024-09-12T02:29:21.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:21 smithi115 ceph-mon[35351]: pgmap v447: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 3.8 MiB/s wr, 429 op/s 2024-09-12T02:29:21.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:21 smithi115 ceph-mon[35351]: osdmap e114: 12 total, 12 up, 12 in 2024-09-12T02:29:21.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:21 smithi136 ceph-mon[35814]: pgmap v447: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 3.8 MiB/s wr, 429 op/s 2024-09-12T02:29:21.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:21 smithi136 ceph-mon[35814]: osdmap e114: 12 total, 12 up, 12 in 2024-09-12T02:29:21.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:21 smithi110 ceph-mon[30548]: pgmap v447: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 3.8 MiB/s wr, 429 op/s 2024-09-12T02:29:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:21 smithi110 ceph-mon[30548]: osdmap e114: 12 total, 12 up, 12 in 2024-09-12T02:29:23.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:23 smithi115 ceph-mon[35351]: pgmap v449: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 3.9 MiB/s wr, 440 op/s 2024-09-12T02:29:23.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:23 smithi136 ceph-mon[35814]: pgmap v449: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 3.9 MiB/s wr, 440 op/s 2024-09-12T02:29:23.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:23 smithi110 ceph-mon[30548]: pgmap v449: 129 pgs: 129 active+clean; 2.9 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 3.9 MiB/s wr, 440 op/s 2024-09-12T02:29:25.174 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 840.0 s, 399.4 tps, lat 238.588 ms stddev 301.994 2024-09-12T02:29:25.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:25 smithi115 ceph-mon[35351]: pgmap v450: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 4.9 MiB/s wr, 523 op/s 2024-09-12T02:29:25.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:25 smithi136 ceph-mon[35814]: pgmap v450: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 4.9 MiB/s wr, 523 op/s 2024-09-12T02:29:25.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:25 smithi110 ceph-mon[30548]: pgmap v450: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 4.9 MiB/s wr, 523 op/s 2024-09-12T02:29:27.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:27 smithi115 ceph-mon[35351]: pgmap v451: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 5.9 MiB/s wr, 599 op/s 2024-09-12T02:29:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:27 smithi136 ceph-mon[35814]: pgmap v451: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 5.9 MiB/s wr, 599 op/s 2024-09-12T02:29:27.939 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:27 smithi110 ceph-mon[30548]: pgmap v451: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 5.9 MiB/s wr, 599 op/s 2024-09-12T02:29:29.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:29 smithi115 ceph-mon[35351]: pgmap v452: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 6.5 MiB/s wr, 633 op/s 2024-09-12T02:29:29.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:29 smithi136 ceph-mon[35814]: pgmap v452: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 6.5 MiB/s wr, 633 op/s 2024-09-12T02:29:29.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:29 smithi110 ceph-mon[30548]: pgmap v452: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 6.5 MiB/s wr, 633 op/s 2024-09-12T02:29:30.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 845.0 s, 452.2 tps, lat 227.198 ms stddev 318.147 2024-09-12T02:29:31.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:31 smithi115 ceph-mon[35351]: pgmap v453: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 9.4 MiB/s wr, 789 op/s 2024-09-12T02:29:31.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:31 smithi136 ceph-mon[35814]: pgmap v453: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 9.4 MiB/s wr, 789 op/s 2024-09-12T02:29:31.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:31 smithi110 ceph-mon[30548]: pgmap v453: 129 pgs: 129 active+clean; 3.0 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 9.4 MiB/s wr, 789 op/s 2024-09-12T02:29:33.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:33 smithi115 ceph-mon[35351]: pgmap v454: 129 pgs: 129 active+clean; 3.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 8.7 MiB/s wr, 719 op/s 2024-09-12T02:29:33.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:33 smithi136 ceph-mon[35814]: pgmap v454: 129 pgs: 129 active+clean; 3.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 8.7 MiB/s wr, 719 op/s 2024-09-12T02:29:33.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:33 smithi110 ceph-mon[30548]: pgmap v454: 129 pgs: 129 active+clean; 3.0 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 8.7 MiB/s wr, 719 op/s 2024-09-12T02:29:35.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 850.0 s, 218.2 tps, lat 438.636 ms stddev 720.120 2024-09-12T02:29:35.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:35 smithi115 ceph-mon[35351]: pgmap v455: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 16 MiB/s wr, 1.24k op/s 2024-09-12T02:29:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:35 smithi136 ceph-mon[35814]: pgmap v455: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 16 MiB/s wr, 1.24k op/s 2024-09-12T02:29:35.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:35 smithi110 ceph-mon[30548]: pgmap v455: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 16 MiB/s wr, 1.24k op/s 2024-09-12T02:29:37.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:37 smithi136 ceph-mon[35814]: pgmap v456: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 18 MiB/s wr, 1.34k op/s 2024-09-12T02:29:37.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:37 smithi110 ceph-mon[30548]: pgmap v456: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 18 MiB/s wr, 1.34k op/s 2024-09-12T02:29:38.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:37 smithi115 ceph-mon[35351]: pgmap v456: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 18 MiB/s wr, 1.34k op/s 2024-09-12T02:29:39.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:39 smithi136 ceph-mon[35814]: pgmap v457: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 17 MiB/s wr, 1.30k op/s 2024-09-12T02:29:39.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:39 smithi110 ceph-mon[30548]: pgmap v457: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 17 MiB/s wr, 1.30k op/s 2024-09-12T02:29:40.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:39 smithi115 ceph-mon[35351]: pgmap v457: 129 pgs: 129 active+clean; 3.1 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 17 MiB/s wr, 1.30k op/s 2024-09-12T02:29:40.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 855.0 s, 451.5 tps, lat 234.358 ms stddev 297.844 2024-09-12T02:29:41.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:41 smithi136 ceph-mon[35814]: pgmap v458: 129 pgs: 129 active+clean; 3.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 18 MiB/s wr, 1.41k op/s 2024-09-12T02:29:41.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:41 smithi110 ceph-mon[30548]: pgmap v458: 129 pgs: 129 active+clean; 3.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 18 MiB/s wr, 1.41k op/s 2024-09-12T02:29:42.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:41 smithi115 ceph-mon[35351]: pgmap v458: 129 pgs: 129 active+clean; 3.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 18 MiB/s wr, 1.41k op/s 2024-09-12T02:29:43.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:43 smithi136 ceph-mon[35814]: pgmap v459: 129 pgs: 129 active+clean; 3.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-12T02:29:43.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:43 smithi110 ceph-mon[30548]: pgmap v459: 129 pgs: 129 active+clean; 3.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-12T02:29:44.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:43 smithi115 ceph-mon[35351]: pgmap v459: 129 pgs: 129 active+clean; 3.2 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 14 MiB/s wr, 1.12k op/s 2024-09-12T02:29:45.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 860.0 s, 505.0 tps, lat 199.480 ms stddev 219.896 2024-09-12T02:29:45.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:45 smithi136 ceph-mon[35814]: pgmap v460: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 15 MiB/s wr, 1.16k op/s 2024-09-12T02:29:45.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:45 smithi110 ceph-mon[30548]: pgmap v460: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 15 MiB/s wr, 1.16k op/s 2024-09-12T02:29:46.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:45 smithi115 ceph-mon[35351]: pgmap v460: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 15 MiB/s wr, 1.16k op/s 2024-09-12T02:29:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:47 smithi136 ceph-mon[35814]: pgmap v461: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.0 MiB/s wr, 692 op/s 2024-09-12T02:29:47.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:47 smithi110 ceph-mon[30548]: pgmap v461: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.0 MiB/s wr, 692 op/s 2024-09-12T02:29:48.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:47 smithi115 ceph-mon[35351]: pgmap v461: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.0 MiB/s wr, 692 op/s 2024-09-12T02:29:48.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:48 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:29:48.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:48 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:29:49.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:48 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:29:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:49 smithi136 ceph-mon[35814]: pgmap v462: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 439 op/s 2024-09-12T02:29:49.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:49 smithi110 ceph-mon[30548]: pgmap v462: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 439 op/s 2024-09-12T02:29:50.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:49 smithi115 ceph-mon[35351]: pgmap v462: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.4 MiB/s wr, 439 op/s 2024-09-12T02:29:50.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 865.0 s, 483.4 tps, lat 199.368 ms stddev 210.525 2024-09-12T02:29:50.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:50 smithi136 ceph-mon[35814]: pgmap v463: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 542 op/s 2024-09-12T02:29:50.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:50 smithi110 ceph-mon[30548]: pgmap v463: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 542 op/s 2024-09-12T02:29:51.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:50 smithi115 ceph-mon[35351]: pgmap v463: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 542 op/s 2024-09-12T02:29:52.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:52 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:29:52.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:52 smithi110 ceph-mon[30548]: pgmap v464: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.9 MiB/s wr, 433 op/s 2024-09-12T02:29:53.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:52 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:29:53.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:52 smithi115 ceph-mon[35351]: pgmap v464: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.9 MiB/s wr, 433 op/s 2024-09-12T02:29:53.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:52 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:29:53.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:52 smithi136 ceph-mon[35814]: pgmap v464: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.9 MiB/s wr, 433 op/s 2024-09-12T02:29:53.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:53 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:54.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:53 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:54.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:53 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:29:55.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:54 smithi115 ceph-mon[35351]: pgmap v465: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.8 MiB/s wr, 517 op/s 2024-09-12T02:29:55.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:54 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:55.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:54 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:55.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:54 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:29:55.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:54 smithi136 ceph-mon[35814]: pgmap v465: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.8 MiB/s wr, 517 op/s 2024-09-12T02:29:55.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:54 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:55.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:54 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:55.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:54 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:29:55.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 870.0 s, 581.2 tps, lat 177.574 ms stddev 224.021 2024-09-12T02:29:55.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:54 smithi110 ceph-mon[30548]: pgmap v465: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.8 MiB/s wr, 517 op/s 2024-09-12T02:29:55.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:54 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:29:55.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:54 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:29:55.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:54 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:29:57.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:57 smithi115 ceph-mon[35351]: pgmap v466: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 505 op/s 2024-09-12T02:29:57.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:57 smithi136 ceph-mon[35814]: pgmap v466: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 505 op/s 2024-09-12T02:29:57.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:57 smithi110 ceph-mon[30548]: pgmap v466: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.7 MiB/s wr, 505 op/s 2024-09-12T02:29:59.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:29:59 smithi115 ceph-mon[35351]: pgmap v467: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.8 MiB/s wr, 432 op/s 2024-09-12T02:29:59.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:29:59 smithi136 ceph-mon[35814]: pgmap v467: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.8 MiB/s wr, 432 op/s 2024-09-12T02:29:59.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:29:59 smithi110 ceph-mon[30548]: pgmap v467: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.8 MiB/s wr, 432 op/s 2024-09-12T02:30:00.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 875.0 s, 631.4 tps, lat 153.937 ms stddev 184.059 2024-09-12T02:30:00.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:00 smithi115 ceph-mon[35351]: overall HEALTH_OK 2024-09-12T02:30:00.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:00 smithi136 ceph-mon[35814]: overall HEALTH_OK 2024-09-12T02:30:00.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:00 smithi110 ceph-mon[30548]: overall HEALTH_OK 2024-09-12T02:30:01.544 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:01 smithi115 ceph-mon[35351]: pgmap v468: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.4 MiB/s wr, 600 op/s 2024-09-12T02:30:01.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:01 smithi136 ceph-mon[35814]: pgmap v468: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.4 MiB/s wr, 600 op/s 2024-09-12T02:30:01.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:01 smithi110 ceph-mon[30548]: pgmap v468: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 5.4 MiB/s wr, 600 op/s 2024-09-12T02:30:03.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:03 smithi136 ceph-mon[35814]: pgmap v469: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.3 MiB/s wr, 458 op/s 2024-09-12T02:30:03.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:03 smithi110 ceph-mon[30548]: pgmap v469: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.3 MiB/s wr, 458 op/s 2024-09-12T02:30:03.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:03 smithi115 ceph-mon[35351]: pgmap v469: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.3 MiB/s wr, 458 op/s 2024-09-12T02:30:05.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 880.0 s, 359.2 tps, lat 246.209 ms stddev 318.980 2024-09-12T02:30:05.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:05 smithi136 ceph-mon[35814]: pgmap v470: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 541 op/s 2024-09-12T02:30:05.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:05 smithi136 ceph-mon[35814]: osdmap e115: 12 total, 12 up, 12 in 2024-09-12T02:30:05.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:05 smithi110 ceph-mon[30548]: pgmap v470: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 541 op/s 2024-09-12T02:30:05.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:05 smithi110 ceph-mon[30548]: osdmap e115: 12 total, 12 up, 12 in 2024-09-12T02:30:05.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:05 smithi115 ceph-mon[35351]: pgmap v470: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.8 MiB/s wr, 541 op/s 2024-09-12T02:30:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:05 smithi115 ceph-mon[35351]: osdmap e115: 12 total, 12 up, 12 in 2024-09-12T02:30:07.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:07 smithi136 ceph-mon[35814]: pgmap v472: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 4.8 MiB/s wr, 550 op/s 2024-09-12T02:30:07.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:07 smithi110 ceph-mon[30548]: pgmap v472: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 4.8 MiB/s wr, 550 op/s 2024-09-12T02:30:07.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:07 smithi115 ceph-mon[35351]: pgmap v472: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 4.8 MiB/s wr, 550 op/s 2024-09-12T02:30:09.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:09 smithi136 ceph-mon[35814]: pgmap v473: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 4.8 MiB/s wr, 543 op/s 2024-09-12T02:30:09.688 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:09 smithi110 ceph-mon[30548]: pgmap v473: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 4.8 MiB/s wr, 543 op/s 2024-09-12T02:30:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:09 smithi115 ceph-mon[35351]: pgmap v473: 129 pgs: 6 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 103 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 4.8 MiB/s wr, 543 op/s 2024-09-12T02:30:10.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 885.0 s, 450.4 tps, lat 248.975 ms stddev 357.777 2024-09-12T02:30:11.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:11 smithi115 ceph-mon[35351]: pgmap v474: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 4.0 MiB/s wr, 469 op/s 2024-09-12T02:30:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:11 smithi115 ceph-mon[35351]: osdmap e116: 12 total, 12 up, 12 in 2024-09-12T02:30:11.908 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:11 smithi136 ceph-mon[35814]: pgmap v474: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 4.0 MiB/s wr, 469 op/s 2024-09-12T02:30:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:11 smithi136 ceph-mon[35814]: osdmap e116: 12 total, 12 up, 12 in 2024-09-12T02:30:11.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:11 smithi110 ceph-mon[30548]: pgmap v474: 129 pgs: 129 active+clean; 3.0 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 4.0 MiB/s wr, 469 op/s 2024-09-12T02:30:11.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:11 smithi110 ceph-mon[30548]: osdmap e116: 12 total, 12 up, 12 in 2024-09-12T02:30:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:13 smithi115 ceph-mon[35351]: pgmap v476: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 3.6 MiB/s wr, 399 op/s 2024-09-12T02:30:13.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:13 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:30:13.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:13 smithi136 ceph-mon[35814]: pgmap v476: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 3.6 MiB/s wr, 399 op/s 2024-09-12T02:30:13.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:13 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:30:13.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:13 smithi110 ceph-mon[30548]: pgmap v476: 129 pgs: 129 active+clean; 3.1 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 3.6 MiB/s wr, 399 op/s 2024-09-12T02:30:13.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:13 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:30:15.172 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 890.0 s, 424.4 tps, lat 226.878 ms stddev 275.271 2024-09-12T02:30:15.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:15 smithi136 ceph-mon[35814]: pgmap v477: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 4.1 MiB/s wr, 435 op/s 2024-09-12T02:30:15.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:15 smithi110 ceph-mon[30548]: pgmap v477: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 4.1 MiB/s wr, 435 op/s 2024-09-12T02:30:16.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:15 smithi115 ceph-mon[35351]: pgmap v477: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 4.1 MiB/s wr, 435 op/s 2024-09-12T02:30:17.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:17 smithi136 ceph-mon[35814]: pgmap v478: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.8 MiB/s wr, 407 op/s 2024-09-12T02:30:17.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:17 smithi110 ceph-mon[30548]: pgmap v478: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.8 MiB/s wr, 407 op/s 2024-09-12T02:30:18.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:17 smithi115 ceph-mon[35351]: pgmap v478: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.8 MiB/s wr, 407 op/s 2024-09-12T02:30:19.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:19 smithi136 ceph-mon[35814]: pgmap v479: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.8 MiB/s wr, 410 op/s 2024-09-12T02:30:19.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:19 smithi110 ceph-mon[30548]: pgmap v479: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.8 MiB/s wr, 410 op/s 2024-09-12T02:30:20.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:19 smithi115 ceph-mon[35351]: pgmap v479: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.8 MiB/s wr, 410 op/s 2024-09-12T02:30:20.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 895.0 s, 437.2 tps, lat 241.520 ms stddev 309.254 2024-09-12T02:30:21.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:21 smithi136 ceph-mon[35814]: pgmap v480: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 5.2 MiB/s wr, 463 op/s 2024-09-12T02:30:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:21 smithi110 ceph-mon[30548]: pgmap v480: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 5.2 MiB/s wr, 463 op/s 2024-09-12T02:30:22.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:21 smithi115 ceph-mon[35351]: pgmap v480: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 5.2 MiB/s wr, 463 op/s 2024-09-12T02:30:23.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:23 smithi136 ceph-mon[35814]: pgmap v481: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 5.0 MiB/s wr, 400 op/s 2024-09-12T02:30:23.938 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:23 smithi110 ceph-mon[30548]: pgmap v481: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 5.0 MiB/s wr, 400 op/s 2024-09-12T02:30:24.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:23 smithi115 ceph-mon[35351]: pgmap v481: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 5.0 MiB/s wr, 400 op/s 2024-09-12T02:30:25.171 INFO:teuthology.orchestra.run.smithi110.stderr:progress: 900.0 s, 447.2 tps, lat 219.026 ms stddev 232.545 2024-09-12T02:30:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:transaction type: 2024-09-12T02:30:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:scaling factor: 32 2024-09-12T02:30:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:query mode: simple 2024-09-12T02:30:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:number of clients: 100 2024-09-12T02:30:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:number of threads: 4 2024-09-12T02:30:25.815 INFO:teuthology.orchestra.run.smithi110.stdout:duration: 900 s 2024-09-12T02:30:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:number of transactions actually processed: 750873 2024-09-12T02:30:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:latency average = 119.865 ms 2024-09-12T02:30:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:latency stddev = 196.645 ms 2024-09-12T02:30:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:tps = 833.707405 (including connections establishing) 2024-09-12T02:30:25.816 INFO:teuthology.orchestra.run.smithi110.stdout:tps = 833.712767 (excluding connections establishing) 2024-09-12T02:30:25.846 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:25 smithi110 ceph-mon[30548]: pgmap v482: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 6.3 MiB/s wr, 513 op/s 2024-09-12T02:30:25.859 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-12T02:30:25.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:25 smithi136 ceph-mon[35814]: pgmap v482: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 6.3 MiB/s wr, 513 op/s 2024-09-12T02:30:26.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:25 smithi115 ceph-mon[35351]: pgmap v482: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 6.3 MiB/s wr, 513 op/s 2024-09-12T02:30:27.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:27 smithi136 ceph-mon[35814]: pgmap v483: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 6.9 MiB/s wr, 492 op/s 2024-09-12T02:30:27.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:27 smithi110 ceph-mon[30548]: pgmap v483: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 6.9 MiB/s wr, 492 op/s 2024-09-12T02:30:28.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:27 smithi115 ceph-mon[35351]: pgmap v483: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 6.9 MiB/s wr, 492 op/s 2024-09-12T02:30:29.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:29 smithi136 ceph-mon[35814]: pgmap v484: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 6.2 MiB/s wr, 418 op/s 2024-09-12T02:30:29.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:29 smithi110 ceph-mon[30548]: pgmap v484: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 6.2 MiB/s wr, 418 op/s 2024-09-12T02:30:30.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:29 smithi115 ceph-mon[35351]: pgmap v484: 129 pgs: 129 active+clean; 3.1 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 6.2 MiB/s wr, 418 op/s 2024-09-12T02:30:31.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:31 smithi136 ceph-mon[35814]: pgmap v485: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 8.4 MiB/s wr, 660 op/s 2024-09-12T02:30:31.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:31 smithi110 ceph-mon[30548]: pgmap v485: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 8.4 MiB/s wr, 660 op/s 2024-09-12T02:30:32.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:31 smithi115 ceph-mon[35351]: pgmap v485: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 8.4 MiB/s wr, 660 op/s 2024-09-12T02:30:33.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:33 smithi110 ceph-mon[30548]: pgmap v486: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 6.7 MiB/s wr, 558 op/s 2024-09-12T02:30:33.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:33 smithi136 ceph-mon[35814]: pgmap v486: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 6.7 MiB/s wr, 558 op/s 2024-09-12T02:30:34.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:33 smithi115 ceph-mon[35351]: pgmap v486: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 6.7 MiB/s wr, 558 op/s 2024-09-12T02:30:35.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:35 smithi136 ceph-mon[35814]: pgmap v487: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 7.0 MiB/s wr, 645 op/s 2024-09-12T02:30:35.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:35 smithi110 ceph-mon[30548]: pgmap v487: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 7.0 MiB/s wr, 645 op/s 2024-09-12T02:30:36.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:35 smithi115 ceph-mon[35351]: pgmap v487: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 7.0 MiB/s wr, 645 op/s 2024-09-12T02:30:37.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:37 smithi136 ceph-mon[35814]: pgmap v488: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 6.2 MiB/s wr, 600 op/s 2024-09-12T02:30:37.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:37 smithi110 ceph-mon[30548]: pgmap v488: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 6.2 MiB/s wr, 600 op/s 2024-09-12T02:30:38.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:37 smithi115 ceph-mon[35351]: pgmap v488: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 6.2 MiB/s wr, 600 op/s 2024-09-12T02:30:39.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:39 smithi136 ceph-mon[35814]: pgmap v489: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.5 MiB/s wr, 511 op/s 2024-09-12T02:30:39.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:39 smithi110 ceph-mon[30548]: pgmap v489: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.5 MiB/s wr, 511 op/s 2024-09-12T02:30:40.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:39 smithi115 ceph-mon[35351]: pgmap v489: 129 pgs: 129 active+clean; 3.2 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 4.5 MiB/s wr, 511 op/s 2024-09-12T02:30:40.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:40 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:30:40.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:40 smithi136 ceph-mon[35814]: pgmap v490: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 6.0 MiB/s wr, 693 op/s 2024-09-12T02:30:40.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:40 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:30:40.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:40 smithi110 ceph-mon[30548]: pgmap v490: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 6.0 MiB/s wr, 693 op/s 2024-09-12T02:30:41.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:40 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:30:41.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:40 smithi115 ceph-mon[35351]: pgmap v490: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 6.0 MiB/s wr, 693 op/s 2024-09-12T02:30:41.595 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-12T02:30:42.241 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/: 2024-09-12T02:30:42.241 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.241 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 . 2024-09-12T02:30:42.241 INFO:teuthology.orchestra.run.smithi110.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 .. 2024-09-12T02:30:42.241 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 data 2024-09-12T02:30:42.242 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.242 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data: 2024-09-12T02:30:42.242 INFO:teuthology.orchestra.run.smithi110.stdout:total 36 2024-09-12T02:30:42.242 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 . 2024-09-12T02:30:42.242 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 .. 2024-09-12T02:30:42.242 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 12 02:15 base 2024-09-12T02:30:42.242 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 12 02:15 current_logfiles 2024-09-12T02:30:42.242 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 12 02:15 global 2024-09-12T02:30:42.242 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 log 2024-09-12T02:30:42.242 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_commit_ts 2024-09-12T02:30:42.243 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_dynshmem 2024-09-12T02:30:42.243 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 12 02:15 pg_hba.conf 2024-09-12T02:30:42.243 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 12 02:15 pg_ident.conf 2024-09-12T02:30:42.243 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:30 pg_logical 2024-09-12T02:30:42.243 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:15 pg_multixact 2024-09-12T02:30:42.243 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_notify 2024-09-12T02:30:42.243 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_replslot 2024-09-12T02:30:42.243 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_serial 2024-09-12T02:30:42.243 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_snapshots 2024-09-12T02:30:42.243 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:30 pg_stat 2024-09-12T02:30:42.243 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:30 pg_stat_tmp 2024-09-12T02:30:42.244 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:30 pg_subtrans 2024-09-12T02:30:42.244 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_tblspc 2024-09-12T02:30:42.244 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pg_twophase 2024-09-12T02:30:42.244 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 PG_VERSION 2024-09-12T02:30:42.244 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 12 02:30 pg_wal 2024-09-12T02:30:42.244 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 pg_xact 2024-09-12T02:30:42.244 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 12 02:15 postgresql.auto.conf 2024-09-12T02:30:42.244 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 12 02:15 postgresql.conf 2024-09-12T02:30:42.244 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 12 02:15 postmaster.opts 2024-09-12T02:30:42.244 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.244 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base: 2024-09-12T02:30:42.245 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.245 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 12 02:15 . 2024-09-12T02:30:42.245 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.245 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:15 1 2024-09-12T02:30:42.245 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:15 13493 2024-09-12T02:30:42.245 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 12 02:22 13494 2024-09-12T02:30:42.245 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 pgsql_tmp 2024-09-12T02:30:42.245 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.245 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-12T02:30:42.245 INFO:teuthology.orchestra.run.smithi110.stdout:total 7777 2024-09-12T02:30:42.245 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:15 . 2024-09-12T02:30:42.246 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 12 02:15 .. 2024-09-12T02:30:42.246 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 112 2024-09-12T02:30:42.246 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 113 2024-09-12T02:30:42.246 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:15 1247 2024-09-12T02:30:42.246 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1247_fsm 2024-09-12T02:30:42.246 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1247_vm 2024-09-12T02:30:42.246 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 12 02:15 1249 2024-09-12T02:30:42.246 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1249_fsm 2024-09-12T02:30:42.246 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1249_vm 2024-09-12T02:30:42.246 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 12 02:15 1255 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1255_fsm 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1255_vm 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 12 02:15 1259 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1259_fsm 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1259_vm 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 12 02:15 13344 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13344_fsm 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13344_vm 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13346 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13348 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13349 2024-09-12T02:30:42.247 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13349_fsm 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13349_vm 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13351 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13353 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13354 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13354_fsm 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13354_vm 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13356 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13358 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13359 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13359_fsm 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13359_vm 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13361 2024-09-12T02:30:42.248 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13363 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 1417 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 1418 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 174 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 175 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2187 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2224 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2328 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2336 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2337 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2579 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2600 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2600_fsm 2024-09-12T02:30:42.249 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2600_vm 2024-09-12T02:30:42.250 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2601 2024-09-12T02:30:42.250 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2601_fsm 2024-09-12T02:30:42.250 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2601_vm 2024-09-12T02:30:42.250 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2602 2024-09-12T02:30:42.250 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2602_fsm 2024-09-12T02:30:42.250 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2602_vm 2024-09-12T02:30:42.250 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2603 2024-09-12T02:30:42.250 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2603_fsm 2024-09-12T02:30:42.250 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2603_vm 2024-09-12T02:30:42.250 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2604 2024-09-12T02:30:42.250 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2605 2024-09-12T02:30:42.250 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2605_fsm 2024-09-12T02:30:42.251 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2605_vm 2024-09-12T02:30:42.251 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2606 2024-09-12T02:30:42.251 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2606_fsm 2024-09-12T02:30:42.251 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2606_vm 2024-09-12T02:30:42.251 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2607 2024-09-12T02:30:42.251 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2607_fsm 2024-09-12T02:30:42.251 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2607_vm 2024-09-12T02:30:42.251 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 12 02:15 2608 2024-09-12T02:30:42.251 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2608_fsm 2024-09-12T02:30:42.251 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2608_vm 2024-09-12T02:30:42.252 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 12 02:15 2609 2024-09-12T02:30:42.252 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2609_fsm 2024-09-12T02:30:42.252 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2609_vm 2024-09-12T02:30:42.252 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2610 2024-09-12T02:30:42.252 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2610_fsm 2024-09-12T02:30:42.252 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2610_vm 2024-09-12T02:30:42.252 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2611 2024-09-12T02:30:42.252 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2612 2024-09-12T02:30:42.252 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2612_fsm 2024-09-12T02:30:42.252 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2612_vm 2024-09-12T02:30:42.252 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2613 2024-09-12T02:30:42.252 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2615 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2615_fsm 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2615_vm 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2616 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2616_fsm 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2616_vm 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 12 02:15 2617 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2617_fsm 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2617_vm 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 12 02:15 2618 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2618_fsm 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2618_vm 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 12 02:15 2619 2024-09-12T02:30:42.253 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2619_fsm 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2619_vm 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2620 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2650 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2651 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2652 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2653 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2654 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2655 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2656 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2657 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:15 2658 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:15 2659 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2660 2024-09-12T02:30:42.254 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2661 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2662 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2663 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2664 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2665 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2666 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2667 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2668 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2669 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2670 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 12 02:15 2673 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 12 02:15 2674 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 12 02:15 2675 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2678 2024-09-12T02:30:42.255 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2679 2024-09-12T02:30:42.256 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2680 2024-09-12T02:30:42.256 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2681 2024-09-12T02:30:42.256 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2682 2024-09-12T02:30:42.256 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2683 2024-09-12T02:30:42.256 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2684 2024-09-12T02:30:42.256 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2685 2024-09-12T02:30:42.256 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2686 2024-09-12T02:30:42.256 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2687 2024-09-12T02:30:42.256 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2688 2024-09-12T02:30:42.256 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2689 2024-09-12T02:30:42.256 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 12 02:15 2690 2024-09-12T02:30:42.257 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 12 02:15 2691 2024-09-12T02:30:42.257 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2692 2024-09-12T02:30:42.257 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2693 2024-09-12T02:30:42.257 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2696 2024-09-12T02:30:42.257 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2699 2024-09-12T02:30:42.257 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2701 2024-09-12T02:30:42.257 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2702 2024-09-12T02:30:42.257 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2703 2024-09-12T02:30:42.257 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2704 2024-09-12T02:30:42.257 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2753 2024-09-12T02:30:42.257 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2753_fsm 2024-09-12T02:30:42.257 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2753_vm 2024-09-12T02:30:42.258 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2754 2024-09-12T02:30:42.258 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2755 2024-09-12T02:30:42.258 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2756 2024-09-12T02:30:42.258 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2757 2024-09-12T02:30:42.258 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2830 2024-09-12T02:30:42.258 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2831 2024-09-12T02:30:42.258 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2832 2024-09-12T02:30:42.258 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2833 2024-09-12T02:30:42.258 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2834 2024-09-12T02:30:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2835 2024-09-12T02:30:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2836 2024-09-12T02:30:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2837 2024-09-12T02:30:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 12 02:15 2838 2024-09-12T02:30:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2838_fsm 2024-09-12T02:30:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2838_vm 2024-09-12T02:30:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2839 2024-09-12T02:30:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2840 2024-09-12T02:30:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2840_fsm 2024-09-12T02:30:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2840_vm 2024-09-12T02:30:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2841 2024-09-12T02:30:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2995 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2996 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3079 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3079_fsm 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3079_vm 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3080 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3081 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 3085 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3118 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3119 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:15 3164 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3256 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3257 2024-09-12T02:30:42.260 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3258 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3350 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3351 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3379 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3380 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3381 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3394 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3394_fsm 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3394_vm 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3395 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3429 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3430 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3431 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3433 2024-09-12T02:30:42.261 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3439 2024-09-12T02:30:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3440 2024-09-12T02:30:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 3455 2024-09-12T02:30:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 12 02:15 3456 2024-09-12T02:30:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3456_fsm 2024-09-12T02:30:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3456_vm 2024-09-12T02:30:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3466 2024-09-12T02:30:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3467 2024-09-12T02:30:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3468 2024-09-12T02:30:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3501 2024-09-12T02:30:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3502 2024-09-12T02:30:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3503 2024-09-12T02:30:42.262 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3534 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3541 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3541_fsm 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3541_vm 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3542 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3574 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3575 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3576 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3596 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3597 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3598 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3599 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3600 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3600_fsm 2024-09-12T02:30:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3600_vm 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3601 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3601_fsm 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3601_vm 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3602 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3602_fsm 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3602_vm 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3603 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3603_fsm 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3603_vm 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3604 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3605 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3606 2024-09-12T02:30:42.264 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3607 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3608 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 3609 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3712 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3764 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3764_fsm 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3764_vm 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3766 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3767 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3997 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4143 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4144 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4145 2024-09-12T02:30:42.265 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4146 2024-09-12T02:30:42.266 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4147 2024-09-12T02:30:42.266 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4148 2024-09-12T02:30:42.266 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4149 2024-09-12T02:30:42.266 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4150 2024-09-12T02:30:42.266 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4151 2024-09-12T02:30:42.266 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4152 2024-09-12T02:30:42.266 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4153 2024-09-12T02:30:42.266 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4154 2024-09-12T02:30:42.266 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4155 2024-09-12T02:30:42.266 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4156 2024-09-12T02:30:42.266 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4157 2024-09-12T02:30:42.266 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4158 2024-09-12T02:30:42.267 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4159 2024-09-12T02:30:42.267 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4160 2024-09-12T02:30:42.267 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4161 2024-09-12T02:30:42.267 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4162 2024-09-12T02:30:42.270 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4163 2024-09-12T02:30:42.270 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4164 2024-09-12T02:30:42.270 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4165 2024-09-12T02:30:42.270 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4166 2024-09-12T02:30:42.270 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4167 2024-09-12T02:30:42.270 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4168 2024-09-12T02:30:42.270 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4169 2024-09-12T02:30:42.270 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4170 2024-09-12T02:30:42.270 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4171 2024-09-12T02:30:42.270 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4172 2024-09-12T02:30:42.270 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4173 2024-09-12T02:30:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4174 2024-09-12T02:30:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 5002 2024-09-12T02:30:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 548 2024-09-12T02:30:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 549 2024-09-12T02:30:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6102 2024-09-12T02:30:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6104 2024-09-12T02:30:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6106 2024-09-12T02:30:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6110 2024-09-12T02:30:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6111 2024-09-12T02:30:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6112 2024-09-12T02:30:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6113 2024-09-12T02:30:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6117 2024-09-12T02:30:42.272 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 826 2024-09-12T02:30:42.272 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 827 2024-09-12T02:30:42.272 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 828 2024-09-12T02:30:42.272 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:15 pg_filenode.map 2024-09-12T02:30:42.272 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 PG_VERSION 2024-09-12T02:30:42.272 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.272 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-12T02:30:42.272 INFO:teuthology.orchestra.run.smithi110.stdout:total 7777 2024-09-12T02:30:42.272 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Sep 12 02:15 . 2024-09-12T02:30:42.272 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 12 02:15 .. 2024-09-12T02:30:42.272 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 112 2024-09-12T02:30:42.272 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 113 2024-09-12T02:30:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:15 1247 2024-09-12T02:30:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1247_fsm 2024-09-12T02:30:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1247_vm 2024-09-12T02:30:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 12 02:15 1249 2024-09-12T02:30:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1249_fsm 2024-09-12T02:30:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1249_vm 2024-09-12T02:30:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 12 02:15 1255 2024-09-12T02:30:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1255_fsm 2024-09-12T02:30:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1255_vm 2024-09-12T02:30:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 12 02:15 1259 2024-09-12T02:30:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1259_fsm 2024-09-12T02:30:42.273 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1259_vm 2024-09-12T02:30:42.274 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 12 02:15 13344 2024-09-12T02:30:42.274 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13344_fsm 2024-09-12T02:30:42.274 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13344_vm 2024-09-12T02:30:42.274 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13346 2024-09-12T02:30:42.274 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13348 2024-09-12T02:30:42.274 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13349 2024-09-12T02:30:42.274 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13349_fsm 2024-09-12T02:30:42.274 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13349_vm 2024-09-12T02:30:42.274 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13351 2024-09-12T02:30:42.274 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13353 2024-09-12T02:30:42.274 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13354 2024-09-12T02:30:42.275 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13354_fsm 2024-09-12T02:30:42.275 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13354_vm 2024-09-12T02:30:42.275 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13356 2024-09-12T02:30:42.275 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13358 2024-09-12T02:30:42.275 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13359 2024-09-12T02:30:42.275 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13359_fsm 2024-09-12T02:30:42.275 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13359_vm 2024-09-12T02:30:42.276 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13361 2024-09-12T02:30:42.276 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13363 2024-09-12T02:30:42.276 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 1417 2024-09-12T02:30:42.276 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 1418 2024-09-12T02:30:42.276 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 174 2024-09-12T02:30:42.276 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 175 2024-09-12T02:30:42.277 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2187 2024-09-12T02:30:42.277 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2224 2024-09-12T02:30:42.277 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2328 2024-09-12T02:30:42.277 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2336 2024-09-12T02:30:42.277 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2337 2024-09-12T02:30:42.277 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2579 2024-09-12T02:30:42.277 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2600 2024-09-12T02:30:42.277 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2600_fsm 2024-09-12T02:30:42.277 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2600_vm 2024-09-12T02:30:42.277 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2601 2024-09-12T02:30:42.277 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2601_fsm 2024-09-12T02:30:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2601_vm 2024-09-12T02:30:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2602 2024-09-12T02:30:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2602_fsm 2024-09-12T02:30:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2602_vm 2024-09-12T02:30:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2603 2024-09-12T02:30:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2603_fsm 2024-09-12T02:30:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2603_vm 2024-09-12T02:30:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2604 2024-09-12T02:30:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2605 2024-09-12T02:30:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2605_fsm 2024-09-12T02:30:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2605_vm 2024-09-12T02:30:42.278 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2606 2024-09-12T02:30:42.279 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2606_fsm 2024-09-12T02:30:42.279 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2606_vm 2024-09-12T02:30:42.279 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2607 2024-09-12T02:30:42.279 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2607_fsm 2024-09-12T02:30:42.279 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2607_vm 2024-09-12T02:30:42.279 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 12 02:15 2608 2024-09-12T02:30:42.279 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2608_fsm 2024-09-12T02:30:42.279 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2608_vm 2024-09-12T02:30:42.279 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 12 02:15 2609 2024-09-12T02:30:42.279 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2609_fsm 2024-09-12T02:30:42.279 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2609_vm 2024-09-12T02:30:42.280 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2610 2024-09-12T02:30:42.280 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2610_fsm 2024-09-12T02:30:42.280 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2610_vm 2024-09-12T02:30:42.280 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2611 2024-09-12T02:30:42.280 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2612 2024-09-12T02:30:42.280 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2612_fsm 2024-09-12T02:30:42.280 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2612_vm 2024-09-12T02:30:42.280 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2613 2024-09-12T02:30:42.280 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2615 2024-09-12T02:30:42.280 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2615_fsm 2024-09-12T02:30:42.281 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2615_vm 2024-09-12T02:30:42.281 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2616 2024-09-12T02:30:42.281 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2616_fsm 2024-09-12T02:30:42.281 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2616_vm 2024-09-12T02:30:42.281 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 12 02:15 2617 2024-09-12T02:30:42.281 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2617_fsm 2024-09-12T02:30:42.281 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2617_vm 2024-09-12T02:30:42.281 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 12 02:15 2618 2024-09-12T02:30:42.281 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2618_fsm 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2618_vm 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 12 02:15 2619 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2619_fsm 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2619_vm 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2620 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2650 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2651 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2652 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2653 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2654 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2655 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2656 2024-09-12T02:30:42.282 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2657 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:15 2658 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:15 2659 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2660 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2661 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2662 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2663 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2664 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2665 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2666 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2667 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2668 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2669 2024-09-12T02:30:42.283 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2670 2024-09-12T02:30:42.284 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 12 02:15 2673 2024-09-12T02:30:42.284 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 12 02:15 2674 2024-09-12T02:30:42.284 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 12 02:15 2675 2024-09-12T02:30:42.284 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2678 2024-09-12T02:30:42.284 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2679 2024-09-12T02:30:42.284 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2680 2024-09-12T02:30:42.284 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2681 2024-09-12T02:30:42.284 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2682 2024-09-12T02:30:42.284 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2683 2024-09-12T02:30:42.284 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2684 2024-09-12T02:30:42.284 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2685 2024-09-12T02:30:42.285 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2686 2024-09-12T02:30:42.285 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2687 2024-09-12T02:30:42.285 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2688 2024-09-12T02:30:42.285 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2689 2024-09-12T02:30:42.285 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 12 02:15 2690 2024-09-12T02:30:42.285 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 12 02:15 2691 2024-09-12T02:30:42.285 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2692 2024-09-12T02:30:42.285 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2693 2024-09-12T02:30:42.285 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2696 2024-09-12T02:30:42.285 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2699 2024-09-12T02:30:42.285 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2701 2024-09-12T02:30:42.285 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2702 2024-09-12T02:30:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2703 2024-09-12T02:30:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2704 2024-09-12T02:30:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2753 2024-09-12T02:30:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2753_fsm 2024-09-12T02:30:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2753_vm 2024-09-12T02:30:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2754 2024-09-12T02:30:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2755 2024-09-12T02:30:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2756 2024-09-12T02:30:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2757 2024-09-12T02:30:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2830 2024-09-12T02:30:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2831 2024-09-12T02:30:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2832 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2833 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2834 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2835 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2836 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2837 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 12 02:15 2838 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2838_fsm 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2838_vm 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2839 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2840 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2840_fsm 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2840_vm 2024-09-12T02:30:42.287 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2841 2024-09-12T02:30:42.288 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2995 2024-09-12T02:30:42.288 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2996 2024-09-12T02:30:42.288 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3079 2024-09-12T02:30:42.288 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3079_fsm 2024-09-12T02:30:42.288 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3079_vm 2024-09-12T02:30:42.288 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3080 2024-09-12T02:30:42.288 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3081 2024-09-12T02:30:42.288 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 3085 2024-09-12T02:30:42.288 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3118 2024-09-12T02:30:42.288 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3119 2024-09-12T02:30:42.288 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:15 3164 2024-09-12T02:30:42.288 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3256 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3257 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3258 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3350 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3351 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3379 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3380 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3381 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3394 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3394_fsm 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3394_vm 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3395 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3429 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3430 2024-09-12T02:30:42.289 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3431 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3433 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3439 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3440 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 3455 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 12 02:15 3456 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3456_fsm 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3456_vm 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3466 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3467 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3468 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3501 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3502 2024-09-12T02:30:42.290 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3503 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3534 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3541 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3541_fsm 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3541_vm 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3542 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3574 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3575 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3576 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3596 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3597 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3598 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3599 2024-09-12T02:30:42.291 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3600 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3600_fsm 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3600_vm 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3601 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3601_fsm 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3601_vm 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3602 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3602_fsm 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3602_vm 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3603 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3603_fsm 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3603_vm 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3604 2024-09-12T02:30:42.292 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3605 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3606 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3607 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3608 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 3609 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3712 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3764 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3764_fsm 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3764_vm 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3766 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3767 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3997 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4143 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4144 2024-09-12T02:30:42.293 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4145 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4146 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4147 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4148 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4149 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4150 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4151 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4152 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4153 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4154 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4155 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4156 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4157 2024-09-12T02:30:42.294 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4158 2024-09-12T02:30:42.295 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4159 2024-09-12T02:30:42.295 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4160 2024-09-12T02:30:42.295 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4161 2024-09-12T02:30:42.295 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4162 2024-09-12T02:30:42.295 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4163 2024-09-12T02:30:42.295 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4164 2024-09-12T02:30:42.295 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4165 2024-09-12T02:30:42.295 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4166 2024-09-12T02:30:42.295 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4167 2024-09-12T02:30:42.295 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4168 2024-09-12T02:30:42.295 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4169 2024-09-12T02:30:42.295 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4170 2024-09-12T02:30:42.296 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4171 2024-09-12T02:30:42.296 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4172 2024-09-12T02:30:42.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4173 2024-09-12T02:30:42.369 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4174 2024-09-12T02:30:42.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 5002 2024-09-12T02:30:42.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 548 2024-09-12T02:30:42.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 549 2024-09-12T02:30:42.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6102 2024-09-12T02:30:42.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6104 2024-09-12T02:30:42.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6106 2024-09-12T02:30:42.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6110 2024-09-12T02:30:42.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6111 2024-09-12T02:30:42.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6112 2024-09-12T02:30:42.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6113 2024-09-12T02:30:42.370 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6117 2024-09-12T02:30:42.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 826 2024-09-12T02:30:42.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 827 2024-09-12T02:30:42.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 828 2024-09-12T02:30:42.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:15 pg_filenode.map 2024-09-12T02:30:42.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 PG_VERSION 2024-09-12T02:30:42.371 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.371 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-12T02:30:42.371 INFO:teuthology.orchestra.run.smithi110.stdout:total 547798 2024-09-12T02:30:42.371 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Sep 12 02:22 . 2024-09-12T02:30:42.371 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 12 02:15 .. 2024-09-12T02:30:42.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 112 2024-09-12T02:30:42.371 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 113 2024-09-12T02:30:42.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:15 1247 2024-09-12T02:30:42.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1247_fsm 2024-09-12T02:30:42.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1247_vm 2024-09-12T02:30:42.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 12 02:15 1249 2024-09-12T02:30:42.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1249_fsm 2024-09-12T02:30:42.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1249_vm 2024-09-12T02:30:42.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 12 02:15 1255 2024-09-12T02:30:42.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1255_fsm 2024-09-12T02:30:42.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1255_vm 2024-09-12T02:30:42.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 12 02:30 1259 2024-09-12T02:30:42.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1259_fsm 2024-09-12T02:30:42.372 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1259_vm 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 12 02:15 13344 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13344_fsm 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13344_vm 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13346 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13348 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13349 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13349_fsm 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13349_vm 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13351 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13353 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13354 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13354_fsm 2024-09-12T02:30:42.373 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13354_vm 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13356 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13358 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13359 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 13359_fsm 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13359_vm 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 13361 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 13363 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 1417 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 1418 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 439934976 Sep 12 02:30 16396 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 12 02:30 16396_fsm 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:24 16396_vm 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Sep 12 02:30 16397 2024-09-12T02:30:42.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:30 16397_fsm 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:30 16397_vm 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Sep 12 02:30 16399 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:30 16399_fsm 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:23 16399_vm 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:30 16400 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:30 16402 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 12 02:30 16404 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 39796736 Sep 12 02:30 16406 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:30 16406_fsm 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:26 16406_vm 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 174 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 175 2024-09-12T02:30:42.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2187 2024-09-12T02:30:42.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2224 2024-09-12T02:30:42.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2328 2024-09-12T02:30:42.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2336 2024-09-12T02:30:42.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2337 2024-09-12T02:30:42.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2579 2024-09-12T02:30:42.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2600 2024-09-12T02:30:42.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2600_fsm 2024-09-12T02:30:42.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2600_vm 2024-09-12T02:30:42.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2601 2024-09-12T02:30:42.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2601_fsm 2024-09-12T02:30:42.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2601_vm 2024-09-12T02:30:42.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2602 2024-09-12T02:30:42.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2602_fsm 2024-09-12T02:30:42.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2602_vm 2024-09-12T02:30:42.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2603 2024-09-12T02:30:42.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2603_fsm 2024-09-12T02:30:42.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2603_vm 2024-09-12T02:30:42.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2604 2024-09-12T02:30:42.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2605 2024-09-12T02:30:42.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2605_fsm 2024-09-12T02:30:42.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2605_vm 2024-09-12T02:30:42.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2606 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2606_fsm 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2606_vm 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2607 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2607_fsm 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2607_vm 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 12 02:15 2608 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2608_fsm 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2608_vm 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 12 02:15 2609 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2609_fsm 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2609_vm 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2610 2024-09-12T02:30:42.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2610_fsm 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2610_vm 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2611 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2612 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2612_fsm 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2612_vm 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2613 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2615 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2615_fsm 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2615_vm 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2616 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2616_fsm 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2616_vm 2024-09-12T02:30:42.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 12 02:15 2617 2024-09-12T02:30:42.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2617_fsm 2024-09-12T02:30:42.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2617_vm 2024-09-12T02:30:42.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 12 02:15 2618 2024-09-12T02:30:42.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2618_fsm 2024-09-12T02:30:42.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2618_vm 2024-09-12T02:30:42.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Sep 12 02:30 2619 2024-09-12T02:30:42.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:18 2619_fsm 2024-09-12T02:30:42.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2619_vm 2024-09-12T02:30:42.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2620 2024-09-12T02:30:42.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2650 2024-09-12T02:30:42.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2651 2024-09-12T02:30:42.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2652 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2653 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2654 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2655 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2656 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2657 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:15 2658 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 12 02:15 2659 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2660 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2661 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2662 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2663 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2664 2024-09-12T02:30:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2665 2024-09-12T02:30:42.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2666 2024-09-12T02:30:42.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2667 2024-09-12T02:30:42.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2668 2024-09-12T02:30:42.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2669 2024-09-12T02:30:42.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2670 2024-09-12T02:30:42.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 12 02:15 2673 2024-09-12T02:30:42.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 12 02:15 2674 2024-09-12T02:30:42.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 12 02:15 2675 2024-09-12T02:30:42.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2678 2024-09-12T02:30:42.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2679 2024-09-12T02:30:42.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2680 2024-09-12T02:30:42.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2681 2024-09-12T02:30:42.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2682 2024-09-12T02:30:42.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2683 2024-09-12T02:30:42.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2684 2024-09-12T02:30:42.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2685 2024-09-12T02:30:42.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2686 2024-09-12T02:30:42.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2687 2024-09-12T02:30:42.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2688 2024-09-12T02:30:42.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 12 02:15 2689 2024-09-12T02:30:42.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 12 02:15 2690 2024-09-12T02:30:42.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 12 02:15 2691 2024-09-12T02:30:42.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2692 2024-09-12T02:30:42.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2693 2024-09-12T02:30:42.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:19 2696 2024-09-12T02:30:42.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2699 2024-09-12T02:30:42.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2701 2024-09-12T02:30:42.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2702 2024-09-12T02:30:42.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2703 2024-09-12T02:30:42.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 2704 2024-09-12T02:30:42.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2753 2024-09-12T02:30:42.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2753_fsm 2024-09-12T02:30:42.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2753_vm 2024-09-12T02:30:42.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2754 2024-09-12T02:30:42.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2755 2024-09-12T02:30:42.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2756 2024-09-12T02:30:42.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 2757 2024-09-12T02:30:42.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2830 2024-09-12T02:30:42.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2831 2024-09-12T02:30:42.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2832 2024-09-12T02:30:42.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2833 2024-09-12T02:30:42.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2834 2024-09-12T02:30:42.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2835 2024-09-12T02:30:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2836 2024-09-12T02:30:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2837 2024-09-12T02:30:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 12 02:15 2838 2024-09-12T02:30:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2838_fsm 2024-09-12T02:30:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2838_vm 2024-09-12T02:30:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2839 2024-09-12T02:30:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2840 2024-09-12T02:30:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2840_fsm 2024-09-12T02:30:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2840_vm 2024-09-12T02:30:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2841 2024-09-12T02:30:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2995 2024-09-12T02:30:42.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2996 2024-09-12T02:30:42.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3079 2024-09-12T02:30:42.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3079_fsm 2024-09-12T02:30:42.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3079_vm 2024-09-12T02:30:42.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3080 2024-09-12T02:30:42.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3081 2024-09-12T02:30:42.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 3085 2024-09-12T02:30:42.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3118 2024-09-12T02:30:42.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3119 2024-09-12T02:30:42.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 12 02:15 3164 2024-09-12T02:30:42.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3256 2024-09-12T02:30:42.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3257 2024-09-12T02:30:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3258 2024-09-12T02:30:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3350 2024-09-12T02:30:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3351 2024-09-12T02:30:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3379 2024-09-12T02:30:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3380 2024-09-12T02:30:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3381 2024-09-12T02:30:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3394 2024-09-12T02:30:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3394_fsm 2024-09-12T02:30:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3394_vm 2024-09-12T02:30:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3395 2024-09-12T02:30:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3429 2024-09-12T02:30:42.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3430 2024-09-12T02:30:42.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3431 2024-09-12T02:30:42.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3433 2024-09-12T02:30:42.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3439 2024-09-12T02:30:42.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3440 2024-09-12T02:30:42.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 12 02:15 3455 2024-09-12T02:30:42.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 12 02:15 3456 2024-09-12T02:30:42.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3456_fsm 2024-09-12T02:30:42.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3456_vm 2024-09-12T02:30:42.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3466 2024-09-12T02:30:42.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3467 2024-09-12T02:30:42.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3468 2024-09-12T02:30:42.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3501 2024-09-12T02:30:42.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3502 2024-09-12T02:30:42.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3503 2024-09-12T02:30:42.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3534 2024-09-12T02:30:42.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3541 2024-09-12T02:30:42.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3541_fsm 2024-09-12T02:30:42.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3541_vm 2024-09-12T02:30:42.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3542 2024-09-12T02:30:42.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3574 2024-09-12T02:30:42.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3575 2024-09-12T02:30:42.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3576 2024-09-12T02:30:42.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3596 2024-09-12T02:30:42.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3597 2024-09-12T02:30:42.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3598 2024-09-12T02:30:42.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3599 2024-09-12T02:30:42.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3600 2024-09-12T02:30:42.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3600_fsm 2024-09-12T02:30:42.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3600_vm 2024-09-12T02:30:42.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3601 2024-09-12T02:30:42.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3601_fsm 2024-09-12T02:30:42.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3601_vm 2024-09-12T02:30:42.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3602 2024-09-12T02:30:42.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3602_fsm 2024-09-12T02:30:42.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3602_vm 2024-09-12T02:30:42.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3603 2024-09-12T02:30:42.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3603_fsm 2024-09-12T02:30:42.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3603_vm 2024-09-12T02:30:42.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3604 2024-09-12T02:30:42.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3605 2024-09-12T02:30:42.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3606 2024-09-12T02:30:42.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3607 2024-09-12T02:30:42.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3608 2024-09-12T02:30:42.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 12 02:15 3609 2024-09-12T02:30:42.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3712 2024-09-12T02:30:42.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3764 2024-09-12T02:30:42.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 3764_fsm 2024-09-12T02:30:42.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3764_vm 2024-09-12T02:30:42.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3766 2024-09-12T02:30:42.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 3767 2024-09-12T02:30:42.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3997 2024-09-12T02:30:42.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4143 2024-09-12T02:30:42.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4144 2024-09-12T02:30:42.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4145 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4146 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4147 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4148 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4149 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4150 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4151 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4152 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4153 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4154 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4155 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4156 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4157 2024-09-12T02:30:42.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4158 2024-09-12T02:30:42.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4159 2024-09-12T02:30:42.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4160 2024-09-12T02:30:42.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4161 2024-09-12T02:30:42.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4162 2024-09-12T02:30:42.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4163 2024-09-12T02:30:42.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4164 2024-09-12T02:30:42.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4165 2024-09-12T02:30:42.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4166 2024-09-12T02:30:42.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4167 2024-09-12T02:30:42.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4168 2024-09-12T02:30:42.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4169 2024-09-12T02:30:42.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4170 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4171 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4172 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4173 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4174 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 5002 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 548 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 549 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6102 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6104 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6106 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6110 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6111 2024-09-12T02:30:42.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6112 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6113 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6117 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 826 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 827 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 828 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:15 pg_filenode.map 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 12 02:15 pg_internal.init 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:15 PG_VERSION 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:30:42.399 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Sep 12 02:15 .. 2024-09-12T02:30:42.400 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.400 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/global: 2024-09-12T02:30:42.400 INFO:teuthology.orchestra.run.smithi110.stdout:total 560 2024-09-12T02:30:42.400 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Sep 12 02:15 . 2024-09-12T02:30:42.400 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1213 2024-09-12T02:30:42.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1213_fsm 2024-09-12T02:30:42.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1213_vm 2024-09-12T02:30:42.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1214 2024-09-12T02:30:42.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1214_fsm 2024-09-12T02:30:42.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1214_vm 2024-09-12T02:30:42.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 1232 2024-09-12T02:30:42.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 1233 2024-09-12T02:30:42.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1260 2024-09-12T02:30:42.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1260_fsm 2024-09-12T02:30:42.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1260_vm 2024-09-12T02:30:42.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1261 2024-09-12T02:30:42.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1261_fsm 2024-09-12T02:30:42.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1261_vm 2024-09-12T02:30:42.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1262 2024-09-12T02:30:42.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 1262_fsm 2024-09-12T02:30:42.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 1262_vm 2024-09-12T02:30:42.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2396 2024-09-12T02:30:42.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 12 02:15 2396_fsm 2024-09-12T02:30:42.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2396_vm 2024-09-12T02:30:42.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2397 2024-09-12T02:30:42.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2671 2024-09-12T02:30:42.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2672 2024-09-12T02:30:42.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2676 2024-09-12T02:30:42.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2677 2024-09-12T02:30:42.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2694 2024-09-12T02:30:42.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2695 2024-09-12T02:30:42.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2697 2024-09-12T02:30:42.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 12 02:15 2698 2024-09-12T02:30:42.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2846 2024-09-12T02:30:42.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2847 2024-09-12T02:30:42.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2964 2024-09-12T02:30:42.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2965 2024-09-12T02:30:42.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 2966 2024-09-12T02:30:42.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 2967 2024-09-12T02:30:42.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 3592 2024-09-12T02:30:42.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 3593 2024-09-12T02:30:42.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4060 2024-09-12T02:30:42.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4061 2024-09-12T02:30:42.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4175 2024-09-12T02:30:42.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4176 2024-09-12T02:30:42.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4177 2024-09-12T02:30:42.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4178 2024-09-12T02:30:42.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4181 2024-09-12T02:30:42.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4182 2024-09-12T02:30:42.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4183 2024-09-12T02:30:42.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4184 2024-09-12T02:30:42.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 4185 2024-09-12T02:30:42.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 4186 2024-09-12T02:30:42.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6000 2024-09-12T02:30:42.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6001 2024-09-12T02:30:42.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6002 2024-09-12T02:30:42.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 6100 2024-09-12T02:30:42.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6114 2024-09-12T02:30:42.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 6115 2024-09-12T02:30:42.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:30 pg_control 2024-09-12T02:30:42.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 12 02:15 pg_filenode.map 2024-09-12T02:30:42.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 12 02:15 pg_internal.init 2024-09-12T02:30:42.407 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.407 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/log: 2024-09-12T02:30:42.407 INFO:teuthology.orchestra.run.smithi110.stdout:total 2 2024-09-12T02:30:42.407 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 . 2024-09-12T02:30:42.407 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1118 Sep 12 02:30 postgresql-Thu.log 2024-09-12T02:30:42.407 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.408 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-12T02:30:42.408 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.408 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:30:42.408 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.408 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.408 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-12T02:30:42.408 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.408 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:30:42.408 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.409 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.409 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-12T02:30:42.409 INFO:teuthology.orchestra.run.smithi110.stdout:total 1 2024-09-12T02:30:42.409 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:30 . 2024-09-12T02:30:42.409 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.409 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 mappings 2024-09-12T02:30:42.409 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 12 02:30 replorigin_checkpoint 2024-09-12T02:30:42.409 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 snapshots 2024-09-12T02:30:42.409 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.409 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-12T02:30:42.410 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.410 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:30:42.410 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:30 .. 2024-09-12T02:30:42.410 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.410 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-12T02:30:42.410 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.410 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:30:42.411 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:30 .. 2024-09-12T02:30:42.411 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.411 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-12T02:30:42.411 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.412 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:15 . 2024-09-12T02:30:42.412 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.412 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 members 2024-09-12T02:30:42.412 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 offsets 2024-09-12T02:30:42.412 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.412 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-12T02:30:42.412 INFO:teuthology.orchestra.run.smithi110.stdout:total 8 2024-09-12T02:30:42.412 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 . 2024-09-12T02:30:42.412 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:15 .. 2024-09-12T02:30:42.412 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:15 0000 2024-09-12T02:30:42.413 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.413 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-12T02:30:42.413 INFO:teuthology.orchestra.run.smithi110.stdout:total 8 2024-09-12T02:30:42.413 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 . 2024-09-12T02:30:42.413 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Sep 12 02:15 .. 2024-09-12T02:30:42.413 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 12 02:20 0000 2024-09-12T02:30:42.413 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.413 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-12T02:30:42.413 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.414 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:30:42.414 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.414 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.414 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-12T02:30:42.414 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.414 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:30:42.414 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.414 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.414 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-12T02:30:42.414 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.414 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:30:42.414 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.415 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.415 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-12T02:30:42.415 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.415 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:30:42.415 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.415 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.415 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-12T02:30:42.415 INFO:teuthology.orchestra.run.smithi110.stdout:total 15 2024-09-12T02:30:42.415 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 12 02:30 . 2024-09-12T02:30:42.415 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.415 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 12 02:30 db_0.stat 2024-09-12T02:30:42.416 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 12 02:30 db_13494.stat 2024-09-12T02:30:42.416 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 12 02:30 global.stat 2024-09-12T02:30:42.416 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.416 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-12T02:30:42.416 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.416 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:30 . 2024-09-12T02:30:42.416 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.416 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.416 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-12T02:30:42.416 INFO:teuthology.orchestra.run.smithi110.stdout:total 120 2024-09-12T02:30:42.417 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:30 . 2024-09-12T02:30:42.417 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.417 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 12 02:30 000B 2024-09-12T02:30:42.417 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.417 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-12T02:30:42.417 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.417 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:30:42.417 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.417 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.417 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-12T02:30:42.417 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.418 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:30:42.418 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.418 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.418 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-12T02:30:42.418 INFO:teuthology.orchestra.run.smithi110.stdout:total 917504 2024-09-12T02:30:42.418 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 12 02:30 . 2024-09-12T02:30:42.418 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.418 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:30 000000010000000000000064 2024-09-12T02:30:42.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:20 000000010000000000000065 2024-09-12T02:30:42.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:23 000000010000000000000066 2024-09-12T02:30:42.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:20 000000010000000000000067 2024-09-12T02:30:42.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:22 000000010000000000000068 2024-09-12T02:30:42.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:21 000000010000000000000069 2024-09-12T02:30:42.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:20 00000001000000000000006A 2024-09-12T02:30:42.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:24 00000001000000000000006B 2024-09-12T02:30:42.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:24 00000001000000000000006C 2024-09-12T02:30:42.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:21 00000001000000000000006D 2024-09-12T02:30:42.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:21 00000001000000000000006E 2024-09-12T02:30:42.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:23 00000001000000000000006F 2024-09-12T02:30:42.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:22 000000010000000000000070 2024-09-12T02:30:42.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:23 000000010000000000000071 2024-09-12T02:30:42.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:20 000000010000000000000072 2024-09-12T02:30:42.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:20 000000010000000000000073 2024-09-12T02:30:42.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:20 000000010000000000000074 2024-09-12T02:30:42.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:21 000000010000000000000075 2024-09-12T02:30:42.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:20 000000010000000000000076 2024-09-12T02:30:42.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:25 000000010000000000000077 2024-09-12T02:30:42.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:20 000000010000000000000078 2024-09-12T02:30:42.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:21 000000010000000000000079 2024-09-12T02:30:42.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:21 00000001000000000000007A 2024-09-12T02:30:42.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:20 00000001000000000000007B 2024-09-12T02:30:42.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:22 00000001000000000000007C 2024-09-12T02:30:42.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:21 00000001000000000000007D 2024-09-12T02:30:42.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:20 00000001000000000000007E 2024-09-12T02:30:42.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:20 00000001000000000000007F 2024-09-12T02:30:42.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:25 000000010000000000000080 2024-09-12T02:30:42.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:27 000000010000000000000081 2024-09-12T02:30:42.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:25 000000010000000000000082 2024-09-12T02:30:42.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:26 000000010000000000000083 2024-09-12T02:30:42.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:27 000000010000000000000084 2024-09-12T02:30:42.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:27 000000010000000000000085 2024-09-12T02:30:42.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:25 000000010000000000000086 2024-09-12T02:30:42.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:26 000000010000000000000087 2024-09-12T02:30:42.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:28 000000010000000000000088 2024-09-12T02:30:42.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:26 000000010000000000000089 2024-09-12T02:30:42.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:29 00000001000000000000008A 2024-09-12T02:30:42.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:26 00000001000000000000008B 2024-09-12T02:30:42.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:27 00000001000000000000008C 2024-09-12T02:30:42.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:25 00000001000000000000008D 2024-09-12T02:30:42.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:27 00000001000000000000008E 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:26 00000001000000000000008F 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:27 000000010000000000000090 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:28 000000010000000000000091 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:25 000000010000000000000092 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:25 000000010000000000000093 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:26 000000010000000000000094 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:26 000000010000000000000095 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:29 000000010000000000000096 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:26 000000010000000000000097 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:25 000000010000000000000098 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:25 000000010000000000000099 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:25 00000001000000000000009A 2024-09-12T02:30:42.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 12 02:28 00000001000000000000009B 2024-09-12T02:30:42.424 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 archive_status 2024-09-12T02:30:42.424 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.424 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-12T02:30:42.424 INFO:teuthology.orchestra.run.smithi110.stdout:total 0 2024-09-12T02:30:42.424 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 12 02:15 . 2024-09-12T02:30:42.424 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Sep 12 02:30 .. 2024-09-12T02:30:42.424 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:42.424 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-12T02:30:42.424 INFO:teuthology.orchestra.run.smithi110.stdout:total 184 2024-09-12T02:30:42.424 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Sep 12 02:15 . 2024-09-12T02:30:42.424 INFO:teuthology.orchestra.run.smithi110.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Sep 12 02:30 .. 2024-09-12T02:30:42.424 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 188416 Sep 12 02:30 0000 2024-09-12T02:30:42.426 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-12T02:30:42.437 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-12T02:30:42.437 INFO:teuthology.task.exec:Executing custom commands... 2024-09-12T02:30:42.437 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T02:30:42.437 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-12T02:30:42.537 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-12T02:30:42.598 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-12T02:30:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.017+0000 7f9689800640 1 -- 172.21.15.110:0/2664330391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9684104900 msgr2=0x7f9684108940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.017+0000 7f9689800640 1 --2- 172.21.15.110:0/2664330391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9684104900 0x7f9684108940 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f966c009900 tx=0x7f966c02a3f0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.017+0000 7f9689800640 1 -- 172.21.15.110:0/2664330391 shutdown_connections 2024-09-12T02:30:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.017+0000 7f9689800640 1 --2- 172.21.15.110:0/2664330391 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96841090a0 0x7f9684110bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.017+0000 7f9689800640 1 --2- 172.21.15.110:0/2664330391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9684104900 0x7f9684108940 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.017+0000 7f9689800640 1 --2- 172.21.15.110:0/2664330391 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9684103f50 0x7f9684104330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.017+0000 7f9689800640 1 -- 172.21.15.110:0/2664330391 >> 172.21.15.110:0/2664330391 conn(0x7f96840ff9e0 msgr2=0x7f9684101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.017+0000 7f9689800640 1 -- 172.21.15.110:0/2664330391 shutdown_connections 2024-09-12T02:30:43.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.017+0000 7f9689800640 1 -- 172.21.15.110:0/2664330391 wait complete. 2024-09-12T02:30:43.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f9689800640 1 Processor -- start 2024-09-12T02:30:43.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f9689800640 1 -- start start 2024-09-12T02:30:43.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f9689800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9684103f50 0x7f968419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f9689800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96841090a0 0x7f968419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f9689800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f968419ee60 0x7f968419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f9689800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9684114110 con 0x7f96841090a0 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f9689800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9684113f90 con 0x7f968419ee60 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f9689800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9684114290 con 0x7f9684103f50 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f9682a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9684103f50 0x7f968419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f967a000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96841090a0 0x7f968419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f9682a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9684103f50 0x7f968419a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:47434/0 (socket says 172.21.15.110:47434) 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f9682a00640 1 -- 172.21.15.110:0/411230286 learned_addr learned my addr 172.21.15.110:0/411230286 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.018+0000 7f9683400640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f968419ee60 0x7f968419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.019+0000 7f967a000640 1 -- 172.21.15.110:0/411230286 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9684103f50 msgr2=0x7f968419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.019+0000 7f967a000640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9684103f50 0x7f968419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.019+0000 7f967a000640 1 -- 172.21.15.110:0/411230286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f968419ee60 msgr2=0x7f968419f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.019+0000 7f967a000640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f968419ee60 0x7f968419f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.019+0000 7f967a000640 1 -- 172.21.15.110:0/411230286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968419f950 con 0x7f96841090a0 2024-09-12T02:30:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.019+0000 7f9682a00640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9684103f50 0x7f968419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.019+0000 7f967a000640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96841090a0 0x7f968419aae0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f966c02a910 tx=0x7f966c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.019+0000 7f967be00640 1 -- 172.21.15.110:0/411230286 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c03f070 con 0x7f96841090a0 2024-09-12T02:30:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.020+0000 7f967be00640 1 -- 172.21.15.110:0/411230286 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f966c031c90 con 0x7f96841090a0 2024-09-12T02:30:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.020+0000 7f967be00640 1 -- 172.21.15.110:0/411230286 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c035030 con 0x7f96841090a0 2024-09-12T02:30:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.020+0000 7f9689800640 1 -- 172.21.15.110:0/411230286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968419fbe0 con 0x7f96841090a0 2024-09-12T02:30:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.020+0000 7f9689800640 1 -- 172.21.15.110:0/411230286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96841a7400 con 0x7f96841090a0 2024-09-12T02:30:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.021+0000 7f9689800640 1 -- 172.21.15.110:0/411230286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9684104330 con 0x7f96841090a0 2024-09-12T02:30:43.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.022+0000 7f967be00640 1 -- 172.21.15.110:0/411230286 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f966c042070 con 0x7f96841090a0 2024-09-12T02:30:43.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.024+0000 7f967be00640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f96680a2e20 0x7f96680a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.024+0000 7f967be00640 1 -- 172.21.15.110:0/411230286 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9504+0+0 (secure 0 0 0) 0x7f966c0efde0 con 0x7f96841090a0 2024-09-12T02:30:43.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.025+0000 7f9682a00640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f96680a2e20 0x7f96680a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.025+0000 7f9682a00640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f96680a2e20 0x7f96680a52e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9674005fd0 tx=0x7f967400b4a0 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:43.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.028+0000 7f967be00640 1 -- 172.21.15.110:0/411230286 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f966c0bbfa0 con 0x7f96841090a0 2024-09-12T02:30:43.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.220+0000 7f9689800640 1 -- 172.21.15.110:0/411230286 --> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f9684104990 con 0x7f96680a2e20 2024-09-12T02:30:43.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.228+0000 7f967be00640 1 -- 172.21.15.110:0/411230286 <== mgr.15147 v2:172.21.15.110:6800/1913988278 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f9684104990 con 0x7f96680a2e20 2024-09-12T02:30:43.229 INFO:teuthology.orchestra.run.smithi110.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-12T00:00:00", "created": "2024-09-12T02:15:04", "first": "2024-09-12T02:16:00", "last": "2024-09-12T02:30:00", "last_pruned": "2024-09-12T02:30:00", "created_count": 15, "pruned_count": 9, "active": true} 2024-09-12T02:30:43.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.230+0000 7f9689800640 1 -- 172.21.15.110:0/411230286 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f96680a2e20 msgr2=0x7f96680a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.230+0000 7f9689800640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f96680a2e20 0x7f96680a52e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9674005fd0 tx=0x7f967400b4a0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.230+0000 7f9689800640 1 -- 172.21.15.110:0/411230286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96841090a0 msgr2=0x7f968419aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.230+0000 7f9689800640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96841090a0 0x7f968419aae0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f966c02a910 tx=0x7f966c003b90 comp rx=0 tx=0).stop 2024-09-12T02:30:43.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.230+0000 7f9689800640 1 -- 172.21.15.110:0/411230286 shutdown_connections 2024-09-12T02:30:43.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.230+0000 7f9689800640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f96680a2e20 0x7f96680a52e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.230+0000 7f9689800640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f968419ee60 0x7f968419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.230+0000 7f9689800640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96841090a0 0x7f968419aae0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.230+0000 7f9689800640 1 --2- 172.21.15.110:0/411230286 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9684103f50 0x7f968419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.230+0000 7f9689800640 1 -- 172.21.15.110:0/411230286 >> 172.21.15.110:0/411230286 conn(0x7f96840ff9e0 msgr2=0x7f9684101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:43.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.231+0000 7f9689800640 1 -- 172.21.15.110:0/411230286 shutdown_connections 2024-09-12T02:30:43.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.231+0000 7f9689800640 1 -- 172.21.15.110:0/411230286 wait complete. 2024-09-12T02:30:43.249 DEBUG:teuthology.orchestra.run.smithi110:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-12T02:30:43.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.402+0000 7f7993c00640 1 -- 172.21.15.110:0/2357666688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f798c107b80 msgr2=0x7f798c107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.402+0000 7f7993c00640 1 --2- 172.21.15.110:0/2357666688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f798c107b80 0x7f798c107f60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7974009930 tx=0x7f797402a420 comp rx=0 tx=0).stop 2024-09-12T02:30:43.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.402+0000 7f7993c00640 1 -- 172.21.15.110:0/2357666688 shutdown_connections 2024-09-12T02:30:43.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.402+0000 7f7993c00640 1 --2- 172.21.15.110:0/2357666688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798c102480 0x7f798c10e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.402+0000 7f7993c00640 1 --2- 172.21.15.110:0/2357666688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f798c101ae0 0x7f798c101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.402+0000 7f7993c00640 1 --2- 172.21.15.110:0/2357666688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f798c107b80 0x7f798c107f60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.402+0000 7f7993c00640 1 -- 172.21.15.110:0/2357666688 >> 172.21.15.110:0/2357666688 conn(0x7f798c0fd7e0 msgr2=0x7f798c0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:43.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.402+0000 7f7993c00640 1 -- 172.21.15.110:0/2357666688 shutdown_connections 2024-09-12T02:30:43.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.402+0000 7f7993c00640 1 -- 172.21.15.110:0/2357666688 wait complete. 2024-09-12T02:30:43.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.403+0000 7f7993c00640 1 Processor -- start 2024-09-12T02:30:43.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.403+0000 7f7993c00640 1 -- start start 2024-09-12T02:30:43.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.403+0000 7f7993c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f798c101ae0 0x7f798c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.403+0000 7f7993c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f798c102480 0x7f798c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.403+0000 7f7993c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798c107b80 0x7f798c19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.403+0000 7f7993c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f798c111f80 con 0x7f798c102480 2024-09-12T02:30:43.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.403+0000 7f7993c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f798c111e00 con 0x7f798c107b80 2024-09-12T02:30:43.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.403+0000 7f7993c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f798c112100 con 0x7f798c101ae0 2024-09-12T02:30:43.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.403+0000 7f7991200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f798c101ae0 0x7f798c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.403+0000 7f798be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f798c102480 0x7f798c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.406 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.403+0000 7f7991200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f798c101ae0 0x7f798c19a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:47444/0 (socket says 172.21.15.110:47444) 2024-09-12T02:30:43.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.403+0000 7f7991200640 1 -- 172.21.15.110:0/2465141389 learned_addr learned my addr 172.21.15.110:0/2465141389 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:30:43.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.404+0000 7f7991c00640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798c107b80 0x7f798c19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.404+0000 7f7991200640 1 -- 172.21.15.110:0/2465141389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798c107b80 msgr2=0x7f798c19ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.404+0000 7f7991200640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798c107b80 0x7f798c19ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.404+0000 7f7991200640 1 -- 172.21.15.110:0/2465141389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f798c102480 msgr2=0x7f798c19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.404+0000 7f7991200640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f798c102480 0x7f798c19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.404+0000 7f7991200640 1 -- 172.21.15.110:0/2465141389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798c19f560 con 0x7f798c101ae0 2024-09-12T02:30:43.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.404+0000 7f798be00640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f798c102480 0x7f798c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:43.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.404+0000 7f7991200640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f798c101ae0 0x7f798c19a570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f797402a940 tx=0x7f7974003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:43.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.404+0000 7f7989600640 1 -- 172.21.15.110:0/2465141389 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797403f070 con 0x7f798c101ae0 2024-09-12T02:30:43.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.404+0000 7f7993c00640 1 -- 172.21.15.110:0/2465141389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f798c19f7f0 con 0x7f798c101ae0 2024-09-12T02:30:43.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.404+0000 7f7989600640 1 -- 172.21.15.110:0/2465141389 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7974031c90 con 0x7f798c101ae0 2024-09-12T02:30:43.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.404+0000 7f7989600640 1 -- 172.21.15.110:0/2465141389 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7974035030 con 0x7f798c101ae0 2024-09-12T02:30:43.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.405+0000 7f7993c00640 1 -- 172.21.15.110:0/2465141389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f798c1a70e0 con 0x7f798c101ae0 2024-09-12T02:30:43.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.405+0000 7f7993c00640 1 -- 172.21.15.110:0/2465141389 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f798c101f40 con 0x7f798c101ae0 2024-09-12T02:30:43.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.407+0000 7f7989600640 1 -- 172.21.15.110:0/2465141389 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f7974042070 con 0x7f798c101ae0 2024-09-12T02:30:43.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.409+0000 7f7989600640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f79700a2da0 0x7f79700a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.409+0000 7f7989600640 1 -- 172.21.15.110:0/2465141389 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9504+0+0 (secure 0 0 0) 0x7f79740effd0 con 0x7f798c101ae0 2024-09-12T02:30:43.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.409+0000 7f798be00640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f79700a2da0 0x7f79700a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.409+0000 7f798be00640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f79700a2da0 0x7f79700a5260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f798c10ee40 tx=0x7f797c005f90 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:43.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.411+0000 7f7989600640 1 -- 172.21.15.110:0/2465141389 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79740bc190 con 0x7f798c101ae0 2024-09-12T02:30:43.545 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:43 smithi115 ceph-mon[35351]: pgmap v491: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 4.6 MiB/s wr, 534 op/s 2024-09-12T02:30:43.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.604+0000 7f7993c00640 1 -- 172.21.15.110:0/2465141389 --> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f798c0fe450 con 0x7f79700a2da0 2024-09-12T02:30:43.612 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.612+0000 7f7989600640 1 -- 172.21.15.110:0/2465141389 <== mgr.15147 v2:172.21.15.110:6800/1913988278 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f798c0fe450 con 0x7f79700a2da0 2024-09-12T02:30:43.613 INFO:teuthology.orchestra.run.smithi110.stdout:/ 1m 6m3h 2024-09-12T02:30:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.614+0000 7f7993c00640 1 -- 172.21.15.110:0/2465141389 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f79700a2da0 msgr2=0x7f79700a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.614+0000 7f7993c00640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f79700a2da0 0x7f79700a5260 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f798c10ee40 tx=0x7f797c005f90 comp rx=0 tx=0).stop 2024-09-12T02:30:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.614+0000 7f7993c00640 1 -- 172.21.15.110:0/2465141389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f798c101ae0 msgr2=0x7f798c19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.614+0000 7f7993c00640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f798c101ae0 0x7f798c19a570 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f797402a940 tx=0x7f7974003b20 comp rx=0 tx=0).stop 2024-09-12T02:30:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.614+0000 7f7993c00640 1 -- 172.21.15.110:0/2465141389 shutdown_connections 2024-09-12T02:30:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.614+0000 7f7993c00640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f79700a2da0 0x7f79700a5260 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.614+0000 7f7993c00640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f798c107b80 0x7f798c19ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.614+0000 7f7993c00640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f798c102480 0x7f798c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.614+0000 7f7993c00640 1 --2- 172.21.15.110:0/2465141389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f798c101ae0 0x7f798c19a570 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.614+0000 7f7993c00640 1 -- 172.21.15.110:0/2465141389 >> 172.21.15.110:0/2465141389 conn(0x7f798c0fd7e0 msgr2=0x7f798c0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.614+0000 7f7993c00640 1 -- 172.21.15.110:0/2465141389 shutdown_connections 2024-09-12T02:30:43.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.614+0000 7f7993c00640 1 -- 172.21.15.110:0/2465141389 wait complete. 2024-09-12T02:30:43.628 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:43 smithi110 ceph-mon[30548]: pgmap v491: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 4.6 MiB/s wr, 534 op/s 2024-09-12T02:30:43.630 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-12T02:30:43.642 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T02:30:43.658 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:43 smithi136 ceph-mon[35814]: pgmap v491: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 4.6 MiB/s wr, 534 op/s 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.821+0000 7ff1e3200640 1 -- 172.21.15.110:0/3359341091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1dc1048c0 msgr2=0x7ff1dc108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.821+0000 7ff1e3200640 1 --2- 172.21.15.110:0/3359341091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1dc1048c0 0x7ff1dc108900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009900 tx=0x7ff1c802a410 comp rx=0 tx=0).stop 2024-09-12T02:30:43.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.821+0000 7ff1e3200640 1 -- 172.21.15.110:0/3359341091 shutdown_connections 2024-09-12T02:30:43.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.821+0000 7ff1e3200640 1 --2- 172.21.15.110:0/3359341091 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1dc109060 0x7ff1dc110bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.821+0000 7ff1e3200640 1 --2- 172.21.15.110:0/3359341091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1dc1048c0 0x7ff1dc108900 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.821+0000 7ff1e3200640 1 --2- 172.21.15.110:0/3359341091 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1dc103f10 0x7ff1dc1042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.821+0000 7ff1e3200640 1 -- 172.21.15.110:0/3359341091 >> 172.21.15.110:0/3359341091 conn(0x7ff1dc0ff980 msgr2=0x7ff1dc101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:43.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.821+0000 7ff1e3200640 1 -- 172.21.15.110:0/3359341091 shutdown_connections 2024-09-12T02:30:43.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.821+0000 7ff1e3200640 1 -- 172.21.15.110:0/3359341091 wait complete. 2024-09-12T02:30:43.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.822+0000 7ff1e3200640 1 Processor -- start 2024-09-12T02:30:43.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.822+0000 7ff1e3200640 1 -- start start 2024-09-12T02:30:43.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1e3200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1dc103f10 0x7ff1dc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1e3200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1dc109060 0x7ff1dc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1e3200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1dc19eea0 0x7ff1dc19f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1e3200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc1140d0 con 0x7ff1dc19eea0 2024-09-12T02:30:43.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1e3200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc113f50 con 0x7ff1dc109060 2024-09-12T02:30:43.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1e3200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc114250 con 0x7ff1dc103f10 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1dbe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1dc103f10 0x7ff1dc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1dbe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1dc103f10 0x7ff1dc19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:47450/0 (socket says 172.21.15.110:47450) 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1dbe00640 1 -- 172.21.15.110:0/201841138 learned_addr learned my addr 172.21.15.110:0/201841138 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1e1200640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1dc19eea0 0x7ff1dc19f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1db400640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1dc109060 0x7ff1dc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1dbe00640 1 -- 172.21.15.110:0/201841138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1dc109060 msgr2=0x7ff1dc19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1dbe00640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1dc109060 0x7ff1dc19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1dbe00640 1 -- 172.21.15.110:0/201841138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1dc19eea0 msgr2=0x7ff1dc19f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1dbe00640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1dc19eea0 0x7ff1dc19f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.823+0000 7ff1dbe00640 1 -- 172.21.15.110:0/201841138 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1dc19f990 con 0x7ff1dc103f10 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.824+0000 7ff1dbe00640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1dc103f10 0x7ff1dc19a5e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00d950 tx=0x7ff1cc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.824+0000 7ff1d8c00640 1 -- 172.21.15.110:0/201841138 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc017030 con 0x7ff1dc103f10 2024-09-12T02:30:43.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.824+0000 7ff1d8c00640 1 -- 172.21.15.110:0/201841138 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1cc004020 con 0x7ff1dc103f10 2024-09-12T02:30:43.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.824+0000 7ff1d8c00640 1 -- 172.21.15.110:0/201841138 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0047a0 con 0x7ff1dc103f10 2024-09-12T02:30:43.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.824+0000 7ff1e3200640 1 -- 172.21.15.110:0/201841138 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1dc19fc80 con 0x7ff1dc103f10 2024-09-12T02:30:43.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.824+0000 7ff1e3200640 1 -- 172.21.15.110:0/201841138 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1dc1a7440 con 0x7ff1dc103f10 2024-09-12T02:30:43.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.825+0000 7ff1e3200640 1 -- 172.21.15.110:0/201841138 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1dc1042f0 con 0x7ff1dc103f10 2024-09-12T02:30:43.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.827+0000 7ff1d8c00640 1 -- 172.21.15.110:0/201841138 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7ff1cc0041d0 con 0x7ff1dc103f10 2024-09-12T02:30:43.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.828+0000 7ff1d8c00640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7ff1c00a2d00 0x7ff1c00a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:43.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.828+0000 7ff1d8c00640 1 -- 172.21.15.110:0/201841138 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9504+0+0 (secure 0 0 0) 0x7ff1cc0cf3b0 con 0x7ff1dc103f10 2024-09-12T02:30:43.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.829+0000 7ff1db400640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7ff1c00a2d00 0x7ff1c00a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:43.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.829+0000 7ff1db400640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7ff1c00a2d00 0x7ff1c00a51c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8006010 tx=0x7ff1c8000bc0 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:43.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:43.830+0000 7ff1d8c00640 1 -- 172.21.15.110:0/201841138 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff1cc09bbc0 con 0x7ff1dc103f10 2024-09-12T02:30:44.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.009+0000 7ff1e3200640 1 -- 172.21.15.110:0/201841138 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1dc10c2d0 con 0x7ff1dc103f10 2024-09-12T02:30:44.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.012+0000 7ff1d8c00640 1 -- 172.21.15.110:0/201841138 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+25506 (secure 0 0 0) 0x7ff1cc09b4c0 con 0x7ff1dc103f10 2024-09-12T02:30:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:44.013 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":116,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:30:10.506736+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:12:08.596125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:12:11.312393+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":115,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:12:21.215161+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":115,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3294226687":"2024-09-13T02:15:01.680986+0000","172.21.15.110:6801/511769794":"2024-09-13T02:15:01.680986+0000","172.21.15.110:6800/511769794":"2024-09-13T02:15:01.680986+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/1555464732":"2024-09-13T02:15:01.680986+0000","172.21.15.110:0/1450306336":"2024-09-13T02:15:01.680986+0000","172.21.15.110:0/2937283686":"2024-09-13T02:15:01.680986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":12,"length":1},{"begin":25,"length":1}]},{"pool":4,"snaps":[{"begin":12,"length":1},{"begin":25,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:30:44.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.014+0000 7ff1e3200640 1 -- 172.21.15.110:0/201841138 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7ff1c00a2d00 msgr2=0x7ff1c00a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.014+0000 7ff1e3200640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7ff1c00a2d00 0x7ff1c00a51c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8006010 tx=0x7ff1c8000bc0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.014+0000 7ff1e3200640 1 -- 172.21.15.110:0/201841138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1dc103f10 msgr2=0x7ff1dc19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.014+0000 7ff1e3200640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1dc103f10 0x7ff1dc19a5e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00d950 tx=0x7ff1cc00de10 comp rx=0 tx=0).stop 2024-09-12T02:30:44.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.014+0000 7ff1e3200640 1 -- 172.21.15.110:0/201841138 shutdown_connections 2024-09-12T02:30:44.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.014+0000 7ff1e3200640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7ff1c00a2d00 0x7ff1c00a51c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.014+0000 7ff1e3200640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1dc19eea0 0x7ff1dc19f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.014+0000 7ff1e3200640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff1dc109060 0x7ff1dc19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.014+0000 7ff1e3200640 1 --2- 172.21.15.110:0/201841138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff1dc103f10 0x7ff1dc19a5e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.014+0000 7ff1e3200640 1 -- 172.21.15.110:0/201841138 >> 172.21.15.110:0/201841138 conn(0x7ff1dc0ff980 msgr2=0x7ff1dc100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:44.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.014+0000 7ff1e3200640 1 -- 172.21.15.110:0/201841138 shutdown_connections 2024-09-12T02:30:44.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.014+0000 7ff1e3200640 1 -- 172.21.15.110:0/201841138 wait complete. 2024-09-12T02:30:44.031 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T02:07:07.945973+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T02:12:08.596125+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T02:12:11.312393+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 25, 'snap_epoch': 115, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-12T02:12:21.215161+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 25, 'snap_epoch': 115, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-12T02:30:44.032 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T02:30:44.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.204+0000 7fde16800640 1 -- 172.21.15.110:0/1807233195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde10074ee0 msgr2=0x7fde1010dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.204+0000 7fde16800640 1 --2- 172.21.15.110:0/1807233195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde10074ee0 0x7fde1010dde0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009900 tx=0x7fddfc02a480 comp rx=0 tx=0).stop 2024-09-12T02:30:44.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.204+0000 7fde16800640 1 -- 172.21.15.110:0/1807233195 shutdown_connections 2024-09-12T02:30:44.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.204+0000 7fde16800640 1 --2- 172.21.15.110:0/1807233195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde1010e320 0x7fde10110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.204+0000 7fde16800640 1 --2- 172.21.15.110:0/1807233195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde10074ee0 0x7fde1010dde0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.204+0000 7fde16800640 1 --2- 172.21.15.110:0/1807233195 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde100745c0 0x7fde100749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.204+0000 7fde16800640 1 -- 172.21.15.110:0/1807233195 >> 172.21.15.110:0/1807233195 conn(0x7fde100fd7c0 msgr2=0x7fde100ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:44.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.204+0000 7fde16800640 1 -- 172.21.15.110:0/1807233195 shutdown_connections 2024-09-12T02:30:44.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.204+0000 7fde16800640 1 -- 172.21.15.110:0/1807233195 wait complete. 2024-09-12T02:30:44.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.205+0000 7fde16800640 1 Processor -- start 2024-09-12T02:30:44.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.205+0000 7fde16800640 1 -- start start 2024-09-12T02:30:44.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde16800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde100745c0 0x7fde1019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde16800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde10074ee0 0x7fde1019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde16800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde1010e320 0x7fde1019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde16800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fde101140b0 con 0x7fde1010e320 2024-09-12T02:30:44.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde16800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fde10113f30 con 0x7fde10074ee0 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde16800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fde10114230 con 0x7fde100745c0 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde0f400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde100745c0 0x7fde1019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde0f400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde100745c0 0x7fde1019a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:47474/0 (socket says 172.21.15.110:47474) 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde0f400640 1 -- 172.21.15.110:0/2219383755 learned_addr learned my addr 172.21.15.110:0/2219383755 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde0fe00640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde1010e320 0x7fde1019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde0ea00640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde10074ee0 0x7fde1019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde0f400640 1 -- 172.21.15.110:0/2219383755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde10074ee0 msgr2=0x7fde1019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde0f400640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde10074ee0 0x7fde1019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde0f400640 1 -- 172.21.15.110:0/2219383755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde1010e320 msgr2=0x7fde1019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde0f400640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde1010e320 0x7fde1019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde0f400640 1 -- 172.21.15.110:0/2219383755 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1019f6a0 con 0x7fde100745c0 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.206+0000 7fde0ea00640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde10074ee0 0x7fde1019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:30:44.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.207+0000 7fde0f400640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde100745c0 0x7fde1019a6b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fde0000e9f0 tx=0x7fde0000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:44.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.207+0000 7fde07e00640 1 -- 172.21.15.110:0/2219383755 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0000ccc0 con 0x7fde100745c0 2024-09-12T02:30:44.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.207+0000 7fde16800640 1 -- 172.21.15.110:0/2219383755 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde1019f990 con 0x7fde100745c0 2024-09-12T02:30:44.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.207+0000 7fde07e00640 1 -- 172.21.15.110:0/2219383755 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde0000ce60 con 0x7fde100745c0 2024-09-12T02:30:44.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.207+0000 7fde07e00640 1 -- 172.21.15.110:0/2219383755 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00010690 con 0x7fde100745c0 2024-09-12T02:30:44.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.207+0000 7fde16800640 1 -- 172.21.15.110:0/2219383755 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde101a7220 con 0x7fde100745c0 2024-09-12T02:30:44.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.208+0000 7fde16800640 1 -- 172.21.15.110:0/2219383755 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde100749a0 con 0x7fde100745c0 2024-09-12T02:30:44.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.210+0000 7fde07e00640 1 -- 172.21.15.110:0/2219383755 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fde000046c0 con 0x7fde100745c0 2024-09-12T02:30:44.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.211+0000 7fde07e00640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fddf40a2d00 0x7fddf40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.211+0000 7fde07e00640 1 -- 172.21.15.110:0/2219383755 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9504+0+0 (secure 0 0 0) 0x7fde000cfc80 con 0x7fde100745c0 2024-09-12T02:30:44.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.211+0000 7fde0ea00640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fddf40a2d00 0x7fddf40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.212+0000 7fde0ea00640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fddf40a2d00 0x7fddf40a51c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fde100ffe50 tx=0x7fddfc005a20 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:44.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.213+0000 7fde07e00640 1 -- 172.21.15.110:0/2219383755 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde0009c490 con 0x7fde100745c0 2024-09-12T02:30:44.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.389+0000 7fde16800640 1 -- 172.21.15.110:0/2219383755 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fde10109500 con 0x7fde100745c0 2024-09-12T02:30:44.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.404+0000 7fde07e00640 1 -- 172.21.15.110:0/2219383755 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) ==== 93+0+10 (secure 0 0 0) 0x7fde0009bd90 con 0x7fde100745c0 2024-09-12T02:30:44.405 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-09-12T02:30:44.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.406+0000 7fde16800640 1 -- 172.21.15.110:0/2219383755 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fddf40a2d00 msgr2=0x7fddf40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.406+0000 7fde16800640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fddf40a2d00 0x7fddf40a51c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fde100ffe50 tx=0x7fddfc005a20 comp rx=0 tx=0).stop 2024-09-12T02:30:44.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.406+0000 7fde16800640 1 -- 172.21.15.110:0/2219383755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde100745c0 msgr2=0x7fde1019a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.406+0000 7fde16800640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde100745c0 0x7fde1019a6b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fde0000e9f0 tx=0x7fde0000edf0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.406+0000 7fde16800640 1 -- 172.21.15.110:0/2219383755 shutdown_connections 2024-09-12T02:30:44.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.406+0000 7fde16800640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fddf40a2d00 0x7fddf40a51c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.406+0000 7fde16800640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde1010e320 0x7fde1019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.407 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.406+0000 7fde16800640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fde10074ee0 0x7fde1019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.406+0000 7fde16800640 1 --2- 172.21.15.110:0/2219383755 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde100745c0 0x7fde1019a6b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.406+0000 7fde16800640 1 -- 172.21.15.110:0/2219383755 >> 172.21.15.110:0/2219383755 conn(0x7fde100fd7c0 msgr2=0x7fde100feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:44.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.406+0000 7fde16800640 1 -- 172.21.15.110:0/2219383755 shutdown_connections 2024-09-12T02:30:44.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.406+0000 7fde16800640 1 -- 172.21.15.110:0/2219383755 wait complete. 2024-09-12T02:30:44.423 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T02:30:44.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.580+0000 7f9f9d400640 1 -- 172.21.15.110:0/3365565722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f98109060 msgr2=0x7f9f98110bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.580+0000 7f9f9d400640 1 --2- 172.21.15.110:0/3365565722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f98109060 0x7f9f98110bb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009ca0 tx=0x7f9f9002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.580+0000 7f9f9d400640 1 -- 172.21.15.110:0/3365565722 shutdown_connections 2024-09-12T02:30:44.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.580+0000 7f9f9d400640 1 --2- 172.21.15.110:0/3365565722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f98109060 0x7f9f98110bb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.580+0000 7f9f9d400640 1 --2- 172.21.15.110:0/3365565722 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f981048c0 0x7f9f98108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.580+0000 7f9f9d400640 1 --2- 172.21.15.110:0/3365565722 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f98103f10 0x7f9f981042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.580+0000 7f9f9d400640 1 -- 172.21.15.110:0/3365565722 >> 172.21.15.110:0/3365565722 conn(0x7f9f980ff940 msgr2=0x7f9f98101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:44.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.580+0000 7f9f9d400640 1 -- 172.21.15.110:0/3365565722 shutdown_connections 2024-09-12T02:30:44.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.580+0000 7f9f9d400640 1 -- 172.21.15.110:0/3365565722 wait complete. 2024-09-12T02:30:44.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.581+0000 7f9f9d400640 1 Processor -- start 2024-09-12T02:30:44.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.581+0000 7f9f9d400640 1 -- start start 2024-09-12T02:30:44.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.581+0000 7f9f9d400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f98103f10 0x7f9f9819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.581+0000 7f9f9d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f98109060 0x7f9f9819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.581+0000 7f9f9d400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f9819eed0 0x7f9f9819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.581+0000 7f9f9d400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9f98114100 con 0x7f9f98109060 2024-09-12T02:30:44.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.581+0000 7f9f9d400640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9f98113f80 con 0x7f9f98103f10 2024-09-12T02:30:44.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.581+0000 7f9f9d400640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9f98114280 con 0x7f9f9819eed0 2024-09-12T02:30:44.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.582+0000 7f9f8fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f98109060 0x7f9f9819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.582+0000 7f9f8fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f98109060 0x7f9f9819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33528/0 (socket says 172.21.15.110:33528) 2024-09-12T02:30:44.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.582+0000 7f9f97200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f9819eed0 0x7f9f9819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.582+0000 7f9f8fe00640 1 -- 172.21.15.110:0/395816478 learned_addr learned my addr 172.21.15.110:0/395816478 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.582+0000 7f9f96800640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f98103f10 0x7f9f9819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.582+0000 7f9f8fe00640 1 -- 172.21.15.110:0/395816478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f9819eed0 msgr2=0x7f9f9819f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.582+0000 7f9f8fe00640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f9819eed0 0x7f9f9819f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.582+0000 7f9f8fe00640 1 -- 172.21.15.110:0/395816478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f98103f10 msgr2=0x7f9f9819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.582+0000 7f9f8fe00640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f98103f10 0x7f9f9819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.582+0000 7f9f8fe00640 1 -- 172.21.15.110:0/395816478 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9819f9c0 con 0x7f9f98109060 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.582+0000 7f9f8fe00640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f98109060 0x7f9f9819ab50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000e9c0 tx=0x7f9f8000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.583+0000 7f9f8f400640 1 -- 172.21.15.110:0/395816478 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8000cd80 con 0x7f9f98109060 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.583+0000 7f9f8f400640 1 -- 172.21.15.110:0/395816478 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f80005500 con 0x7f9f98109060 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.583+0000 7f9f9d400640 1 -- 172.21.15.110:0/395816478 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9819fcb0 con 0x7f9f98109060 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.583+0000 7f9f8f400640 1 -- 172.21.15.110:0/395816478 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f80010690 con 0x7f9f98109060 2024-09-12T02:30:44.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.583+0000 7f9f9d400640 1 -- 172.21.15.110:0/395816478 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f981a74f0 con 0x7f9f98109060 2024-09-12T02:30:44.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.584+0000 7f9f9d400640 1 -- 172.21.15.110:0/395816478 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f981042f0 con 0x7f9f98109060 2024-09-12T02:30:44.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.585+0000 7f9f8f400640 1 -- 172.21.15.110:0/395816478 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f9f800046c0 con 0x7f9f98109060 2024-09-12T02:30:44.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.587+0000 7f9f8f400640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f9f7c0a2d80 0x7f9f7c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.587+0000 7f9f8f400640 1 -- 172.21.15.110:0/395816478 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9504+0+0 (secure 0 0 0) 0x7f9f800cfb20 con 0x7f9f98109060 2024-09-12T02:30:44.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.587+0000 7f9f96800640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f9f7c0a2d80 0x7f9f7c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.588+0000 7f9f96800640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f9f7c0a2d80 0x7f9f7c0a5240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009bd0 tx=0x7f9f88005f90 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:44.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.591+0000 7f9f8f400640 1 -- 172.21.15.110:0/395816478 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9f8009c330 con 0x7f9f98109060 2024-09-12T02:30:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:44 smithi136 ceph-mon[35814]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:44 smithi136 ceph-mon[35814]: from='client.25270 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:44.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:44 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/201841138' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:44.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:44 smithi110 ceph-mon[30548]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:44.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:44 smithi110 ceph-mon[30548]: from='client.25270 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:44.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:44 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/201841138' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:44.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.767+0000 7f9f9d400640 1 -- 172.21.15.110:0/395816478 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9f981048c0 con 0x7f9f98109060 2024-09-12T02:30:44.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.782+0000 7f9f8f400640 1 -- 172.21.15.110:0/395816478 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) ==== 104+0+11 (secure 0 0 0) 0x7f9f8009bc30 con 0x7f9f98109060 2024-09-12T02:30:44.782 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-09-12T02:30:44.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.784+0000 7f9f9d400640 1 -- 172.21.15.110:0/395816478 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f9f7c0a2d80 msgr2=0x7f9f7c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.784+0000 7f9f9d400640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f9f7c0a2d80 0x7f9f7c0a5240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009bd0 tx=0x7f9f88005f90 comp rx=0 tx=0).stop 2024-09-12T02:30:44.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.784+0000 7f9f9d400640 1 -- 172.21.15.110:0/395816478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f98109060 msgr2=0x7f9f9819ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.784+0000 7f9f9d400640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f98109060 0x7f9f9819ab50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000e9c0 tx=0x7f9f8000ee80 comp rx=0 tx=0).stop 2024-09-12T02:30:44.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.784+0000 7f9f9d400640 1 -- 172.21.15.110:0/395816478 shutdown_connections 2024-09-12T02:30:44.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.784+0000 7f9f9d400640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f9f7c0a2d80 0x7f9f7c0a5240 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.784+0000 7f9f9d400640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f9819eed0 0x7f9f9819f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.784+0000 7f9f9d400640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f98109060 0x7f9f9819ab50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.784+0000 7f9f9d400640 1 --2- 172.21.15.110:0/395816478 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f98103f10 0x7f9f9819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.784+0000 7f9f9d400640 1 -- 172.21.15.110:0/395816478 >> 172.21.15.110:0/395816478 conn(0x7f9f980ff940 msgr2=0x7f9f98100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:44.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.784+0000 7f9f9d400640 1 -- 172.21.15.110:0/395816478 shutdown_connections 2024-09-12T02:30:44.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.784+0000 7f9f9d400640 1 -- 172.21.15.110:0/395816478 wait complete. 2024-09-12T02:30:44.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:44 smithi115 ceph-mon[35351]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:44 smithi115 ceph-mon[35351]: from='client.25270 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T02:30:44.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:44 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/201841138' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:30:44.801 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T02:30:44.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.958+0000 7eff7be00640 1 -- 172.21.15.110:0/2935596109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff7c0745c0 msgr2=0x7eff7c0749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.958+0000 7eff7be00640 1 --2- 172.21.15.110:0/2935596109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff7c0745c0 0x7eff7c0749a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009900 tx=0x7eff6c02a480 comp rx=0 tx=0).stop 2024-09-12T02:30:44.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.958+0000 7eff7be00640 1 -- 172.21.15.110:0/2935596109 shutdown_connections 2024-09-12T02:30:44.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.958+0000 7eff7be00640 1 --2- 172.21.15.110:0/2935596109 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff7c10e2a0 0x7eff7c1106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.958+0000 7eff7be00640 1 --2- 172.21.15.110:0/2935596109 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff7c074ee0 0x7eff7c10dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.958+0000 7eff7be00640 1 --2- 172.21.15.110:0/2935596109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff7c0745c0 0x7eff7c0749a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.958+0000 7eff7be00640 1 -- 172.21.15.110:0/2935596109 >> 172.21.15.110:0/2935596109 conn(0x7eff7c0fd700 msgr2=0x7eff7c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:44.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.958+0000 7eff7be00640 1 -- 172.21.15.110:0/2935596109 shutdown_connections 2024-09-12T02:30:44.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.958+0000 7eff7be00640 1 -- 172.21.15.110:0/2935596109 wait complete. 2024-09-12T02:30:44.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.959+0000 7eff7be00640 1 Processor -- start 2024-09-12T02:30:44.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.959+0000 7eff7be00640 1 -- start start 2024-09-12T02:30:44.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.959+0000 7eff7be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff7c0745c0 0x7eff7c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.959+0000 7eff7be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff7c074ee0 0x7eff7c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.959+0000 7eff7be00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff7c10e2a0 0x7eff7c19ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.959+0000 7eff7be00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c114030 con 0x7eff7c0745c0 2024-09-12T02:30:44.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.959+0000 7eff7be00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c113eb0 con 0x7eff7c10e2a0 2024-09-12T02:30:44.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.959+0000 7eff7be00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c1141b0 con 0x7eff7c074ee0 2024-09-12T02:30:44.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.960+0000 7eff73e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff7c074ee0 0x7eff7c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.960+0000 7eff7aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff7c0745c0 0x7eff7c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.960+0000 7eff73e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff7c074ee0 0x7eff7c19ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:47512/0 (socket says 172.21.15.110:47512) 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.960+0000 7eff73e00640 1 -- 172.21.15.110:0/2487504686 learned_addr learned my addr 172.21.15.110:0/2487504686 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.960+0000 7eff7b400640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff7c10e2a0 0x7eff7c19ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.960+0000 7eff73e00640 1 -- 172.21.15.110:0/2487504686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff7c10e2a0 msgr2=0x7eff7c19ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.960+0000 7eff73e00640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff7c10e2a0 0x7eff7c19ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.960+0000 7eff73e00640 1 -- 172.21.15.110:0/2487504686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff7c0745c0 msgr2=0x7eff7c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.960+0000 7eff73e00640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff7c0745c0 0x7eff7c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.960+0000 7eff73e00640 1 -- 172.21.15.110:0/2487504686 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7c19f5b0 con 0x7eff7c074ee0 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.960+0000 7eff73e00640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff7c074ee0 0x7eff7c19ab00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff6400e9f0 tx=0x7eff6400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.960+0000 7eff73400640 1 -- 172.21.15.110:0/2487504686 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6400cd80 con 0x7eff7c074ee0 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.961+0000 7eff7be00640 1 -- 172.21.15.110:0/2487504686 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff7c19f8a0 con 0x7eff7c074ee0 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.961+0000 7eff73400640 1 -- 172.21.15.110:0/2487504686 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff64005500 con 0x7eff7c074ee0 2024-09-12T02:30:44.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.961+0000 7eff73400640 1 -- 172.21.15.110:0/2487504686 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64010690 con 0x7eff7c074ee0 2024-09-12T02:30:44.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.961+0000 7eff7be00640 1 -- 172.21.15.110:0/2487504686 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff7c1a7130 con 0x7eff7c074ee0 2024-09-12T02:30:44.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.962+0000 7eff7be00640 1 -- 172.21.15.110:0/2487504686 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff7c0749a0 con 0x7eff7c074ee0 2024-09-12T02:30:44.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.963+0000 7eff73400640 1 -- 172.21.15.110:0/2487504686 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7eff640046c0 con 0x7eff7c074ee0 2024-09-12T02:30:44.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.965+0000 7eff73400640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7eff600a2d80 0x7eff600a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:44.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.965+0000 7eff73400640 1 -- 172.21.15.110:0/2487504686 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9504+0+0 (secure 0 0 0) 0x7eff640cfb50 con 0x7eff7c074ee0 2024-09-12T02:30:44.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.965+0000 7eff7aa00640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7eff600a2d80 0x7eff600a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:44.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.966+0000 7eff7aa00640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7eff600a2d80 0x7eff600a5240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009230 tx=0x7eff6c0058d0 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:44.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:44.966+0000 7eff73400640 1 -- 172.21.15.110:0/2487504686 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff6409c360 con 0x7eff7c074ee0 2024-09-12T02:30:45.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.142+0000 7eff7be00640 1 -- 172.21.15.110:0/2487504686 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7eff7c109420 con 0x7eff7c074ee0 2024-09-12T02:30:45.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.143+0000 7eff73400640 1 -- 172.21.15.110:0/2487504686 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) ==== 100+0+11 (secure 0 0 0) 0x7eff6409bc60 con 0x7eff7c074ee0 2024-09-12T02:30:45.144 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-09-12T02:30:45.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.145+0000 7eff7be00640 1 -- 172.21.15.110:0/2487504686 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7eff600a2d80 msgr2=0x7eff600a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.145+0000 7eff7be00640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7eff600a2d80 0x7eff600a5240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009230 tx=0x7eff6c0058d0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.145+0000 7eff7be00640 1 -- 172.21.15.110:0/2487504686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff7c074ee0 msgr2=0x7eff7c19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.145+0000 7eff7be00640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff7c074ee0 0x7eff7c19ab00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff6400e9f0 tx=0x7eff6400edf0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.146+0000 7eff7be00640 1 -- 172.21.15.110:0/2487504686 shutdown_connections 2024-09-12T02:30:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.146+0000 7eff7be00640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7eff600a2d80 0x7eff600a5240 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.146+0000 7eff7be00640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff7c10e2a0 0x7eff7c19ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.146+0000 7eff7be00640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7eff7c074ee0 0x7eff7c19ab00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.146+0000 7eff7be00640 1 --2- 172.21.15.110:0/2487504686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff7c0745c0 0x7eff7c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.146+0000 7eff7be00640 1 -- 172.21.15.110:0/2487504686 >> 172.21.15.110:0/2487504686 conn(0x7eff7c0fd700 msgr2=0x7eff7c0fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.146+0000 7eff7be00640 1 -- 172.21.15.110:0/2487504686 shutdown_connections 2024-09-12T02:30:45.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.146+0000 7eff7be00640 1 -- 172.21.15.110:0/2487504686 wait complete. 2024-09-12T02:30:45.162 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-12T02:30:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.320+0000 7fe382000640 1 -- 172.21.15.110:0/3089723898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe37c103f10 msgr2=0x7fe37c1042f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.320+0000 7fe382000640 1 --2- 172.21.15.110:0/3089723898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe37c103f10 0x7fe37c1042f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009900 tx=0x7fe36c02a410 comp rx=0 tx=0).stop 2024-09-12T02:30:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.321+0000 7fe382000640 1 -- 172.21.15.110:0/3089723898 shutdown_connections 2024-09-12T02:30:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.321+0000 7fe382000640 1 --2- 172.21.15.110:0/3089723898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe37c109060 0x7fe37c110bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.321+0000 7fe382000640 1 --2- 172.21.15.110:0/3089723898 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe37c1048c0 0x7fe37c108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.321+0000 7fe382000640 1 --2- 172.21.15.110:0/3089723898 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe37c103f10 0x7fe37c1042f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.321+0000 7fe382000640 1 -- 172.21.15.110:0/3089723898 >> 172.21.15.110:0/3089723898 conn(0x7fe37c0ff940 msgr2=0x7fe37c101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.321+0000 7fe382000640 1 -- 172.21.15.110:0/3089723898 shutdown_connections 2024-09-12T02:30:45.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.321+0000 7fe382000640 1 -- 172.21.15.110:0/3089723898 wait complete. 2024-09-12T02:30:45.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.321+0000 7fe382000640 1 Processor -- start 2024-09-12T02:30:45.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.322+0000 7fe382000640 1 -- start start 2024-09-12T02:30:45.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.322+0000 7fe382000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe37c103f10 0x7fe37c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:45.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.322+0000 7fe382000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe37c109060 0x7fe37c19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:45.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.322+0000 7fe382000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe37c19eed0 0x7fe37c19f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:45.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.322+0000 7fe382000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c1140d0 con 0x7fe37c109060 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.322+0000 7fe382000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c113f50 con 0x7fe37c103f10 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.322+0000 7fe382000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe37c114250 con 0x7fe37c19eed0 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.322+0000 7fe372a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe37c109060 0x7fe37c19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.322+0000 7fe37be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe37c19eed0 0x7fe37c19f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.322+0000 7fe37be00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe37c19eed0 0x7fe37c19f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:47538/0 (socket says 172.21.15.110:47538) 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.322+0000 7fe37be00640 1 -- 172.21.15.110:0/3048487670 learned_addr learned my addr 172.21.15.110:0/3048487670 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.322+0000 7fe37b400640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe37c103f10 0x7fe37c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.323+0000 7fe37be00640 1 -- 172.21.15.110:0/3048487670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe37c103f10 msgr2=0x7fe37c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.323+0000 7fe37be00640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe37c103f10 0x7fe37c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.323+0000 7fe37be00640 1 -- 172.21.15.110:0/3048487670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe37c109060 msgr2=0x7fe37c19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.323+0000 7fe37be00640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe37c109060 0x7fe37c19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.323+0000 7fe37be00640 1 -- 172.21.15.110:0/3048487670 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37c19f9c0 con 0x7fe37c19eed0 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.323+0000 7fe37be00640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe37c19eed0 0x7fe37c19f380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe37400eb10 tx=0x7fe37400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:45.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.323+0000 7fe378c00640 1 -- 172.21.15.110:0/3048487670 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374004b20 con 0x7fe37c19eed0 2024-09-12T02:30:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.323+0000 7fe382000640 1 -- 172.21.15.110:0/3048487670 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe37c19fcb0 con 0x7fe37c19eed0 2024-09-12T02:30:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.323+0000 7fe378c00640 1 -- 172.21.15.110:0/3048487670 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe374004cc0 con 0x7fe37c19eed0 2024-09-12T02:30:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.323+0000 7fe378c00640 1 -- 172.21.15.110:0/3048487670 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374010690 con 0x7fe37c19eed0 2024-09-12T02:30:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.323+0000 7fe382000640 1 -- 172.21.15.110:0/3048487670 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37c1a74a0 con 0x7fe37c19eed0 2024-09-12T02:30:45.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.324+0000 7fe382000640 1 -- 172.21.15.110:0/3048487670 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe37c1042f0 con 0x7fe37c19eed0 2024-09-12T02:30:45.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.326+0000 7fe378c00640 1 -- 172.21.15.110:0/3048487670 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fe374005000 con 0x7fe37c19eed0 2024-09-12T02:30:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.327+0000 7fe378c00640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fe3600a2d00 0x7fe3600a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:45.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.328+0000 7fe378c00640 1 -- 172.21.15.110:0/3048487670 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9504+0+0 (secure 0 0 0) 0x7fe3740cfdd0 con 0x7fe37c19eed0 2024-09-12T02:30:45.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.328+0000 7fe37b400640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fe3600a2d00 0x7fe3600a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:45.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.328+0000 7fe37b400640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fe3600a2d00 0x7fe3600a51c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe36c000c00 tx=0x7fe36c005b50 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:45.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.331+0000 7fe378c00640 1 -- 172.21.15.110:0/3048487670 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe37409c5e0 con 0x7fe37c19eed0 2024-09-12T02:30:45.436 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:45 smithi110 ceph-mon[30548]: pgmap v492: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 4.4 MiB/s wr, 515 op/s 2024-09-12T02:30:45.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:45 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2219383755' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:30:45.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:45 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/395816478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:30:45.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:45 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2487504686' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:30:45.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.508+0000 7fe382000640 1 -- 172.21.15.110:0/3048487670 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe37c10c270 con 0x7fe37c19eed0 2024-09-12T02:30:45.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.509+0000 7fe378c00640 1 -- 172.21.15.110:0/3048487670 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v116) ==== 103+0+11 (secure 0 0 0) 0x7fe37409bee0 con 0x7fe37c19eed0 2024-09-12T02:30:45.510 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-09-12T02:30:45.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.512+0000 7fe382000640 1 -- 172.21.15.110:0/3048487670 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fe3600a2d00 msgr2=0x7fe3600a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.512+0000 7fe382000640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fe3600a2d00 0x7fe3600a51c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe36c000c00 tx=0x7fe36c005b50 comp rx=0 tx=0).stop 2024-09-12T02:30:45.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.512+0000 7fe382000640 1 -- 172.21.15.110:0/3048487670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe37c19eed0 msgr2=0x7fe37c19f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.512+0000 7fe382000640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe37c19eed0 0x7fe37c19f380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe37400eb10 tx=0x7fe37400c2d0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.512+0000 7fe382000640 1 -- 172.21.15.110:0/3048487670 shutdown_connections 2024-09-12T02:30:45.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.512+0000 7fe382000640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fe3600a2d00 0x7fe3600a51c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.512+0000 7fe382000640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe37c19eed0 0x7fe37c19f380 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.512+0000 7fe382000640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe37c109060 0x7fe37c19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.512+0000 7fe382000640 1 --2- 172.21.15.110:0/3048487670 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe37c103f10 0x7fe37c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.512+0000 7fe382000640 1 -- 172.21.15.110:0/3048487670 >> 172.21.15.110:0/3048487670 conn(0x7fe37c0ff940 msgr2=0x7fe37c100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:45.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.512+0000 7fe382000640 1 -- 172.21.15.110:0/3048487670 shutdown_connections 2024-09-12T02:30:45.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.512+0000 7fe382000640 1 -- 172.21.15.110:0/3048487670 wait complete. 2024-09-12T02:30:45.529 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-12T02:30:45.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:45 smithi136 ceph-mon[35814]: pgmap v492: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 4.4 MiB/s wr, 515 op/s 2024-09-12T02:30:45.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:45 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2219383755' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:30:45.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:45 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/395816478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:30:45.659 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:45 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2487504686' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:30:45.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.683+0000 7f583ce00640 1 -- 172.21.15.110:0/595072376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5838109060 msgr2=0x7f5838110bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.683+0000 7f583ce00640 1 --2- 172.21.15.110:0/595072376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5838109060 0x7f5838110bb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5830009ca0 tx=0x7f583002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.683+0000 7f583ce00640 1 -- 172.21.15.110:0/595072376 shutdown_connections 2024-09-12T02:30:45.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.683+0000 7f583ce00640 1 --2- 172.21.15.110:0/595072376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5838109060 0x7f5838110bb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.683+0000 7f583ce00640 1 --2- 172.21.15.110:0/595072376 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f58381048c0 0x7f5838108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.683+0000 7f583ce00640 1 --2- 172.21.15.110:0/595072376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838103f10 0x7f58381042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.683+0000 7f583ce00640 1 -- 172.21.15.110:0/595072376 >> 172.21.15.110:0/595072376 conn(0x7f58380ff980 msgr2=0x7f5838101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:45.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.683+0000 7f583ce00640 1 -- 172.21.15.110:0/595072376 shutdown_connections 2024-09-12T02:30:45.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.684+0000 7f583ce00640 1 -- 172.21.15.110:0/595072376 wait complete. 2024-09-12T02:30:45.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.684+0000 7f583ce00640 1 Processor -- start 2024-09-12T02:30:45.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.685+0000 7f583ce00640 1 -- start start 2024-09-12T02:30:45.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.685+0000 7f583ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838103f10 0x7f583819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:45.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.685+0000 7f583ce00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5838109060 0x7f583819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:45.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.685+0000 7f583ce00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f583819ee50 0x7f583819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:45.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.685+0000 7f583ce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f5838114080 con 0x7f5838103f10 2024-09-12T02:30:45.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.685+0000 7f583ce00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5838113f00 con 0x7f5838109060 2024-09-12T02:30:45.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.685+0000 7f583ce00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5838114200 con 0x7f583819ee50 2024-09-12T02:30:45.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.685+0000 7f5835e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838103f10 0x7f583819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:45.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.685+0000 7f5836800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f583819ee50 0x7f583819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:45.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.685+0000 7f5836800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f583819ee50 0x7f583819f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:47546/0 (socket says 172.21.15.110:47546) 2024-09-12T02:30:45.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.685+0000 7f5836800640 1 -- 172.21.15.110:0/1377049485 learned_addr learned my addr 172.21.15.110:0/1377049485 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:30:45.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.685+0000 7f5835400640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5838109060 0x7f583819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:45.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.686+0000 7f5835e00640 1 -- 172.21.15.110:0/1377049485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f583819ee50 msgr2=0x7f583819f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.686+0000 7f5835e00640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f583819ee50 0x7f583819f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.686+0000 7f5835e00640 1 -- 172.21.15.110:0/1377049485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5838109060 msgr2=0x7f583819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:45.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.686+0000 7f5835e00640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5838109060 0x7f583819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:45.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.686+0000 7f5835e00640 1 -- 172.21.15.110:0/1377049485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583819f940 con 0x7f5838103f10 2024-09-12T02:30:45.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.686+0000 7f5836800640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f583819ee50 0x7f583819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:30:45.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.686+0000 7f5835e00640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838103f10 0x7f583819a590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f582800e9f0 tx=0x7f582800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:45.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.686+0000 7f582ea00640 1 -- 172.21.15.110:0/1377049485 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582800ccc0 con 0x7f5838103f10 2024-09-12T02:30:45.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.686+0000 7f582ea00640 1 -- 172.21.15.110:0/1377049485 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5828010910 con 0x7f5838103f10 2024-09-12T02:30:45.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.686+0000 7f583ce00640 1 -- 172.21.15.110:0/1377049485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f583819fc30 con 0x7f5838103f10 2024-09-12T02:30:45.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.686+0000 7f582ea00640 1 -- 172.21.15.110:0/1377049485 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828018960 con 0x7f5838103f10 2024-09-12T02:30:45.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.686+0000 7f583ce00640 1 -- 172.21.15.110:0/1377049485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58381a7420 con 0x7f5838103f10 2024-09-12T02:30:45.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.687+0000 7f583ce00640 1 -- 172.21.15.110:0/1377049485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58381042f0 con 0x7f5838103f10 2024-09-12T02:30:45.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.689+0000 7f582ea00640 1 -- 172.21.15.110:0/1377049485 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f5828010ac0 con 0x7f5838103f10 2024-09-12T02:30:45.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.690+0000 7f582ea00640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f581c0a2d00 0x7f581c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:30:45.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.690+0000 7f582ea00640 1 -- 172.21.15.110:0/1377049485 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 9504+0+0 (secure 0 0 0) 0x7f58280cfbf0 con 0x7f5838103f10 2024-09-12T02:30:45.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.691+0000 7f5835400640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f581c0a2d00 0x7f581c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:30:45.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.691+0000 7f5835400640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f581c0a2d00 0x7f581c0a51c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f58240095f0 tx=0x7f5824005f90 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:30:45.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.695+0000 7f582ea00640 1 -- 172.21.15.110:0/1377049485 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f582809bdb0 con 0x7f5838103f10 2024-09-12T02:30:45.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:45 smithi115 ceph-mon[35351]: pgmap v492: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 4.4 MiB/s wr, 515 op/s 2024-09-12T02:30:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:45 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2219383755' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T02:30:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:45 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/395816478' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-12T02:30:45.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:45 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2487504686' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-12T02:30:45.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.919+0000 7f583ce00640 1 -- 172.21.15.110:0/1377049485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f58381048c0 con 0x7f5838103f10 2024-09-12T02:30:45.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.929+0000 7f582ea00640 1 -- 172.21.15.110:0/1377049485 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+740912 (secure 0 0 0) 0x7f58280a00b0 con 0x7f5838103f10 2024-09-12T02:30:45.940 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:30:45.940 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:30:45.940 INFO:teuthology.orchestra.run.smithi110.stdout: "epoch": 26, 2024-09-12T02:30:45.940 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.940 INFO:teuthology.orchestra.run.smithi110.stdout: "active_gid": 15147, 2024-09-12T02:30:45.940 INFO:teuthology.orchestra.run.smithi110.stdout: "active_name": "x", 2024-09-12T02:30:45.940 INFO:teuthology.orchestra.run.smithi110.stdout: "active_addrs": { 2024-09-12T02:30:45.941 INFO:teuthology.orchestra.run.smithi110.stdout: "addrvec": [ 2024-09-12T02:30:45.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:45.941 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v2", 2024-09-12T02:30:45.941 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "172.21.15.110:6800", 2024-09-12T02:30:45.941 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 1913988278 2024-09-12T02:30:45.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:45.941 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v1", 2024-09-12T02:30:45.941 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "172.21.15.110:6801", 2024-09-12T02:30:45.941 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 1913988278 2024-09-12T02:30:45.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:45.942 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T02:30:45.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.942 INFO:teuthology.orchestra.run.smithi110.stdout: "active_addr": "172.21.15.110:6801/1913988278", 2024-09-12T02:30:45.942 INFO:teuthology.orchestra.run.smithi110.stdout: "active_change": "2024-09-12T02:15:01.681286+0000", 2024-09-12T02:30:45.942 INFO:teuthology.orchestra.run.smithi110.stdout: "active_mgr_features": 4540701547738038271, 2024-09-12T02:30:45.942 INFO:teuthology.orchestra.run.smithi110.stdout: "available": true, 2024-09-12T02:30:45.942 INFO:teuthology.orchestra.run.smithi110.stdout: "standbys": [ 2024-09-12T02:30:45.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:45.942 INFO:teuthology.orchestra.run.smithi110.stdout: "gid": 25151, 2024-09-12T02:30:45.942 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "y", 2024-09-12T02:30:45.942 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:30:45.943 INFO:teuthology.orchestra.run.smithi110.stdout: "available_modules": [ 2024-09-12T02:30:45.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:45.943 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "alerts", 2024-09-12T02:30:45.943 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:45.943 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:45.943 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:45.943 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:45.943 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:45.943 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:45.944 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.944 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.944 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:45.944 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.944 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.944 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.944 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:30:45.944 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.944 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.944 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.945 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:45.945 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:45.945 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.945 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.945 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.945 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:45.945 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.945 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.945 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:45.945 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:45.945 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:45.946 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:45.947 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:45.948 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.948 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.948 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.948 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:45.948 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.948 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.948 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:45.948 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:45.948 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:45.948 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:45.948 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:45.948 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.949 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_destination": { 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_destination", 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.950 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_from_name": { 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_from_name", 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.951 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "Ceph", 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Email From: name", 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_host": { 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_host", 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.952 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "SMTP server", 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_password": { 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_password", 2024-09-12T02:30:45.953 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Password to authenticate with", 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_port": { 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_port", 2024-09-12T02:30:45.954 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "465", 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "SMTP port", 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_sender": { 2024-09-12T02:30:45.955 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_sender", 2024-09-12T02:30:45.956 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.956 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.956 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.956 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:45.956 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.956 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.956 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.956 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:30:45.956 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.956 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.956 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_ssl": { 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_ssl", 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.957 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_user": { 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_user", 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "User to authenticate as", 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.958 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.959 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.959 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:45.959 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:45.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:45.959 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "balancer", 2024-09-12T02:30:45.959 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:45.959 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:45.959 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:45.959 INFO:teuthology.orchestra.run.smithi110.stdout: "active": { 2024-09-12T02:30:45.959 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "active", 2024-09-12T02:30:45.960 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:45.960 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.960 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.960 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:45.960 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.960 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.960 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: "begin_time": { 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "begin_time", 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0000", 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.961 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: "begin_weekday": { 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "begin_weekday", 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:45.962 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "0", 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "6", 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: "crush_compat_max_iterations": { 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.963 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "25", 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1", 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "250", 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: "crush_compat_metrics": { 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crush_compat_metrics", 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.964 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "crush_compat_step": { 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crush_compat_step", 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.965 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0.5", 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "0.001", 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "0.999", 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: "end_time": { 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "end_time", 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.966 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "2359", 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: "end_weekday": { 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "end_weekday", 2024-09-12T02:30:45.967 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "0", 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "6", 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:45.968 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:45.969 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:45.970 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:45.970 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:45.970 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.970 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.970 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.970 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:45.970 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:45.970 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:45.970 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.970 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.970 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.971 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.972 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:45.972 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.972 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.972 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:45.972 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:45.972 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:45.972 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:45.972 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:45.972 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:45.972 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:45.972 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:45.972 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.973 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: "min_score": { 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "min_score", 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.974 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "mode": { 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mode", 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "upmap", 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.975 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: "crush-compat", 2024-09-12T02:30:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: "none", 2024-09-12T02:30:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: "read", 2024-09-12T02:30:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: "upmap", 2024-09-12T02:30:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: "upmap-read" 2024-09-12T02:30:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Balancer mode", 2024-09-12T02:30:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "pool_ids": { 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "pool_ids", 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.977 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.978 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: "upmap_max_deviation": { 2024-09-12T02:30:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "upmap_max_deviation", 2024-09-12T02:30:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5", 2024-09-12T02:30:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1", 2024-09-12T02:30:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.979 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "upmap_max_optimizations": { 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.980 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cephadm", 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: "agent_down_multiplier": { 2024-09-12T02:30:45.981 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "agent_down_multiplier", 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "3.0", 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.982 INFO:teuthology.orchestra.run.smithi110.stdout: "agent_refresh_rate": { 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "agent_refresh_rate", 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "20", 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.983 INFO:teuthology.orchestra.run.smithi110.stdout: "agent_starting_port": { 2024-09-12T02:30:45.984 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "agent_starting_port", 2024-09-12T02:30:45.984 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:45.984 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.984 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.984 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "4721", 2024-09-12T02:30:45.984 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.984 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.984 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.984 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:30:45.984 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.984 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: "allow_ptrace": { 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "allow_ptrace", 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:30:45.985 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: "autotune_interval": { 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "autotune_interval", 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.986 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:30:45.987 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.987 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.987 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.987 INFO:teuthology.orchestra.run.smithi110.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:30:45.987 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:30:45.987 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:45.987 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0.7", 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: "cephadm_log_destination": { 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cephadm_log_destination", 2024-09-12T02:30:45.988 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: "file", 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: "file,syslog", 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: "syslog" 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.989 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: "cgroups_split": { 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cgroups_split", 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:30:45.990 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: "config_checks_enabled": { 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "config_checks_enabled", 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.991 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: "config_dashboard": { 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "config_dashboard", 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.992 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_alertmanager": { 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_alertmanager", 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.993 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Prometheus container image", 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_base": { 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_base", 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.994 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_elasticsearch": { 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.995 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "elasticsearch container image", 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_grafana": { 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_grafana", 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:30:45.996 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Prometheus container image", 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_haproxy": { 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_haproxy", 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.997 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "HAproxy container image", 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_jaeger_agent": { 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:45.998 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_jaeger_collector": { 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:45.999 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_jaeger_query": { 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:30:46.000 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Jaeger query container image", 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_keepalived": { 2024-09-12T02:30:46.001 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_keepalived", 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Keepalived container image", 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.002 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_loki": { 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_loki", 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Loki container image", 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_node_exporter": { 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_node_exporter", 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Prometheus container image", 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.004 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_nvmeof": { 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_nvmeof", 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Nvme-of container image", 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.005 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_prometheus": { 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_prometheus", 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Prometheus container image", 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.006 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_promtail": { 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_promtail", 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Promtail container image", 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.007 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_samba": { 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_samba", 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:30:46.008 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_snmp_gateway": { 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.009 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:30:46.010 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.010 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.010 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.010 INFO:teuthology.orchestra.run.smithi110.stdout: "container_init": { 2024-09-12T02:30:46.010 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_init", 2024-09-12T02:30:46.010 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.010 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.010 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.010 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.010 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.010 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: "daemon_cache_timeout": { 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:46.011 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.012 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "900", 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: "default_registry": { 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "default_registry", 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.013 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "docker.io", 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: "device_cache_timeout": { 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "device_cache_timeout", 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.014 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "1800", 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: "device_enhanced_scan": { 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "device_enhanced_scan", 2024-09-12T02:30:46.015 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: "facts_cache_timeout": { 2024-09-12T02:30:46.016 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "facts_cache_timeout", 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: "grafana_dashboards_path": { 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "host_check_interval": { 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "host_check_interval", 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "hw_monitoring": { 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "hw_monitoring", 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.020 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: "inventory_list_all": { 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "inventory_list_all", 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.021 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.022 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: "log_refresh_metadata": { 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_refresh_metadata", 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.023 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.024 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.024 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.024 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.024 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.024 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.024 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:30:46.024 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.024 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.024 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.024 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.024 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.025 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.026 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.027 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.028 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.029 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "*", 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: "max_count_per_host": { 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_count_per_host", 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.030 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: "max_osd_draining_count": { 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_osd_draining_count", 2024-09-12T02:30:46.031 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: "migration_current": { 2024-09-12T02:30:46.032 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "migration_current", 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "internal - do not modify", 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "mode": { 2024-09-12T02:30:46.033 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mode", 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "root", 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: "cephadm-package", 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: "root" 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.034 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: "oob_default_addr": { 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "oob_default_addr", 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "169.254.1.1", 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:30:46.035 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: "prometheus_alerts_path": { 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.036 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:30:46.037 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.037 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.037 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.037 INFO:teuthology.orchestra.run.smithi110.stdout: "registry_insecure": { 2024-09-12T02:30:46.037 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "registry_insecure", 2024-09-12T02:30:46.037 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.037 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.037 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.037 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.037 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.037 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: "registry_password": { 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "registry_password", 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.038 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "registry_url": { 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "registry_url", 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.039 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.040 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.040 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.040 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:30:46.040 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.040 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.040 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.040 INFO:teuthology.orchestra.run.smithi110.stdout: "registry_username": { 2024-09-12T02:30:46.040 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "registry_username", 2024-09-12T02:30:46.040 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.040 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.040 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "secure_monitoring_stack": { 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.041 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: "service_discovery_port": { 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "service_discovery_port", 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.042 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8765", 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: "ssh_config_file": { 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ssh_config_file", 2024-09-12T02:30:46.043 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: "use_agent": { 2024-09-12T02:30:46.044 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "use_agent", 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.045 INFO:teuthology.orchestra.run.smithi110.stdout: "use_repo_digest": { 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "use_repo_digest", 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_on_failed_host_check": { 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_on_stray_daemons": { 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.048 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_on_stray_hosts": { 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.049 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crash", 2024-09-12T02:30:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.050 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.051 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.052 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.053 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.054 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.056 INFO:teuthology.orchestra.run.smithi110.stdout: "retain_interval": { 2024-09-12T02:30:46.056 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "retain_interval", 2024-09-12T02:30:46.056 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.056 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.056 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.056 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "31536000", 2024-09-12T02:30:46.056 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.056 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.056 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.056 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:30:46.056 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.056 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_recent_interval": { 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_recent_interval", 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "1209600", 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.057 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "dashboard", 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.058 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.059 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.060 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.061 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.062 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.063 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.064 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.065 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.066 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.067 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.068 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.069 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:30:46.070 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:30:46.071 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.072 INFO:teuthology.orchestra.run.smithi110.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "admin", 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.075 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_API_URL": { 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.076 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "admin", 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.077 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.078 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.079 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.080 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.081 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.082 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.083 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.084 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.085 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.086 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:30:46.087 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:30:46.088 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:30:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.278 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:30:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:30:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.279 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.280 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.281 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:30:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:30:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.282 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.283 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:30:46.284 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8", 2024-09-12T02:30:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:30:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:30:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "45", 2024-09-12T02:30:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.286 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.287 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.288 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:30:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:30:46.289 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "admin", 2024-09-12T02:30:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.290 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:30:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:30:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.291 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.292 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.293 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.294 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5", 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.295 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "cross_origin_url": { 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cross_origin_url", 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.296 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "crt_file": { 2024-09-12T02:30:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crt_file", 2024-09-12T02:30:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.297 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.298 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "debug": { 2024-09-12T02:30:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "debug", 2024-09-12T02:30:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.299 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:30:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "jwt_token_ttl": { 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "jwt_token_ttl", 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "28800", 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.301 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "key_file": { 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "key_file", 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.302 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.303 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.304 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.305 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.306 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.307 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "motd": { 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "motd", 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.308 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "The message of the day", 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.309 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "server_addr": { 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_addr", 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "::", 2024-09-12T02:30:46.310 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "server_port": { 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_port", 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.311 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8080", 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "ssl": { 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ssl", 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.312 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "ssl_server_port": { 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ssl_server_port", 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.313 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8443", 2024-09-12T02:30:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "standby_behaviour": { 2024-09-12T02:30:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "standby_behaviour", 2024-09-12T02:30:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.314 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "redirect", 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "redirect" 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "standby_error_status_code": { 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "standby_error_status_code", 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "500", 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "400", 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "599", 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "url_prefix": { 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "url_prefix", 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "devicehealth", 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "enable_monitoring": { 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "enable_monitoring", 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.318 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "monitor device health metrics", 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.319 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.320 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.321 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.322 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.323 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.324 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "mark_out_threshold": { 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mark_out_threshold", 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "2419200", 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:30:46.325 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "pool_name": { 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "pool_name", 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "device_health_metrics", 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:30:46.326 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "retention_period": { 2024-09-12T02:30:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "retention_period", 2024-09-12T02:30:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "15552000", 2024-09-12T02:30:46.327 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "scrape_frequency": { 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "scrape_frequency", 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "86400", 2024-09-12T02:30:46.328 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:30:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "self_heal": { 2024-09-12T02:30:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "self_heal", 2024-09-12T02:30:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.329 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.330 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:30:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_threshold": { 2024-09-12T02:30:46.331 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_threshold", 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "7257600", 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.332 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "diskprediction_local", 2024-09-12T02:30:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.333 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.334 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.335 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.336 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.337 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "predict_interval": { 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "predict_interval", 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.338 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "86400", 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "predictor_model": { 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "predictor_model", 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.339 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "prophetstor", 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.340 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.341 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "influx", 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": false, 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "batch_size": { 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "batch_size", 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5000", 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.342 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "database": { 2024-09-12T02:30:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "database", 2024-09-12T02:30:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "ceph", 2024-09-12T02:30:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.343 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:30:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "hostname": { 2024-09-12T02:30:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "hostname", 2024-09-12T02:30:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.344 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "30", 2024-09-12T02:30:46.345 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "5", 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.346 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.347 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.348 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.349 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.350 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.350 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.350 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.350 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.350 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.350 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.350 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.350 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.350 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.350 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.350 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "password": { 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "password", 2024-09-12T02:30:46.351 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: "port": { 2024-09-12T02:30:46.352 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "port", 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8086", 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "InfluxDB server port", 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "ssl": { 2024-09-12T02:30:46.353 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ssl", 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "false", 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.354 INFO:teuthology.orchestra.run.smithi110.stdout: "threads": { 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "threads", 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5", 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1", 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "32", 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.355 INFO:teuthology.orchestra.run.smithi110.stdout: "username": { 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "username", 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.357 INFO:teuthology.orchestra.run.smithi110.stdout: "verify_ssl": { 2024-09-12T02:30:46.357 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "verify_ssl", 2024-09-12T02:30:46.357 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.357 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.357 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.357 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "true", 2024-09-12T02:30:46.357 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.357 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.357 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.357 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:30:46.357 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.357 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "insights", 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.358 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.359 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.360 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.360 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.360 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.360 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.360 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.360 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.360 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.360 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.360 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.360 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.360 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.361 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.361 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.361 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.361 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.361 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.361 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.361 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.361 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.361 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.361 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.362 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.362 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.362 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.362 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.362 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.362 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.362 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.362 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.362 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.362 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.363 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "iostat", 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.364 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.365 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.366 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.367 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.368 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.369 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "k8sevents", 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_event_retention_days": { 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.370 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "7", 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "config_check_secs": { 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "config_check_secs", 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.371 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.372 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.372 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.372 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "10", 2024-09-12T02:30:46.372 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.372 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.372 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:30:46.372 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.372 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.372 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.372 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.372 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.373 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.374 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.375 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.377 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "localpool", 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: "failure_domain": { 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "failure_domain", 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.378 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "host", 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.379 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.380 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.381 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.382 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.383 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: "min_size": { 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "min_size", 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.384 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "num_rep": { 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "num_rep", 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.385 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.386 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.386 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "3", 2024-09-12T02:30:46.386 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.386 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.386 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.386 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:30:46.386 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.386 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.386 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.386 INFO:teuthology.orchestra.run.smithi110.stdout: "pg_num": { 2024-09-12T02:30:46.386 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "pg_num", 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "128", 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.387 INFO:teuthology.orchestra.run.smithi110.stdout: "prefix": { 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "prefix", 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.388 INFO:teuthology.orchestra.run.smithi110.stdout: "subtree": { 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "subtree", 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "rack", 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mds_autoscaler", 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.390 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.391 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.392 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.393 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.394 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.395 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mirroring", 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.396 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.397 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.398 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.399 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.400 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.400 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.400 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.400 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.400 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.400 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.400 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.400 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.400 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.400 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.400 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "nfs", 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.401 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.402 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.403 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.404 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.405 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.406 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "orchestrator", 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.407 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "fail_fs": { 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "fail_fs", 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.408 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.409 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.410 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.411 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.412 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.412 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.412 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.412 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.412 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.412 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.412 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.412 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.412 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.412 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.412 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.412 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.413 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "orchestrator": { 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "orchestrator", 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.414 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.415 INFO:teuthology.orchestra.run.smithi110.stdout: "cephadm", 2024-09-12T02:30:46.415 INFO:teuthology.orchestra.run.smithi110.stdout: "rook", 2024-09-12T02:30:46.415 INFO:teuthology.orchestra.run.smithi110.stdout: "test_orchestrator" 2024-09-12T02:30:46.415 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.415 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Orchestrator backend", 2024-09-12T02:30:46.415 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.415 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.415 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "osd_perf_query", 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.416 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.417 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.418 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.419 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "osd_support", 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.421 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.422 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.423 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.424 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.425 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.426 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "pg_autoscaler", 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.427 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.428 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.429 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.430 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.430 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.430 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.430 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.430 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.430 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.430 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.430 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.430 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.430 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.430 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.431 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.432 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.433 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: "threshold": { 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "threshold", 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "3.0", 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1.0", 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "scaling threshold", 2024-09-12T02:30:46.434 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "progress", 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: "allow_pg_recovery_event": { 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:30:46.435 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": { 2024-09-12T02:30:46.436 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "enabled", 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.437 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.438 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.439 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.440 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "max_completed_events": { 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_completed_events", 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "50", 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5", 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.444 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "prometheus", 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: "cache": { 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cache", 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.445 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: "exclude_perf_counters": { 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "exclude_perf_counters", 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.446 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.447 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.448 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.449 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.450 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.451 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.452 INFO:teuthology.orchestra.run.smithi110.stdout: "rbd_stats_pools": { 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rbd_stats_pools", 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "300", 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "scrape_interval": { 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "scrape_interval", 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "15.0", 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "server_addr": { 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_addr", 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "::", 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.456 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: "server_port": { 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_port", 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "9283", 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.457 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: "stale_cache_strategy": { 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "stale_cache_strategy", 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "log", 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.458 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: "standby_behaviour": { 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "standby_behaviour", 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "default", 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.459 INFO:teuthology.orchestra.run.smithi110.stdout: "default", 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: "error" 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: "standby_error_status_code": { 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "standby_error_status_code", 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.460 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "500", 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "400", 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "599", 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rbd_support", 2024-09-12T02:30:46.461 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.462 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.463 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.464 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.465 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.466 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: "max_concurrent_snap_create": { 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.467 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.468 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: "trash_purge_schedule": { 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "trash_purge_schedule", 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.469 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "restful", 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.470 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "enable_auth": { 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "enable_auth", 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.472 INFO:teuthology.orchestra.run.smithi110.stdout: "key_file": { 2024-09-12T02:30:46.472 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "key_file", 2024-09-12T02:30:46.472 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.472 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.472 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.472 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.472 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.472 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.472 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.472 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.472 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.473 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.474 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.476 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.477 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "server_addr": { 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_addr", 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.478 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "server_port": { 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_port", 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.479 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rgw", 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.480 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.481 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.482 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.483 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.484 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.485 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rook", 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.486 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.487 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.488 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.489 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.490 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "storage_class": { 2024-09-12T02:30:46.491 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "storage_class", 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "local", 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "selftest", 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.493 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.496 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.497 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: "roption1": { 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "roption1", 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.498 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "roption2": { 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "roption2", 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.499 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "xyz", 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption1": { 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption1", 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.500 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption2": { 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption2", 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.501 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption3": { 2024-09-12T02:30:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption3", 2024-09-12T02:30:46.502 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption4": { 2024-09-12T02:30:46.503 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption4", 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.504 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption5": { 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption5", 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption6": { 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption6", 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption7": { 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption7", 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1", 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "42", 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "testkey": { 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "testkey", 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.508 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: "testlkey": { 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "testlkey", 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.509 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "testnewline": { 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "testnewline", 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.510 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "snap_schedule", 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: "allow_m_granularity": { 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "allow_m_granularity", 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.511 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "dump_on_update": { 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "dump_on_update", 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.512 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.513 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.514 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.515 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.516 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.516 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.516 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.516 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.516 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.516 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.516 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.516 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.516 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.516 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.516 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.517 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "stats", 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.519 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.522 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.523 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "status", 2024-09-12T02:30:46.524 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.525 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.526 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.527 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.528 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.529 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "telegraf", 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: "address": { 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "address", 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.530 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.531 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.531 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:30:46.531 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.531 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.531 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.531 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.531 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.531 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.531 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.531 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:46.531 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "15", 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.532 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.534 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.535 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.536 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.537 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "telemetry", 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_basic": { 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_basic", 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.538 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_crash": { 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_crash", 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.539 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_device": { 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_device", 2024-09-12T02:30:46.540 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_ident": { 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_ident", 2024-09-12T02:30:46.541 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_perf": { 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_perf", 2024-09-12T02:30:46.542 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "contact": { 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "contact", 2024-09-12T02:30:46.543 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "description": { 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "description", 2024-09-12T02:30:46.544 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.545 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.545 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.545 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.545 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.545 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.545 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.545 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.545 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.545 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.545 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.545 INFO:teuthology.orchestra.run.smithi110.stdout: "device_url": { 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "device_url", 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": { 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "enabled", 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "24", 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "8", 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.548 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "last_opt_revision": { 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "last_opt_revision", 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "1", 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.549 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: "leaderboard": { 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "leaderboard", 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.550 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "leaderboard_description": { 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "leaderboard_description", 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.551 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.552 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.553 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.554 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.555 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.556 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "organization": { 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "organization", 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.557 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "proxy": { 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "proxy", 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.558 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.559 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.559 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.559 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.559 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.559 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.559 INFO:teuthology.orchestra.run.smithi110.stdout: "url": { 2024-09-12T02:30:46.559 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "url", 2024-09-12T02:30:46.559 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.559 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.559 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.559 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "test_orchestrator", 2024-09-12T02:30:46.560 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.561 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.562 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.563 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.564 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.565 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "volumes", 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.566 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.567 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.568 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.569 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.571 INFO:teuthology.orchestra.run.smithi110.stdout: "max_concurrent_clones": { 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_concurrent_clones", 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "4", 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.572 INFO:teuthology.orchestra.run.smithi110.stdout: "periodic_async_work": { 2024-09-12T02:30:46.573 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "periodic_async_work", 2024-09-12T02:30:46.573 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.573 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.573 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.573 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.573 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.573 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.573 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.573 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Periodically check for async work", 2024-09-12T02:30:46.573 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.573 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.573 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: "snapshot_clone_delay": { 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.574 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:30:46.575 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "zabbix", 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: "discovery_interval": { 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "discovery_interval", 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:46.576 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "100", 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: "identifier": { 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "identifier", 2024-09-12T02:30:46.577 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:46.578 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.579 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.580 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.581 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.582 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "zabbix_host": { 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "zabbix_host", 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "zabbix_port": { 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "zabbix_port", 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10051", 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "zabbix_sender": { 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "zabbix_sender", 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.587 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: "gid": 25159, 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "z", 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr_features": 4540701547738038271, 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: "available_modules": [ 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "alerts", 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.588 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.589 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.590 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.591 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.592 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.593 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.594 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_destination": { 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_destination", 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.595 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_from_name": { 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_from_name", 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "Ceph", 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.596 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Email From: name", 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_host": { 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_host", 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.597 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "SMTP server", 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_password": { 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_password", 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.598 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Password to authenticate with", 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_port": { 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_port", 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "465", 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.599 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "SMTP port", 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_sender": { 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_sender", 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.600 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_ssl": { 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_ssl", 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.601 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.602 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:30:46.602 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.602 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.602 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.602 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_user": { 2024-09-12T02:30:46.602 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_user", 2024-09-12T02:30:46.602 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.602 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.602 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.602 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.602 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "User to authenticate as", 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "balancer", 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.603 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "active": { 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "active", 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.604 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: "begin_time": { 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "begin_time", 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0000", 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:30:46.605 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "begin_weekday": { 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "begin_weekday", 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "0", 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "6", 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:30:46.606 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "crush_compat_max_iterations": { 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "25", 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1", 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "250", 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:30:46.608 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.608 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.608 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.608 INFO:teuthology.orchestra.run.smithi110.stdout: "crush_compat_metrics": { 2024-09-12T02:30:46.608 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crush_compat_metrics", 2024-09-12T02:30:46.608 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.608 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.608 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.608 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:30:46.608 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.608 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "crush_compat_step": { 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crush_compat_step", 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0.5", 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "0.001", 2024-09-12T02:30:46.609 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "0.999", 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "end_time": { 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "end_time", 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "2359", 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.610 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: "end_weekday": { 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "end_weekday", 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:46.611 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "0", 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "6", 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.612 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.615 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.615 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.615 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.615 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.615 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.615 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.615 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.615 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.615 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.615 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.615 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.615 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.616 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: "min_score": { 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "min_score", 2024-09-12T02:30:46.617 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "mode": { 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mode", 2024-09-12T02:30:46.618 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "upmap", 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: "crush-compat", 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: "none", 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: "read", 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: "upmap", 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: "upmap-read" 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.619 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Balancer mode", 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "pool_ids": { 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "pool_ids", 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.621 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "upmap_max_deviation": { 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "upmap_max_deviation", 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5", 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1", 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.622 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "upmap_max_optimizations": { 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.623 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cephadm", 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.624 INFO:teuthology.orchestra.run.smithi110.stdout: "agent_down_multiplier": { 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "agent_down_multiplier", 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "3.0", 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.625 INFO:teuthology.orchestra.run.smithi110.stdout: "agent_refresh_rate": { 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "agent_refresh_rate", 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "20", 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "agent_starting_port": { 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "agent_starting_port", 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "4721", 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.627 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.628 INFO:teuthology.orchestra.run.smithi110.stdout: "allow_ptrace": { 2024-09-12T02:30:46.628 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "allow_ptrace", 2024-09-12T02:30:46.628 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.628 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.628 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.628 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.628 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.628 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.628 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.628 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:30:46.628 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: "autotune_interval": { 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "autotune_interval", 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.629 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0.7", 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.630 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: "cephadm_log_destination": { 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cephadm_log_destination", 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.631 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: "file", 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: "file,syslog", 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: "syslog" 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: "cgroups_split": { 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cgroups_split", 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.632 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "config_checks_enabled": { 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "config_checks_enabled", 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.633 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: "config_dashboard": { 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "config_dashboard", 2024-09-12T02:30:46.634 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_alertmanager": { 2024-09-12T02:30:46.635 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_alertmanager", 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Prometheus container image", 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.636 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_base": { 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_base", 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.637 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_elasticsearch": { 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "elasticsearch container image", 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.638 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_grafana": { 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_grafana", 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Prometheus container image", 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.639 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_haproxy": { 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_haproxy", 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "HAproxy container image", 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.640 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_jaeger_agent": { 2024-09-12T02:30:46.641 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:30:46.641 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.641 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.641 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.641 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:30:46.641 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.641 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.641 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.641 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:30:46.641 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.641 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_jaeger_collector": { 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.642 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_jaeger_query": { 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Jaeger query container image", 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.643 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_keepalived": { 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_keepalived", 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Keepalived container image", 2024-09-12T02:30:46.644 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_loki": { 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_loki", 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Loki container image", 2024-09-12T02:30:46.645 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_node_exporter": { 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_node_exporter", 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.646 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Prometheus container image", 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_nvmeof": { 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_nvmeof", 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.647 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Nvme-of container image", 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_prometheus": { 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_prometheus", 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.648 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Prometheus container image", 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_promtail": { 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_promtail", 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.649 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Promtail container image", 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_samba": { 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_samba", 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.650 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_snmp_gateway": { 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.651 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: "container_init": { 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_init", 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.652 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: "daemon_cache_timeout": { 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:46.653 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "900", 2024-09-12T02:30:46.654 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: "default_registry": { 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "default_registry", 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.655 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "docker.io", 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "device_cache_timeout": { 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "device_cache_timeout", 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.656 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "1800", 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "device_enhanced_scan": { 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "device_enhanced_scan", 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.657 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: "facts_cache_timeout": { 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "facts_cache_timeout", 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.658 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "grafana_dashboards_path": { 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.659 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: "host_check_interval": { 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "host_check_interval", 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.660 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "hw_monitoring": { 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "hw_monitoring", 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.661 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "inventory_list_all": { 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "inventory_list_all", 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.662 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.663 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.664 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "log_refresh_metadata": { 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_refresh_metadata", 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:30:46.665 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.666 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.666 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.666 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.666 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.666 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.666 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.666 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.666 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.666 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.666 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.666 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.667 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.668 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.670 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "*", 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.671 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: "max_count_per_host": { 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_count_per_host", 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.672 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: "max_osd_draining_count": { 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_osd_draining_count", 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:30:46.673 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "migration_current": { 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "migration_current", 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "internal - do not modify", 2024-09-12T02:30:46.674 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: "mode": { 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mode", 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "root", 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.675 INFO:teuthology.orchestra.run.smithi110.stdout: "cephadm-package", 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: "root" 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: "oob_default_addr": { 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "oob_default_addr", 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.676 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "169.254.1.1", 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "prometheus_alerts_path": { 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.677 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "registry_insecure": { 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "registry_insecure", 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.678 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: "registry_password": { 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "registry_password", 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.679 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: "registry_url": { 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "registry_url", 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.680 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: "registry_username": { 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "registry_username", 2024-09-12T02:30:46.681 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "secure_monitoring_stack": { 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:30:46.682 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "service_discovery_port": { 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "service_discovery_port", 2024-09-12T02:30:46.683 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8765", 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: "ssh_config_file": { 2024-09-12T02:30:46.684 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ssh_config_file", 2024-09-12T02:30:46.685 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.685 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.685 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.685 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.685 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.685 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.685 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.685 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:30:46.685 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.685 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.685 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.687 INFO:teuthology.orchestra.run.smithi110.stdout: "use_agent": { 2024-09-12T02:30:46.687 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "use_agent", 2024-09-12T02:30:46.687 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "use_repo_digest": { 2024-09-12T02:30:46.688 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "use_repo_digest", 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_on_failed_host_check": { 2024-09-12T02:30:46.689 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_on_stray_daemons": { 2024-09-12T02:30:46.690 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_on_stray_hosts": { 2024-09-12T02:30:46.691 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crash", 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.693 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.694 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.694 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.694 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.694 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.694 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.694 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.694 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.694 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.694 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.694 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.694 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.696 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.697 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "retain_interval": { 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "retain_interval", 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.698 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "31536000", 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_recent_interval": { 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_recent_interval", 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.699 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "1209600", 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.700 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "dashboard", 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.701 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.702 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.703 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.704 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.705 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.706 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.707 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.708 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.708 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.708 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.708 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.708 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:30:46.708 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:30:46.708 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.708 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.708 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.708 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.708 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.709 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.710 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.711 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.712 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.713 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.714 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.715 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "admin", 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.716 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_API_URL": { 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.717 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.718 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "admin", 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.719 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:30:46.720 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:30:46.721 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.722 INFO:teuthology.orchestra.run.smithi110.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.723 INFO:teuthology.orchestra.run.smithi110.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.724 INFO:teuthology.orchestra.run.smithi110.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.726 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.727 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.728 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.729 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.730 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.731 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.732 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.733 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.734 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.735 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8", 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.736 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "45", 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.737 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.738 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "admin", 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.739 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.740 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.741 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.742 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.743 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.744 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5", 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "cross_origin_url": { 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cross_origin_url", 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.745 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "crt_file": { 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crt_file", 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.746 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "debug": { 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "debug", 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.747 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: "jwt_token_ttl": { 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "jwt_token_ttl", 2024-09-12T02:30:46.748 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "28800", 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: "key_file": { 2024-09-12T02:30:46.749 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "key_file", 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.750 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.751 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.752 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.753 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.754 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.755 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: "motd": { 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "motd", 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "The message of the day", 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.756 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.757 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: "server_addr": { 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_addr", 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "::", 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.758 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "server_port": { 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_port", 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8080", 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.759 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "ssl": { 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ssl", 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.760 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: "ssl_server_port": { 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ssl_server_port", 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8443", 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.761 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "standby_behaviour": { 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "standby_behaviour", 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "redirect", 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.762 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: "redirect" 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: "standby_error_status_code": { 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "standby_error_status_code", 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.763 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "500", 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "400", 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "599", 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: "url_prefix": { 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "url_prefix", 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.764 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.765 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "devicehealth", 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "enable_monitoring": { 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "enable_monitoring", 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.766 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "monitor device health metrics", 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.767 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.768 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.770 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.771 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.772 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.772 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.772 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.772 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.772 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.772 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.772 INFO:teuthology.orchestra.run.smithi110.stdout: "mark_out_threshold": { 2024-09-12T02:30:46.772 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mark_out_threshold", 2024-09-12T02:30:46.772 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.772 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.772 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "2419200", 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "pool_name": { 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "pool_name", 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.773 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "device_health_metrics", 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: "retention_period": { 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "retention_period", 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.774 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "15552000", 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: "scrape_frequency": { 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "scrape_frequency", 2024-09-12T02:30:46.775 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "86400", 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "self_heal": { 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "self_heal", 2024-09-12T02:30:46.776 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.777 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.777 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.777 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.777 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.777 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.777 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.777 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:30:46.777 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.777 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.777 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.777 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.778 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_threshold": { 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_threshold", 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "7257600", 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.779 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.780 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "diskprediction_local", 2024-09-12T02:30:46.780 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.780 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.780 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.780 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.780 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.780 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.780 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.780 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.781 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.782 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.783 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.784 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: "predict_interval": { 2024-09-12T02:30:46.785 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "predict_interval", 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "86400", 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "predictor_model": { 2024-09-12T02:30:46.786 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "predictor_model", 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "prophetstor", 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:46.787 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "influx", 2024-09-12T02:30:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": false, 2024-09-12T02:30:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:30:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: "batch_size": { 2024-09-12T02:30:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "batch_size", 2024-09-12T02:30:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.789 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5000", 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "database": { 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "database", 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.790 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "ceph", 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: "hostname": { 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "hostname", 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.791 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.792 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "30", 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "5", 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "password": { 2024-09-12T02:30:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "password", 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "port": { 2024-09-12T02:30:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "port", 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8086", 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "InfluxDB server port", 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "ssl": { 2024-09-12T02:30:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ssl", 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "false", 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "threads": { 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "threads", 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5", 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1", 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "32", 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "username": { 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "username", 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "verify_ssl": { 2024-09-12T02:30:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "verify_ssl", 2024-09-12T02:30:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "true", 2024-09-12T02:30:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:30:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "insights", 2024-09-12T02:30:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "iostat", 2024-09-12T02:30:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "k8sevents", 2024-09-12T02:30:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_event_retention_days": { 2024-09-12T02:30:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:30:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "7", 2024-09-12T02:30:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:30:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "config_check_secs": { 2024-09-12T02:30:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "config_check_secs", 2024-09-12T02:30:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "10", 2024-09-12T02:30:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:30:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "localpool", 2024-09-12T02:30:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "failure_domain": { 2024-09-12T02:30:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "failure_domain", 2024-09-12T02:30:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "host", 2024-09-12T02:30:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:30:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:30:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "min_size": { 2024-09-12T02:30:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "min_size", 2024-09-12T02:30:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:30:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:30:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "num_rep": { 2024-09-12T02:30:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "num_rep", 2024-09-12T02:30:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "3", 2024-09-12T02:30:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:30:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "pg_num": { 2024-09-12T02:30:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "pg_num", 2024-09-12T02:30:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "128", 2024-09-12T02:30:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:30:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "prefix": { 2024-09-12T02:30:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "prefix", 2024-09-12T02:30:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:30:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "subtree": { 2024-09-12T02:30:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "subtree", 2024-09-12T02:30:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "rack", 2024-09-12T02:30:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:30:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:30:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mds_autoscaler", 2024-09-12T02:30:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mirroring", 2024-09-12T02:30:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "nfs", 2024-09-12T02:30:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "orchestrator", 2024-09-12T02:30:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "fail_fs": { 2024-09-12T02:30:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "fail_fs", 2024-09-12T02:30:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:30:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "orchestrator": { 2024-09-12T02:30:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "orchestrator", 2024-09-12T02:30:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "cephadm", 2024-09-12T02:30:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "rook", 2024-09-12T02:30:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "test_orchestrator" 2024-09-12T02:30:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Orchestrator backend", 2024-09-12T02:30:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "osd_perf_query", 2024-09-12T02:30:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "osd_support", 2024-09-12T02:30:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.885 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.886 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "pg_autoscaler", 2024-09-12T02:30:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.887 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.888 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.889 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.890 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.891 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.893 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.894 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: "threshold": { 2024-09-12T02:30:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "threshold", 2024-09-12T02:30:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "3.0", 2024-09-12T02:30:46.895 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1.0", 2024-09-12T02:30:46.896 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.896 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.896 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "scaling threshold", 2024-09-12T02:30:46.896 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:30:46.896 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.896 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.896 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "progress", 2024-09-12T02:30:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: "allow_pg_recovery_event": { 2024-09-12T02:30:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:30:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.898 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:30:46.898 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.898 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.898 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.898 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": { 2024-09-12T02:30:46.898 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "enabled", 2024-09-12T02:30:46.898 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.898 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.898 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.898 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.899 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.899 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.899 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.899 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.899 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.899 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.899 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.899 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.899 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.899 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.899 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.900 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.900 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.900 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.900 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.900 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.900 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.900 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.900 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.900 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.900 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.900 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.900 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.901 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.901 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.901 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.901 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.901 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.901 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.901 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.901 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.901 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.901 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.902 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.902 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.902 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.902 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.902 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.902 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.902 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.902 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.902 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.902 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.902 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.903 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.903 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.903 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.903 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.903 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.903 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.903 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.903 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.903 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.903 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.903 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.903 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.904 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.904 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.904 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.904 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.904 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.904 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.904 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.904 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.904 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.904 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.905 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.905 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.905 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.905 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.905 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.905 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.905 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.905 INFO:teuthology.orchestra.run.smithi110.stdout: "max_completed_events": { 2024-09-12T02:30:46.905 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_completed_events", 2024-09-12T02:30:46.905 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.906 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.906 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.906 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "50", 2024-09-12T02:30:46.906 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.906 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.906 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.906 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:30:46.906 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.906 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.906 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.906 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:46.907 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:46.907 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:46.907 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.907 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.907 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5", 2024-09-12T02:30:46.907 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.907 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.907 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.907 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:30:46.907 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.907 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.907 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.908 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.908 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.908 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "prometheus", 2024-09-12T02:30:46.908 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.908 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.908 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.908 INFO:teuthology.orchestra.run.smithi110.stdout: "cache": { 2024-09-12T02:30:46.908 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cache", 2024-09-12T02:30:46.908 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.909 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.909 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.909 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.909 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.909 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.909 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.909 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.909 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.909 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.909 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.910 INFO:teuthology.orchestra.run.smithi110.stdout: "exclude_perf_counters": { 2024-09-12T02:30:46.910 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "exclude_perf_counters", 2024-09-12T02:30:46.910 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.910 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.910 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.910 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.910 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.910 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.910 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.910 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:30:46.910 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:30:46.911 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.911 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.911 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.911 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.911 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.911 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.911 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.911 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.911 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.911 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.911 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.912 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.912 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.912 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.912 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.912 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.912 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.912 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.912 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.912 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.912 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.912 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.913 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.913 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.913 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.913 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.913 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.913 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.913 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.913 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.913 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.913 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.914 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.914 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.914 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.914 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.914 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.914 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.914 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.914 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.914 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.914 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.915 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.915 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.915 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.915 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.915 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.915 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.915 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.915 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.915 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.915 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.915 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.916 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.916 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.916 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.916 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.916 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.916 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.916 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.916 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.916 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.916 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.917 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.917 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.917 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.917 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.917 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.917 INFO:teuthology.orchestra.run.smithi110.stdout: "rbd_stats_pools": { 2024-09-12T02:30:46.917 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rbd_stats_pools", 2024-09-12T02:30:46.917 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.917 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.917 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.918 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.918 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.918 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.918 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.918 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.918 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.918 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.918 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.918 INFO:teuthology.orchestra.run.smithi110.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:30:46.918 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:30:46.919 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.919 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.919 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.919 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "300", 2024-09-12T02:30:46.919 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.919 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.919 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.919 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.919 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.919 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.919 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.920 INFO:teuthology.orchestra.run.smithi110.stdout: "scrape_interval": { 2024-09-12T02:30:46.920 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "scrape_interval", 2024-09-12T02:30:46.920 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:46.920 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.920 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.920 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "15.0", 2024-09-12T02:30:46.920 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.920 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.920 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.920 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.920 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.921 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.921 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.921 INFO:teuthology.orchestra.run.smithi110.stdout: "server_addr": { 2024-09-12T02:30:46.921 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_addr", 2024-09-12T02:30:46.921 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.921 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.921 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.921 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "::", 2024-09-12T02:30:46.921 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.921 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.921 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.922 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:30:46.922 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.922 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.922 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.922 INFO:teuthology.orchestra.run.smithi110.stdout: "server_port": { 2024-09-12T02:30:46.922 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_port", 2024-09-12T02:30:46.922 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.922 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.922 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.922 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "9283", 2024-09-12T02:30:46.922 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.923 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.923 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.923 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:30:46.923 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.923 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.923 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.923 INFO:teuthology.orchestra.run.smithi110.stdout: "stale_cache_strategy": { 2024-09-12T02:30:46.923 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "stale_cache_strategy", 2024-09-12T02:30:46.923 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.923 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.924 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.924 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "log", 2024-09-12T02:30:46.924 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.924 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.924 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.924 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.924 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.924 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.924 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.924 INFO:teuthology.orchestra.run.smithi110.stdout: "standby_behaviour": { 2024-09-12T02:30:46.925 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "standby_behaviour", 2024-09-12T02:30:46.925 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.925 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.925 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.925 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "default", 2024-09-12T02:30:46.925 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.925 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.925 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.925 INFO:teuthology.orchestra.run.smithi110.stdout: "default", 2024-09-12T02:30:46.925 INFO:teuthology.orchestra.run.smithi110.stdout: "error" 2024-09-12T02:30:46.925 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.925 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.926 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.926 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.926 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.926 INFO:teuthology.orchestra.run.smithi110.stdout: "standby_error_status_code": { 2024-09-12T02:30:46.926 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "standby_error_status_code", 2024-09-12T02:30:46.926 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.926 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.926 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.926 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "500", 2024-09-12T02:30:46.926 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "400", 2024-09-12T02:30:46.926 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "599", 2024-09-12T02:30:46.927 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.927 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.927 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.927 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.927 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.927 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.927 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.927 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rbd_support", 2024-09-12T02:30:46.927 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.928 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.928 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.928 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.928 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.928 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.928 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.928 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.928 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.928 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.928 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.928 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.928 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.930 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.931 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.931 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.931 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.931 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.931 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.931 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.931 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.931 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.931 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.931 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.932 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.932 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.932 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.932 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.932 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.932 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.932 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.932 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.932 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.932 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.932 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.933 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.933 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.933 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.933 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.933 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.933 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.933 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.933 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.933 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.933 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.933 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.934 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.934 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.934 INFO:teuthology.orchestra.run.smithi110.stdout: "max_concurrent_snap_create": { 2024-09-12T02:30:46.934 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:30:46.934 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.934 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.934 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.934 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:46.934 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.934 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.934 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.935 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.935 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.935 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.935 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.935 INFO:teuthology.orchestra.run.smithi110.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:30:46.935 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:30:46.935 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.935 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.935 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.935 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.935 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.936 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.936 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.936 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.936 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.936 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.936 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.936 INFO:teuthology.orchestra.run.smithi110.stdout: "trash_purge_schedule": { 2024-09-12T02:30:46.936 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "trash_purge_schedule", 2024-09-12T02:30:46.936 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.936 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.937 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.937 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.937 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.937 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.937 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.937 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.937 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.937 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.937 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.937 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.937 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.938 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "restful", 2024-09-12T02:30:46.938 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.938 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.938 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.938 INFO:teuthology.orchestra.run.smithi110.stdout: "enable_auth": { 2024-09-12T02:30:46.938 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "enable_auth", 2024-09-12T02:30:46.938 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.938 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.938 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.938 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.939 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.939 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.939 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.939 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.939 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.939 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.939 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.939 INFO:teuthology.orchestra.run.smithi110.stdout: "key_file": { 2024-09-12T02:30:46.939 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "key_file", 2024-09-12T02:30:46.939 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.939 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.940 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.940 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.940 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.940 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.940 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.940 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.940 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.940 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.940 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.940 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.940 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.941 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.941 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.941 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.941 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.941 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.941 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.941 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.941 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.941 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.941 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.941 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.942 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.942 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.942 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.942 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.942 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.942 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.942 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.942 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.942 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.942 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.943 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.943 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.943 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.943 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.943 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.943 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.943 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.943 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.943 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.943 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.943 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.944 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.944 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.944 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.944 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.944 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.944 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.944 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.944 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.944 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.944 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.944 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.945 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.945 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.945 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.945 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.945 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.945 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.945 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.945 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.945 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.945 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.946 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.946 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.946 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.946 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.946 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.946 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.946 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.946 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.946 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.946 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.946 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi110.stdout: "server_addr": { 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_addr", 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.947 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.948 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.948 INFO:teuthology.orchestra.run.smithi110.stdout: "server_port": { 2024-09-12T02:30:46.948 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_port", 2024-09-12T02:30:46.948 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.948 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.948 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.948 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.948 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.948 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.948 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.949 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.949 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.949 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.949 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.949 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.949 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.949 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rgw", 2024-09-12T02:30:46.949 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.949 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.949 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.950 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.950 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.950 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.950 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.950 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.950 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.950 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.950 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.950 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.950 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.950 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.950 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.951 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.951 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.951 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.951 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.951 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.951 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.951 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.951 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.951 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.951 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.952 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.952 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.952 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.952 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.952 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.952 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.952 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.952 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.952 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.952 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.952 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.953 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.953 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.953 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.953 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.953 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.953 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.953 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.953 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.953 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.953 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.953 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.953 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.954 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.954 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.954 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.954 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.954 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.954 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.954 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.954 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.954 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.954 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.955 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.955 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.955 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.955 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.955 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.955 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.955 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.955 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.955 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.955 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.955 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rook", 2024-09-12T02:30:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.956 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.957 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.957 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.957 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.957 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.957 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.957 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.957 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.957 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.957 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.957 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.957 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.957 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.958 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.958 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.958 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.958 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.958 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.958 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.958 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.958 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.958 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.958 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.959 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.959 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.959 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.959 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.959 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.959 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.959 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.959 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.959 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.959 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.960 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.960 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.960 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.960 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.960 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.960 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.960 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.960 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.960 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.960 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.961 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.961 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.961 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.961 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.961 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.961 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.961 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.961 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.961 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.961 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.962 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.962 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.962 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.962 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.962 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.962 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.962 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.962 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.962 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.962 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.962 INFO:teuthology.orchestra.run.smithi110.stdout: "storage_class": { 2024-09-12T02:30:46.963 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "storage_class", 2024-09-12T02:30:46.963 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.963 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.963 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.963 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "local", 2024-09-12T02:30:46.963 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.963 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.963 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.963 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:30:46.963 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.963 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.964 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.964 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "selftest", 2024-09-12T02:30:46.964 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.964 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.964 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.964 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.964 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.965 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.965 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.965 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.965 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.965 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.965 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.965 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.965 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.965 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.965 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.965 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.965 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.966 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.966 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.966 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.966 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.966 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.966 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.966 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.966 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.966 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.966 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.967 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.967 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.967 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.967 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.967 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.967 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.967 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.967 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.967 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.967 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.967 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.968 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.968 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.968 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.968 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.968 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.968 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.968 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.968 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.968 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.968 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.968 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.969 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.969 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.969 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.969 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.969 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.969 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.969 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.969 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.969 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.969 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.969 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.970 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.970 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.970 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.970 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.970 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.970 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.970 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.970 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.970 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.970 INFO:teuthology.orchestra.run.smithi110.stdout: "roption1": { 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "roption1", 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.971 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.972 INFO:teuthology.orchestra.run.smithi110.stdout: "roption2": { 2024-09-12T02:30:46.972 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "roption2", 2024-09-12T02:30:46.972 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.972 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.972 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.972 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "xyz", 2024-09-12T02:30:46.972 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.972 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.972 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.972 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.972 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.973 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.973 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.973 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption1": { 2024-09-12T02:30:46.973 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption1", 2024-09-12T02:30:46.973 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.973 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.973 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.973 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.973 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.973 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.974 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.974 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.974 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.974 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.974 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.974 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption2": { 2024-09-12T02:30:46.974 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption2", 2024-09-12T02:30:46.974 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.974 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.974 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.975 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.975 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.975 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.975 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.975 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.975 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.975 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.975 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.975 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption3": { 2024-09-12T02:30:46.975 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption3", 2024-09-12T02:30:46.975 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:46.976 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.976 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.976 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.976 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.976 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.976 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.976 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.976 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.976 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.976 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption4": { 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption4", 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.977 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.978 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.978 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption5": { 2024-09-12T02:30:46.978 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption5", 2024-09-12T02:30:46.978 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.978 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.978 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.978 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.978 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.978 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.978 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.979 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.979 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.979 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.979 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.979 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption6": { 2024-09-12T02:30:46.979 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption6", 2024-09-12T02:30:46.979 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.979 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.979 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.979 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:46.979 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.980 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.980 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.980 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.980 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.980 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.980 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.980 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption7": { 2024-09-12T02:30:46.980 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption7", 2024-09-12T02:30:46.980 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:46.980 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.981 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.981 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.981 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1", 2024-09-12T02:30:46.981 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "42", 2024-09-12T02:30:46.981 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.981 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.981 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.981 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.981 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.981 INFO:teuthology.orchestra.run.smithi110.stdout: "testkey": { 2024-09-12T02:30:46.982 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "testkey", 2024-09-12T02:30:46.982 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.982 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.982 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.982 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.982 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.982 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.982 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.982 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.982 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.982 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.982 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.983 INFO:teuthology.orchestra.run.smithi110.stdout: "testlkey": { 2024-09-12T02:30:46.983 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "testlkey", 2024-09-12T02:30:46.983 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.983 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.983 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.983 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.983 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.983 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.983 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.983 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.984 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.984 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.984 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.984 INFO:teuthology.orchestra.run.smithi110.stdout: "testnewline": { 2024-09-12T02:30:46.984 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "testnewline", 2024-09-12T02:30:46.984 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.984 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.984 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:46.984 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.984 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.985 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.985 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.985 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.985 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.985 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.985 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.985 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.985 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.985 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "snap_schedule", 2024-09-12T02:30:46.985 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.986 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.986 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.986 INFO:teuthology.orchestra.run.smithi110.stdout: "allow_m_granularity": { 2024-09-12T02:30:46.986 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "allow_m_granularity", 2024-09-12T02:30:46.986 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.986 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.986 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.986 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.986 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.986 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.986 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.986 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:30:46.987 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.987 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.987 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.987 INFO:teuthology.orchestra.run.smithi110.stdout: "dump_on_update": { 2024-09-12T02:30:46.987 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "dump_on_update", 2024-09-12T02:30:46.987 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.987 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.987 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.987 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.987 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.987 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.988 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.988 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:30:46.988 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.988 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.988 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.988 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.988 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.988 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.988 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.988 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.989 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.989 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.989 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.989 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.989 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.989 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.989 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.989 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.989 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.989 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.989 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.990 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.991 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.992 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.993 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.994 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "stats", 2024-09-12T02:30:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.995 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:46.996 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.997 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:46.998 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:46.999 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.000 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "status", 2024-09-12T02:30:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.002 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.003 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.004 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.005 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.006 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.007 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "telegraf", 2024-09-12T02:30:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.008 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "address": { 2024-09-12T02:30:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "address", 2024-09-12T02:30:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:30:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.009 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "15", 2024-09-12T02:30:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.010 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.011 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.012 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.013 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.014 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.015 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.016 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.017 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "telemetry", 2024-09-12T02:30:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_basic": { 2024-09-12T02:30:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_basic", 2024-09-12T02:30:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.018 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:30:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.019 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_crash": { 2024-09-12T02:30:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_crash", 2024-09-12T02:30:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.020 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:30:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_device": { 2024-09-12T02:30:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_device", 2024-09-12T02:30:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.021 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:30:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_ident": { 2024-09-12T02:30:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_ident", 2024-09-12T02:30:47.022 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:30:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.023 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_perf": { 2024-09-12T02:30:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_perf", 2024-09-12T02:30:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:30:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.024 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "contact": { 2024-09-12T02:30:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "contact", 2024-09-12T02:30:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.025 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "description": { 2024-09-12T02:30:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "description", 2024-09-12T02:30:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.026 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "device_url": { 2024-09-12T02:30:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "device_url", 2024-09-12T02:30:47.027 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:30:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": { 2024-09-12T02:30:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "enabled", 2024-09-12T02:30:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.029 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "24", 2024-09-12T02:30:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "8", 2024-09-12T02:30:47.030 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "last_opt_revision": { 2024-09-12T02:30:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "last_opt_revision", 2024-09-12T02:30:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.031 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "1", 2024-09-12T02:30:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "leaderboard": { 2024-09-12T02:30:47.032 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "leaderboard", 2024-09-12T02:30:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.033 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "leaderboard_description": { 2024-09-12T02:30:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "leaderboard_description", 2024-09-12T02:30:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.034 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.035 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.036 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.037 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.038 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.039 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.040 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "organization": { 2024-09-12T02:30:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "organization", 2024-09-12T02:30:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.041 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "proxy": { 2024-09-12T02:30:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "proxy", 2024-09-12T02:30:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.042 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "url": { 2024-09-12T02:30:47.043 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "url", 2024-09-12T02:30:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:30:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.044 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "test_orchestrator", 2024-09-12T02:30:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.045 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.046 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.047 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.048 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.049 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.050 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.051 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "volumes", 2024-09-12T02:30:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.052 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.053 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.054 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.055 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.056 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "max_concurrent_clones": { 2024-09-12T02:30:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_concurrent_clones", 2024-09-12T02:30:47.058 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "4", 2024-09-12T02:30:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:30:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "periodic_async_work": { 2024-09-12T02:30:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "periodic_async_work", 2024-09-12T02:30:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Periodically check for async work", 2024-09-12T02:30:47.060 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "snapshot_clone_delay": { 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.061 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:30:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:30:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:30:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.062 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:30:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "zabbix", 2024-09-12T02:30:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "discovery_interval": { 2024-09-12T02:30:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "discovery_interval", 2024-09-12T02:30:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "100", 2024-09-12T02:30:47.064 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "identifier": { 2024-09-12T02:30:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "identifier", 2024-09-12T02:30:47.065 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.066 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.067 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.068 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.069 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.070 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.071 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.072 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.073 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "zabbix_host": { 2024-09-12T02:30:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "zabbix_host", 2024-09-12T02:30:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.074 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "zabbix_port": { 2024-09-12T02:30:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "zabbix_port", 2024-09-12T02:30:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10051", 2024-09-12T02:30:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.075 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "zabbix_sender": { 2024-09-12T02:30:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "zabbix_sender", 2024-09-12T02:30:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.076 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:30:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T02:30:47.077 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "modules": [ 2024-09-12T02:30:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "cephadm", 2024-09-12T02:30:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "dashboard", 2024-09-12T02:30:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "iostat", 2024-09-12T02:30:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "nfs", 2024-09-12T02:30:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "restful", 2024-09-12T02:30:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "snap_schedule" 2024-09-12T02:30:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "available_modules": [ 2024-09-12T02:30:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.078 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "alerts", 2024-09-12T02:30:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.079 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "How frequently to reexamine health status", 2024-09-12T02:30:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.080 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.081 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.081 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.081 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.081 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.081 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.081 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.081 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.081 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.081 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.081 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.081 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.082 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.082 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.082 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.082 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.082 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.082 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.082 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.082 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.082 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.082 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.083 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.083 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.083 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.083 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.083 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.083 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.083 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.083 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.083 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.083 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.083 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.084 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.084 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.084 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.084 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.084 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.084 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.084 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.084 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.084 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.084 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.084 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.085 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.085 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.085 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.085 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.085 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.085 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.085 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.085 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.085 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.085 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.085 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.086 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.086 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.086 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.086 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.086 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.086 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.086 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_destination": { 2024-09-12T02:30:47.086 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_destination", 2024-09-12T02:30:47.086 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.086 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.087 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.087 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.087 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.087 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.087 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.087 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Email address to send alerts to", 2024-09-12T02:30:47.087 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.087 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.087 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.087 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_from_name": { 2024-09-12T02:30:47.087 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_from_name", 2024-09-12T02:30:47.088 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.088 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.088 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.088 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "Ceph", 2024-09-12T02:30:47.088 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.088 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.088 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.088 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Email From: name", 2024-09-12T02:30:47.088 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.088 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.088 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.089 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_host": { 2024-09-12T02:30:47.089 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_host", 2024-09-12T02:30:47.089 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.089 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.089 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.089 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.089 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.089 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.089 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.089 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "SMTP server", 2024-09-12T02:30:47.090 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.090 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.090 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.090 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_password": { 2024-09-12T02:30:47.090 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_password", 2024-09-12T02:30:47.090 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.090 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.090 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.090 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.090 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.090 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.091 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.091 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Password to authenticate with", 2024-09-12T02:30:47.091 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.091 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.091 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.091 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_port": { 2024-09-12T02:30:47.091 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_port", 2024-09-12T02:30:47.091 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.091 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.091 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.092 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "465", 2024-09-12T02:30:47.092 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.092 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.092 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.092 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "SMTP port", 2024-09-12T02:30:47.092 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.092 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.092 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.092 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_sender": { 2024-09-12T02:30:47.092 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_sender", 2024-09-12T02:30:47.092 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.093 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.093 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.093 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.093 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.093 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.093 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.093 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "SMTP envelope sender", 2024-09-12T02:30:47.093 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.093 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.093 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.094 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_ssl": { 2024-09-12T02:30:47.094 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_ssl", 2024-09-12T02:30:47.094 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.094 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.094 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.094 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.094 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.094 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.094 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.094 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-12T02:30:47.094 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.095 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.095 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.095 INFO:teuthology.orchestra.run.smithi110.stdout: "smtp_user": { 2024-09-12T02:30:47.095 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "smtp_user", 2024-09-12T02:30:47.095 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.095 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.095 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.095 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.095 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.095 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.096 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.096 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "User to authenticate as", 2024-09-12T02:30:47.096 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.096 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.096 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.096 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.096 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.096 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "balancer", 2024-09-12T02:30:47.096 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.096 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.097 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.097 INFO:teuthology.orchestra.run.smithi110.stdout: "active": { 2024-09-12T02:30:47.097 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "active", 2024-09-12T02:30:47.097 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.097 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.097 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.097 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.097 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.097 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.097 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.097 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "automatically balance PGs across cluster", 2024-09-12T02:30:47.098 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.098 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.098 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.098 INFO:teuthology.orchestra.run.smithi110.stdout: "begin_time": { 2024-09-12T02:30:47.098 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "begin_time", 2024-09-12T02:30:47.098 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.098 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.098 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.098 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0000", 2024-09-12T02:30:47.098 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.098 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.099 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.099 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "beginning time of day to automatically balance", 2024-09-12T02:30:47.099 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:30:47.099 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.099 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.099 INFO:teuthology.orchestra.run.smithi110.stdout: "begin_weekday": { 2024-09-12T02:30:47.099 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "begin_weekday", 2024-09-12T02:30:47.099 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:47.099 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.099 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.100 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:47.100 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "0", 2024-09-12T02:30:47.100 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "6", 2024-09-12T02:30:47.100 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.100 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-12T02:30:47.100 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:30:47.100 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.100 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.100 INFO:teuthology.orchestra.run.smithi110.stdout: "crush_compat_max_iterations": { 2024-09-12T02:30:47.100 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crush_compat_max_iterations", 2024-09-12T02:30:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "25", 2024-09-12T02:30:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1", 2024-09-12T02:30:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "250", 2024-09-12T02:30:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-12T02:30:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.102 INFO:teuthology.orchestra.run.smithi110.stdout: "crush_compat_metrics": { 2024-09-12T02:30:47.102 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crush_compat_metrics", 2024-09-12T02:30:47.102 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.102 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.102 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.102 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "pgs,objects,bytes", 2024-09-12T02:30:47.102 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.102 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.102 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.102 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-12T02:30:47.102 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-12T02:30:47.103 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.103 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.103 INFO:teuthology.orchestra.run.smithi110.stdout: "crush_compat_step": { 2024-09-12T02:30:47.103 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crush_compat_step", 2024-09-12T02:30:47.103 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:47.103 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.103 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.103 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0.5", 2024-09-12T02:30:47.103 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "0.001", 2024-09-12T02:30:47.103 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "0.999", 2024-09-12T02:30:47.103 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.104 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "aggressiveness of optimization", 2024-09-12T02:30:47.104 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-12T02:30:47.104 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.104 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.104 INFO:teuthology.orchestra.run.smithi110.stdout: "end_time": { 2024-09-12T02:30:47.104 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "end_time", 2024-09-12T02:30:47.104 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.104 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.104 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.104 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "2359", 2024-09-12T02:30:47.104 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "ending time of day to automatically balance", 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi110.stdout: "end_weekday": { 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "end_weekday", 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:47.105 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "0", 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "6", 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.106 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.107 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.107 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.107 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.107 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.107 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.107 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.107 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.107 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.107 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.107 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.107 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.107 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.108 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.108 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.108 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.108 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.108 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.108 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.108 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.108 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.108 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.108 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.109 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.109 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.109 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.109 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.109 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.109 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.109 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.109 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.109 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.109 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.109 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.110 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.110 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.110 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.110 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.110 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.110 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.110 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.110 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.110 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.110 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.110 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.110 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.111 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.111 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.111 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.111 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.111 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.111 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.111 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.111 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.111 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.111 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.111 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.112 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.112 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.112 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.112 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.112 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.112 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.112 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.112 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.112 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.112 INFO:teuthology.orchestra.run.smithi110.stdout: "min_score": { 2024-09-12T02:30:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "min_score", 2024-09-12T02:30:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-12T02:30:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.113 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.114 INFO:teuthology.orchestra.run.smithi110.stdout: "mode": { 2024-09-12T02:30:47.114 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mode", 2024-09-12T02:30:47.114 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.114 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.114 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.114 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "upmap", 2024-09-12T02:30:47.114 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.114 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.114 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.114 INFO:teuthology.orchestra.run.smithi110.stdout: "crush-compat", 2024-09-12T02:30:47.114 INFO:teuthology.orchestra.run.smithi110.stdout: "none", 2024-09-12T02:30:47.115 INFO:teuthology.orchestra.run.smithi110.stdout: "read", 2024-09-12T02:30:47.115 INFO:teuthology.orchestra.run.smithi110.stdout: "upmap", 2024-09-12T02:30:47.115 INFO:teuthology.orchestra.run.smithi110.stdout: "upmap-read" 2024-09-12T02:30:47.115 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.115 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Balancer mode", 2024-09-12T02:30:47.115 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.115 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.115 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.115 INFO:teuthology.orchestra.run.smithi110.stdout: "pool_ids": { 2024-09-12T02:30:47.115 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "pool_ids", 2024-09-12T02:30:47.115 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.116 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.116 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.116 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.116 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.116 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.116 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.116 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-12T02:30:47.116 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.116 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.116 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.117 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:47.117 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:47.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.117 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.117 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:47.117 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.117 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.117 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.117 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-12T02:30:47.117 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.117 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.118 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.118 INFO:teuthology.orchestra.run.smithi110.stdout: "upmap_max_deviation": { 2024-09-12T02:30:47.118 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "upmap_max_deviation", 2024-09-12T02:30:47.118 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.118 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.118 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.118 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5", 2024-09-12T02:30:47.118 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1", 2024-09-12T02:30:47.118 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.118 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.119 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-12T02:30:47.119 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-12T02:30:47.119 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.119 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.119 INFO:teuthology.orchestra.run.smithi110.stdout: "upmap_max_optimizations": { 2024-09-12T02:30:47.119 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "upmap_max_optimizations", 2024-09-12T02:30:47.119 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:47.119 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.119 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.119 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:47.120 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.120 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.120 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.120 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-12T02:30:47.120 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.120 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.120 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.120 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.120 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.121 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cephadm", 2024-09-12T02:30:47.121 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.121 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.121 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.121 INFO:teuthology.orchestra.run.smithi110.stdout: "agent_down_multiplier": { 2024-09-12T02:30:47.121 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "agent_down_multiplier", 2024-09-12T02:30:47.121 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:47.121 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.121 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.121 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "3.0", 2024-09-12T02:30:47.121 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.122 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.122 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.122 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-12T02:30:47.122 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.122 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.122 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.122 INFO:teuthology.orchestra.run.smithi110.stdout: "agent_refresh_rate": { 2024-09-12T02:30:47.122 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "agent_refresh_rate", 2024-09-12T02:30:47.122 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.122 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.122 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.123 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "20", 2024-09-12T02:30:47.123 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.123 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.123 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.123 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-12T02:30:47.123 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.123 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.123 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.123 INFO:teuthology.orchestra.run.smithi110.stdout: "agent_starting_port": { 2024-09-12T02:30:47.123 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "agent_starting_port", 2024-09-12T02:30:47.124 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.124 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.124 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.124 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "4721", 2024-09-12T02:30:47.124 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.124 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.124 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.124 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-12T02:30:47.124 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.124 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.124 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.125 INFO:teuthology.orchestra.run.smithi110.stdout: "allow_ptrace": { 2024-09-12T02:30:47.125 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "allow_ptrace", 2024-09-12T02:30:47.125 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.125 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.125 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.125 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.125 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.125 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.125 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.125 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-12T02:30:47.125 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-12T02:30:47.126 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.126 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.126 INFO:teuthology.orchestra.run.smithi110.stdout: "autotune_interval": { 2024-09-12T02:30:47.126 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "autotune_interval", 2024-09-12T02:30:47.126 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.126 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.126 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.126 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:47.126 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.126 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.127 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.127 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-12T02:30:47.127 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.127 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.127 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.127 INFO:teuthology.orchestra.run.smithi110.stdout: "autotune_memory_target_ratio": { 2024-09-12T02:30:47.127 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "autotune_memory_target_ratio", 2024-09-12T02:30:47.127 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:47.127 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.127 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.128 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0.7", 2024-09-12T02:30:47.128 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.128 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.128 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.128 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-12T02:30:47.128 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.128 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.128 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.128 INFO:teuthology.orchestra.run.smithi110.stdout: "cephadm_log_destination": { 2024-09-12T02:30:47.128 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cephadm_log_destination", 2024-09-12T02:30:47.129 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.129 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.129 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.129 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.129 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.129 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.129 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.129 INFO:teuthology.orchestra.run.smithi110.stdout: "file", 2024-09-12T02:30:47.129 INFO:teuthology.orchestra.run.smithi110.stdout: "file,syslog", 2024-09-12T02:30:47.129 INFO:teuthology.orchestra.run.smithi110.stdout: "syslog" 2024-09-12T02:30:47.129 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.129 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-12T02:30:47.130 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.130 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.130 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.130 INFO:teuthology.orchestra.run.smithi110.stdout: "cgroups_split": { 2024-09-12T02:30:47.130 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cgroups_split", 2024-09-12T02:30:47.130 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.130 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.130 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.130 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.130 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.130 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.131 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.131 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-12T02:30:47.131 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.131 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.131 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.131 INFO:teuthology.orchestra.run.smithi110.stdout: "config_checks_enabled": { 2024-09-12T02:30:47.131 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "config_checks_enabled", 2024-09-12T02:30:47.131 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.131 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.131 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.131 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.132 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.132 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.132 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.132 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-12T02:30:47.132 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.132 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.132 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.132 INFO:teuthology.orchestra.run.smithi110.stdout: "config_dashboard": { 2024-09-12T02:30:47.132 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "config_dashboard", 2024-09-12T02:30:47.132 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.133 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.133 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.133 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.133 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.133 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.133 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.133 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-12T02:30:47.133 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.133 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.133 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.133 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_alertmanager": { 2024-09-12T02:30:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_alertmanager", 2024-09-12T02:30:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-12T02:30:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Prometheus container image", 2024-09-12T02:30:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.134 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.135 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_base": { 2024-09-12T02:30:47.135 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_base", 2024-09-12T02:30:47.135 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.135 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.135 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.135 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-12T02:30:47.135 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.135 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.135 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.135 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Container image name, without the tag", 2024-09-12T02:30:47.136 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.136 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.136 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.136 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_elasticsearch": { 2024-09-12T02:30:47.136 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_elasticsearch", 2024-09-12T02:30:47.136 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.136 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.136 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.136 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-12T02:30:47.136 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.137 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.137 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.137 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "elasticsearch container image", 2024-09-12T02:30:47.137 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.137 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.137 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.137 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_grafana": { 2024-09-12T02:30:47.137 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_grafana", 2024-09-12T02:30:47.137 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.137 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.137 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.138 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-12T02:30:47.138 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.138 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.138 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.138 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Prometheus container image", 2024-09-12T02:30:47.138 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.138 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.138 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.138 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_haproxy": { 2024-09-12T02:30:47.138 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_haproxy", 2024-09-12T02:30:47.139 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.139 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.139 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-12T02:30:47.139 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.139 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.139 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.139 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "HAproxy container image", 2024-09-12T02:30:47.139 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.139 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.139 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.140 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_jaeger_agent": { 2024-09-12T02:30:47.140 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_jaeger_agent", 2024-09-12T02:30:47.140 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.140 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.140 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.140 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-12T02:30:47.140 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.140 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.140 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.140 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Jaeger agent container image", 2024-09-12T02:30:47.140 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.140 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.141 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.141 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_jaeger_collector": { 2024-09-12T02:30:47.141 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_jaeger_collector", 2024-09-12T02:30:47.141 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.141 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.141 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.141 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-12T02:30:47.141 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.141 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.141 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.142 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Jaeger collector container image", 2024-09-12T02:30:47.142 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.142 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.142 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.142 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_jaeger_query": { 2024-09-12T02:30:47.142 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_jaeger_query", 2024-09-12T02:30:47.142 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.142 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.142 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.142 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-12T02:30:47.142 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.143 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.143 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.143 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Jaeger query container image", 2024-09-12T02:30:47.143 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.143 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.143 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.143 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_keepalived": { 2024-09-12T02:30:47.143 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_keepalived", 2024-09-12T02:30:47.143 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.143 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.143 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.144 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-12T02:30:47.144 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.144 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.144 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.144 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Keepalived container image", 2024-09-12T02:30:47.144 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.144 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.144 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.144 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_loki": { 2024-09-12T02:30:47.144 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_loki", 2024-09-12T02:30:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-12T02:30:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Loki container image", 2024-09-12T02:30:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.146 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_node_exporter": { 2024-09-12T02:30:47.146 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_node_exporter", 2024-09-12T02:30:47.146 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.146 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.146 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.146 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-12T02:30:47.146 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.146 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.146 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.146 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Prometheus container image", 2024-09-12T02:30:47.146 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.146 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.147 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.147 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_nvmeof": { 2024-09-12T02:30:47.147 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_nvmeof", 2024-09-12T02:30:47.147 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.147 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.147 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.147 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-12T02:30:47.147 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.147 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.147 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.148 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Nvme-of container image", 2024-09-12T02:30:47.148 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.148 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.148 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.148 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_prometheus": { 2024-09-12T02:30:47.148 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_prometheus", 2024-09-12T02:30:47.148 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.148 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.148 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.148 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-12T02:30:47.148 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.149 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.149 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.149 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Prometheus container image", 2024-09-12T02:30:47.149 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.149 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.149 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.149 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_promtail": { 2024-09-12T02:30:47.149 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_promtail", 2024-09-12T02:30:47.149 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.149 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.149 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.150 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-12T02:30:47.150 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.150 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.150 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.150 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Promtail container image", 2024-09-12T02:30:47.150 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.150 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.150 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.150 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_samba": { 2024-09-12T02:30:47.150 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_samba", 2024-09-12T02:30:47.151 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.151 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.151 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.151 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-12T02:30:47.151 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.151 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.151 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.151 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Samba/SMB container image", 2024-09-12T02:30:47.151 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.151 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.151 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.152 INFO:teuthology.orchestra.run.smithi110.stdout: "container_image_snmp_gateway": { 2024-09-12T02:30:47.152 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_image_snmp_gateway", 2024-09-12T02:30:47.152 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.152 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.152 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.152 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-12T02:30:47.152 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.152 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.152 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.152 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "SNMP Gateway container image", 2024-09-12T02:30:47.152 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.153 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.153 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.153 INFO:teuthology.orchestra.run.smithi110.stdout: "container_init": { 2024-09-12T02:30:47.153 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "container_init", 2024-09-12T02:30:47.153 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.153 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.153 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.153 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.153 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.153 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.154 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.154 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Run podman/docker with `--init`", 2024-09-12T02:30:47.154 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.154 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.154 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.154 INFO:teuthology.orchestra.run.smithi110.stdout: "daemon_cache_timeout": { 2024-09-12T02:30:47.154 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "daemon_cache_timeout", 2024-09-12T02:30:47.154 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.154 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.154 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.155 INFO:teuthology.orchestra.run.smithi110.stdout: "default_cephadm_command_timeout": { 2024-09-12T02:30:47.156 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "default_cephadm_command_timeout", 2024-09-12T02:30:47.156 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.156 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.156 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.156 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "900", 2024-09-12T02:30:47.156 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.156 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.156 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.156 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-12T02:30:47.156 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.156 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.157 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.157 INFO:teuthology.orchestra.run.smithi110.stdout: "default_registry": { 2024-09-12T02:30:47.157 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "default_registry", 2024-09-12T02:30:47.157 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.157 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.157 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.157 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "docker.io", 2024-09-12T02:30:47.157 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.157 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.157 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.158 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-12T02:30:47.158 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.158 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.158 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.158 INFO:teuthology.orchestra.run.smithi110.stdout: "device_cache_timeout": { 2024-09-12T02:30:47.158 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "device_cache_timeout", 2024-09-12T02:30:47.158 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.158 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.158 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.158 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "1800", 2024-09-12T02:30:47.158 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.159 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.159 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.159 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "seconds to cache device inventory", 2024-09-12T02:30:47.159 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.159 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.159 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.159 INFO:teuthology.orchestra.run.smithi110.stdout: "device_enhanced_scan": { 2024-09-12T02:30:47.159 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "device_enhanced_scan", 2024-09-12T02:30:47.159 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.159 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.160 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.160 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.160 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.160 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.160 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.160 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-12T02:30:47.160 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.160 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.160 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.160 INFO:teuthology.orchestra.run.smithi110.stdout: "facts_cache_timeout": { 2024-09-12T02:30:47.160 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "facts_cache_timeout", 2024-09-12T02:30:47.161 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.161 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.161 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.161 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:47.161 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.161 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.161 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.161 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "seconds to cache host facts data", 2024-09-12T02:30:47.161 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.161 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.161 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.162 INFO:teuthology.orchestra.run.smithi110.stdout: "grafana_dashboards_path": { 2024-09-12T02:30:47.162 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "grafana_dashboards_path", 2024-09-12T02:30:47.162 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.162 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.162 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.162 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-12T02:30:47.162 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.162 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.162 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.162 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-12T02:30:47.163 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.163 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.163 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.163 INFO:teuthology.orchestra.run.smithi110.stdout: "host_check_interval": { 2024-09-12T02:30:47.163 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "host_check_interval", 2024-09-12T02:30:47.163 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.163 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.163 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.163 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:47.163 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.164 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.164 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.164 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to perform a host check", 2024-09-12T02:30:47.164 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.164 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.164 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.164 INFO:teuthology.orchestra.run.smithi110.stdout: "hw_monitoring": { 2024-09-12T02:30:47.164 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "hw_monitoring", 2024-09-12T02:30:47.164 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.164 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.165 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.165 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.165 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.165 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.165 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.165 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-12T02:30:47.165 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.165 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.165 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.165 INFO:teuthology.orchestra.run.smithi110.stdout: "inventory_list_all": { 2024-09-12T02:30:47.165 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "inventory_list_all", 2024-09-12T02:30:47.166 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.166 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.166 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.166 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.166 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.166 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.166 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.166 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-12T02:30:47.166 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.166 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.166 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.167 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.167 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.167 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.167 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.167 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.167 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.167 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.167 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.167 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.167 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.167 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.168 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.168 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.168 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.168 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.168 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.168 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.168 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.168 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.168 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.168 INFO:teuthology.orchestra.run.smithi110.stdout: "log_refresh_metadata": { 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_refresh_metadata", 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.169 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.170 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.170 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.170 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.170 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.170 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.170 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.170 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.170 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.170 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.170 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-12T02:30:47.170 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.171 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.171 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.171 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.171 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.171 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.171 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.171 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.171 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.171 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.171 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.172 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.172 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.172 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.172 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.172 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.172 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.172 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.172 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.172 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.172 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.172 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.172 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.173 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.173 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.173 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.173 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.173 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.173 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.173 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.173 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.173 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.173 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.174 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.174 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.174 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.174 INFO:teuthology.orchestra.run.smithi110.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-12T02:30:47.174 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-12T02:30:47.174 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.174 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.174 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.174 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.174 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.175 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.175 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.175 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-12T02:30:47.175 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.175 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.175 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.175 INFO:teuthology.orchestra.run.smithi110.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-12T02:30:47.175 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-12T02:30:47.175 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.175 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.175 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.176 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "*", 2024-09-12T02:30:47.176 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.176 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.176 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.176 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-12T02:30:47.176 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.176 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.176 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.176 INFO:teuthology.orchestra.run.smithi110.stdout: "max_count_per_host": { 2024-09-12T02:30:47.177 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_count_per_host", 2024-09-12T02:30:47.177 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.177 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.177 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.177 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:47.177 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.177 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.177 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.177 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "max number of daemons per service per host", 2024-09-12T02:30:47.177 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.178 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.178 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.178 INFO:teuthology.orchestra.run.smithi110.stdout: "max_osd_draining_count": { 2024-09-12T02:30:47.178 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_osd_draining_count", 2024-09-12T02:30:47.178 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.178 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.178 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.178 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:47.178 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.178 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.178 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.179 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-12T02:30:47.179 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.179 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.179 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.179 INFO:teuthology.orchestra.run.smithi110.stdout: "migration_current": { 2024-09-12T02:30:47.179 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "migration_current", 2024-09-12T02:30:47.179 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.179 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.179 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.179 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.180 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.180 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.180 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.180 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "internal - do not modify", 2024-09-12T02:30:47.180 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.180 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.180 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.180 INFO:teuthology.orchestra.run.smithi110.stdout: "mode": { 2024-09-12T02:30:47.180 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mode", 2024-09-12T02:30:47.180 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.180 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.181 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.181 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "root", 2024-09-12T02:30:47.181 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.181 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.181 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.181 INFO:teuthology.orchestra.run.smithi110.stdout: "cephadm-package", 2024-09-12T02:30:47.181 INFO:teuthology.orchestra.run.smithi110.stdout: "root" 2024-09-12T02:30:47.181 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.181 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "mode for remote execution of cephadm", 2024-09-12T02:30:47.181 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.181 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.181 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.182 INFO:teuthology.orchestra.run.smithi110.stdout: "oob_default_addr": { 2024-09-12T02:30:47.182 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "oob_default_addr", 2024-09-12T02:30:47.182 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.182 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.182 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.182 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "169.254.1.1", 2024-09-12T02:30:47.182 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.182 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.182 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.182 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-12T02:30:47.183 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.183 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.183 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.183 INFO:teuthology.orchestra.run.smithi110.stdout: "prometheus_alerts_path": { 2024-09-12T02:30:47.183 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "prometheus_alerts_path", 2024-09-12T02:30:47.183 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.183 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.183 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.183 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-12T02:30:47.183 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.183 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.184 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.184 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-12T02:30:47.184 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.184 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.184 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.184 INFO:teuthology.orchestra.run.smithi110.stdout: "registry_insecure": { 2024-09-12T02:30:47.184 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "registry_insecure", 2024-09-12T02:30:47.184 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.184 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.184 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.185 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.185 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.185 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.185 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.185 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-12T02:30:47.185 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.185 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.185 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.185 INFO:teuthology.orchestra.run.smithi110.stdout: "registry_password": { 2024-09-12T02:30:47.185 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "registry_password", 2024-09-12T02:30:47.185 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.186 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.186 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.186 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.186 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.186 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.186 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.186 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-12T02:30:47.186 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.186 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.186 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.187 INFO:teuthology.orchestra.run.smithi110.stdout: "registry_url": { 2024-09-12T02:30:47.187 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "registry_url", 2024-09-12T02:30:47.187 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.187 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.187 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.187 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.187 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.187 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.187 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.187 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-12T02:30:47.187 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.187 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.188 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.188 INFO:teuthology.orchestra.run.smithi110.stdout: "registry_username": { 2024-09-12T02:30:47.188 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "registry_username", 2024-09-12T02:30:47.188 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.188 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.188 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.188 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.188 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.188 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.188 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.189 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-12T02:30:47.189 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.189 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.189 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.189 INFO:teuthology.orchestra.run.smithi110.stdout: "secure_monitoring_stack": { 2024-09-12T02:30:47.189 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "secure_monitoring_stack", 2024-09-12T02:30:47.189 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.189 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.189 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.189 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.189 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.190 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.190 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.190 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-12T02:30:47.190 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.190 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.190 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.190 INFO:teuthology.orchestra.run.smithi110.stdout: "service_discovery_port": { 2024-09-12T02:30:47.190 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "service_discovery_port", 2024-09-12T02:30:47.190 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.190 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.191 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.191 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8765", 2024-09-12T02:30:47.191 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.191 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.191 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.191 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "cephadm service discovery port", 2024-09-12T02:30:47.191 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.191 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.191 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.191 INFO:teuthology.orchestra.run.smithi110.stdout: "ssh_config_file": { 2024-09-12T02:30:47.192 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ssh_config_file", 2024-09-12T02:30:47.192 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.192 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.192 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.192 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.192 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.192 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.192 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.192 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-12T02:30:47.192 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.192 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.192 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.193 INFO:teuthology.orchestra.run.smithi110.stdout: "use_agent": { 2024-09-12T02:30:47.193 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "use_agent", 2024-09-12T02:30:47.193 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.193 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.193 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.193 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.193 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.193 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.193 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.193 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-12T02:30:47.194 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.194 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.194 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.194 INFO:teuthology.orchestra.run.smithi110.stdout: "use_repo_digest": { 2024-09-12T02:30:47.194 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "use_repo_digest", 2024-09-12T02:30:47.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.194 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.194 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.194 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.194 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.195 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.195 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.195 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-12T02:30:47.195 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.195 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.195 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.195 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_on_failed_host_check": { 2024-09-12T02:30:47.195 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_on_failed_host_check", 2024-09-12T02:30:47.195 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.195 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.195 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.196 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.196 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.196 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.196 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.196 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "raise a health warning if the host check fails", 2024-09-12T02:30:47.196 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.196 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.196 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.196 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_on_stray_daemons": { 2024-09-12T02:30:47.197 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_on_stray_daemons", 2024-09-12T02:30:47.197 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.197 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.197 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.197 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.197 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.197 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.197 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.197 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-12T02:30:47.197 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.198 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.198 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.198 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_on_stray_hosts": { 2024-09-12T02:30:47.198 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_on_stray_hosts", 2024-09-12T02:30:47.198 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.198 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.198 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.198 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.198 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.198 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.199 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.199 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-12T02:30:47.199 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.199 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.199 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.199 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.199 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.199 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crash", 2024-09-12T02:30:47.199 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.199 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.200 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.201 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.202 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.203 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.204 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.205 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "retain_interval": { 2024-09-12T02:30:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "retain_interval", 2024-09-12T02:30:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "31536000", 2024-09-12T02:30:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-12T02:30:47.206 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_recent_interval": { 2024-09-12T02:30:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_recent_interval", 2024-09-12T02:30:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "1209600", 2024-09-12T02:30:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.207 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-12T02:30:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "dashboard", 2024-09-12T02:30:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.208 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-12T02:30:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-12T02:30:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.209 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "ALERTMANAGER_API_HOST": { 2024-09-12T02:30:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-12T02:30:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.210 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-12T02:30:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-12T02:30:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.211 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "AUDIT_API_ENABLED": { 2024-09-12T02:30:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "AUDIT_API_ENABLED", 2024-09-12T02:30:47.212 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.213 INFO:teuthology.orchestra.run.smithi110.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-12T02:30:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-12T02:30:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.214 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "ENABLE_BROWSABLE_API": { 2024-09-12T02:30:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-12T02:30:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.215 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-12T02:30:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-12T02:30:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.216 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-12T02:30:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-12T02:30:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.217 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-12T02:30:47.218 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-12T02:30:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.219 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-12T02:30:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-12T02:30:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.220 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-12T02:30:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-12T02:30:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.221 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.222 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-12T02:30:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-12T02:30:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.223 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-12T02:30:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-12T02:30:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.224 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-12T02:30:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-12T02:30:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.225 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_API_PASSWORD": { 2024-09-12T02:30:47.226 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-12T02:30:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "admin", 2024-09-12T02:30:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.227 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-12T02:30:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-12T02:30:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.228 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_API_URL": { 2024-09-12T02:30:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_API_URL", 2024-09-12T02:30:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.229 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_API_USERNAME": { 2024-09-12T02:30:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-12T02:30:47.230 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "admin", 2024-09-12T02:30:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.232 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-12T02:30:47.232 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-12T02:30:47.232 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.232 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.232 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.232 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.232 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.232 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.232 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.232 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.232 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.233 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.233 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.233 INFO:teuthology.orchestra.run.smithi110.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-12T02:30:47.233 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-12T02:30:47.233 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.233 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.233 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.233 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.233 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.233 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.234 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.234 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.234 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.234 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.234 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.234 INFO:teuthology.orchestra.run.smithi110.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-12T02:30:47.234 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-12T02:30:47.234 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.234 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.234 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.235 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.235 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.235 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.235 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.235 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.235 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.235 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.235 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.235 INFO:teuthology.orchestra.run.smithi110.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-12T02:30:47.235 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-12T02:30:47.236 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.236 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.236 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.236 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.236 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.236 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.236 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.236 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.236 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.236 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.236 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.237 INFO:teuthology.orchestra.run.smithi110.stdout: "PROMETHEUS_API_HOST": { 2024-09-12T02:30:47.237 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-12T02:30:47.237 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.237 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.237 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.237 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.237 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.237 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.237 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.237 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.237 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-12T02:30:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-12T02:30:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.238 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.239 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.239 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.239 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.239 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.239 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.239 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-12T02:30:47.239 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-12T02:30:47.239 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.239 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.239 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.240 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.240 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.240 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.240 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.240 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.240 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.240 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.240 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.240 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-12T02:30:47.240 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-12T02:30:47.241 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.241 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.241 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.241 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.241 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.241 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.241 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.241 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.241 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.241 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.241 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.242 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-12T02:30:47.242 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-12T02:30:47.242 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.242 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.242 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.242 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.242 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.242 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.242 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.242 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.242 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.242 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.243 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.243 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-12T02:30:47.243 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-12T02:30:47.243 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.243 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.243 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.243 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.243 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.243 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.243 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.244 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.244 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.244 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.244 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.244 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-12T02:30:47.244 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-12T02:30:47.244 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.244 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.244 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.244 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.244 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.245 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.245 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.245 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.245 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.245 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.245 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.245 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-12T02:30:47.245 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-12T02:30:47.245 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.245 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.245 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.246 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.246 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.246 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.246 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.246 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.246 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.246 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.246 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.246 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-12T02:30:47.246 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-12T02:30:47.247 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.247 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.247 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.247 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.247 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.247 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.247 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.247 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.247 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.247 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.247 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.248 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_ENABLED": { 2024-09-12T02:30:47.248 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-12T02:30:47.248 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.248 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.248 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.248 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.248 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.248 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.248 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.248 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.248 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.248 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.249 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.249 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-12T02:30:47.249 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-12T02:30:47.249 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.249 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.249 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.249 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-12T02:30:47.249 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.249 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.249 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.250 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.250 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.250 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.250 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.250 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-12T02:30:47.250 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-12T02:30:47.250 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.250 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.250 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.250 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:47.250 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.251 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.251 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.251 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.251 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.251 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.251 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.251 INFO:teuthology.orchestra.run.smithi110.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-12T02:30:47.251 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-12T02:30:47.251 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.251 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.251 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.252 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8", 2024-09-12T02:30:47.252 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.252 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.252 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.252 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.252 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.252 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.252 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.252 INFO:teuthology.orchestra.run.smithi110.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-12T02:30:47.252 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-12T02:30:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "45", 2024-09-12T02:30:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.254 INFO:teuthology.orchestra.run.smithi110.stdout: "RGW_API_ACCESS_KEY": { 2024-09-12T02:30:47.254 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-12T02:30:47.254 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.254 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.254 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.254 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.254 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.254 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.254 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.254 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.254 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.255 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.255 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.255 INFO:teuthology.orchestra.run.smithi110.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-12T02:30:47.255 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-12T02:30:47.255 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.255 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.255 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.255 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "admin", 2024-09-12T02:30:47.255 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.255 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.255 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.256 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.256 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.256 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.256 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.256 INFO:teuthology.orchestra.run.smithi110.stdout: "RGW_API_SECRET_KEY": { 2024-09-12T02:30:47.256 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-12T02:30:47.256 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.256 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.256 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.256 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.257 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.257 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.257 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.257 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.257 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.257 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.257 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.257 INFO:teuthology.orchestra.run.smithi110.stdout: "RGW_API_SSL_VERIFY": { 2024-09-12T02:30:47.257 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-12T02:30:47.257 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.257 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.258 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.258 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.258 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.258 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.258 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.258 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.258 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.258 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.258 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.258 INFO:teuthology.orchestra.run.smithi110.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-12T02:30:47.259 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-12T02:30:47.259 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.259 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.259 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.259 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:47.259 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.259 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.259 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.259 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.259 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.259 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.259 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.260 INFO:teuthology.orchestra.run.smithi110.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-12T02:30:47.260 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-12T02:30:47.260 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.260 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.260 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.260 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:47.260 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.260 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.260 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.260 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.261 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.261 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.261 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.261 INFO:teuthology.orchestra.run.smithi110.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-12T02:30:47.261 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-12T02:30:47.261 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.261 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.261 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.261 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5", 2024-09-12T02:30:47.261 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.261 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.262 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.262 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.262 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.262 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.262 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.262 INFO:teuthology.orchestra.run.smithi110.stdout: "cross_origin_url": { 2024-09-12T02:30:47.262 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cross_origin_url", 2024-09-12T02:30:47.262 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.262 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.262 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.263 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.263 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.263 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.263 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.263 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.263 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.263 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.263 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.263 INFO:teuthology.orchestra.run.smithi110.stdout: "crt_file": { 2024-09-12T02:30:47.263 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "crt_file", 2024-09-12T02:30:47.263 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.264 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.264 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.264 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.264 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.264 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.264 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.264 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.264 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.264 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.264 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.264 INFO:teuthology.orchestra.run.smithi110.stdout: "debug": { 2024-09-12T02:30:47.265 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "debug", 2024-09-12T02:30:47.265 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.265 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.265 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.265 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.265 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.265 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.265 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.265 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Enable/disable debug options", 2024-09-12T02:30:47.265 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.265 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.266 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.266 INFO:teuthology.orchestra.run.smithi110.stdout: "jwt_token_ttl": { 2024-09-12T02:30:47.266 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "jwt_token_ttl", 2024-09-12T02:30:47.266 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.266 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.266 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.266 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "28800", 2024-09-12T02:30:47.266 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.266 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.266 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.266 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.267 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.267 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.267 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.267 INFO:teuthology.orchestra.run.smithi110.stdout: "key_file": { 2024-09-12T02:30:47.267 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "key_file", 2024-09-12T02:30:47.267 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.267 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.267 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.267 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.267 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.268 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.268 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.268 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.268 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.268 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.268 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.268 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.268 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.268 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.268 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.268 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.269 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.269 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.269 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.269 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.269 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.269 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.269 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.269 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.269 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.269 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.269 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.270 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.270 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.270 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.270 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.270 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.270 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.270 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.270 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.270 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.270 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.270 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.271 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.271 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.271 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.271 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.271 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.271 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.271 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.271 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.271 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.271 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.272 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.272 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.272 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.272 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.272 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.272 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.272 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.272 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.272 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.272 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.272 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.273 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.273 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.273 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.273 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.273 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.273 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.273 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.273 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.273 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.273 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.273 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "motd": { 2024-09-12T02:30:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "motd", 2024-09-12T02:30:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "The message of the day", 2024-09-12T02:30:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "redirect_resolve_ip_addr": { 2024-09-12T02:30:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "redirect_resolve_ip_addr", 2024-09-12T02:30:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "server_addr": { 2024-09-12T02:30:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_addr", 2024-09-12T02:30:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "::", 2024-09-12T02:30:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "server_port": { 2024-09-12T02:30:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_port", 2024-09-12T02:30:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8080", 2024-09-12T02:30:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "ssl": { 2024-09-12T02:30:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ssl", 2024-09-12T02:30:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "ssl_server_port": { 2024-09-12T02:30:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ssl_server_port", 2024-09-12T02:30:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8443", 2024-09-12T02:30:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "standby_behaviour": { 2024-09-12T02:30:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "standby_behaviour", 2024-09-12T02:30:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "redirect", 2024-09-12T02:30:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "redirect" 2024-09-12T02:30:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "standby_error_status_code": { 2024-09-12T02:30:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "standby_error_status_code", 2024-09-12T02:30:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "500", 2024-09-12T02:30:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "400", 2024-09-12T02:30:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "599", 2024-09-12T02:30:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "url_prefix": { 2024-09-12T02:30:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "url_prefix", 2024-09-12T02:30:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "devicehealth", 2024-09-12T02:30:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "enable_monitoring": { 2024-09-12T02:30:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "enable_monitoring", 2024-09-12T02:30:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "monitor device health metrics", 2024-09-12T02:30:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "mark_out_threshold": { 2024-09-12T02:30:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mark_out_threshold", 2024-09-12T02:30:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "2419200", 2024-09-12T02:30:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-12T02:30:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "pool_name": { 2024-09-12T02:30:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "pool_name", 2024-09-12T02:30:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "device_health_metrics", 2024-09-12T02:30:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-12T02:30:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "retention_period": { 2024-09-12T02:30:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "retention_period", 2024-09-12T02:30:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "15552000", 2024-09-12T02:30:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how long to retain device health metrics", 2024-09-12T02:30:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "scrape_frequency": { 2024-09-12T02:30:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "scrape_frequency", 2024-09-12T02:30:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "86400", 2024-09-12T02:30:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-12T02:30:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "self_heal": { 2024-09-12T02:30:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "self_heal", 2024-09-12T02:30:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-12T02:30:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how frequently to wake up and check device health", 2024-09-12T02:30:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "warn_threshold": { 2024-09-12T02:30:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "warn_threshold", 2024-09-12T02:30:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "7257600", 2024-09-12T02:30:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-12T02:30:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "diskprediction_local", 2024-09-12T02:30:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "predict_interval": { 2024-09-12T02:30:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "predict_interval", 2024-09-12T02:30:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "86400", 2024-09-12T02:30:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "predictor_model": { 2024-09-12T02:30:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "predictor_model", 2024-09-12T02:30:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "prophetstor", 2024-09-12T02:30:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "600", 2024-09-12T02:30:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "influx", 2024-09-12T02:30:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": false, 2024-09-12T02:30:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "influxdb python module not found", 2024-09-12T02:30:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "batch_size": { 2024-09-12T02:30:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "batch_size", 2024-09-12T02:30:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5000", 2024-09-12T02:30:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-12T02:30:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "database": { 2024-09-12T02:30:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "database", 2024-09-12T02:30:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "ceph", 2024-09-12T02:30:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-12T02:30:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "hostname": { 2024-09-12T02:30:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "hostname", 2024-09-12T02:30:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "InfluxDB server hostname", 2024-09-12T02:30:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "30", 2024-09-12T02:30:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "5", 2024-09-12T02:30:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-12T02:30:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "password": { 2024-09-12T02:30:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "password", 2024-09-12T02:30:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "password of InfluxDB server user", 2024-09-12T02:30:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "port": { 2024-09-12T02:30:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "port", 2024-09-12T02:30:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "8086", 2024-09-12T02:30:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "InfluxDB server port", 2024-09-12T02:30:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "ssl": { 2024-09-12T02:30:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ssl", 2024-09-12T02:30:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "false", 2024-09-12T02:30:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:30:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "threads": { 2024-09-12T02:30:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "threads", 2024-09-12T02:30:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5", 2024-09-12T02:30:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1", 2024-09-12T02:30:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "32", 2024-09-12T02:30:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-12T02:30:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "username": { 2024-09-12T02:30:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "username", 2024-09-12T02:30:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "username of InfluxDB server user", 2024-09-12T02:30:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "verify_ssl": { 2024-09-12T02:30:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "verify_ssl", 2024-09-12T02:30:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "true", 2024-09-12T02:30:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-12T02:30:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "insights", 2024-09-12T02:30:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "iostat", 2024-09-12T02:30:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "k8sevents", 2024-09-12T02:30:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_event_retention_days": { 2024-09-12T02:30:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "ceph_event_retention_days", 2024-09-12T02:30:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "7", 2024-09-12T02:30:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-12T02:30:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "config_check_secs": { 2024-09-12T02:30:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "config_check_secs", 2024-09-12T02:30:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "10", 2024-09-12T02:30:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-12T02:30:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "localpool", 2024-09-12T02:30:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "failure_domain": { 2024-09-12T02:30:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "failure_domain", 2024-09-12T02:30:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "host", 2024-09-12T02:30:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "failure domain for any created local pool", 2024-09-12T02:30:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-12T02:30:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "min_size": { 2024-09-12T02:30:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "min_size", 2024-09-12T02:30:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "default min_size for any created local pool", 2024-09-12T02:30:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-12T02:30:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.366 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.366 INFO:teuthology.orchestra.run.smithi110.stdout: "num_rep": { 2024-09-12T02:30:47.366 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "num_rep", 2024-09-12T02:30:47.366 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.366 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.366 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.366 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "3", 2024-09-12T02:30:47.366 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.366 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.366 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.367 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "default replica count for any created local pool", 2024-09-12T02:30:47.367 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.367 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.367 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.367 INFO:teuthology.orchestra.run.smithi110.stdout: "pg_num": { 2024-09-12T02:30:47.367 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "pg_num", 2024-09-12T02:30:47.367 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.367 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.367 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.367 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "128", 2024-09-12T02:30:47.368 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.368 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.368 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.368 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "default pg_num for any created local pool", 2024-09-12T02:30:47.368 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.368 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.368 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.368 INFO:teuthology.orchestra.run.smithi110.stdout: "prefix": { 2024-09-12T02:30:47.368 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "prefix", 2024-09-12T02:30:47.368 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.369 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.369 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.369 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.369 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.369 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.369 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.369 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "name prefix for any created local pool", 2024-09-12T02:30:47.369 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.369 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.369 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.369 INFO:teuthology.orchestra.run.smithi110.stdout: "subtree": { 2024-09-12T02:30:47.370 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "subtree", 2024-09-12T02:30:47.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.370 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.370 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.370 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "rack", 2024-09-12T02:30:47.370 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.370 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.370 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.370 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-12T02:30:47.370 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mds_autoscaler", 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.371 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.372 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.372 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.372 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.372 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.372 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.372 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.372 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.372 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.372 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.372 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mirroring", 2024-09-12T02:30:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "nfs", 2024-09-12T02:30:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "orchestrator", 2024-09-12T02:30:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "fail_fs": { 2024-09-12T02:30:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "fail_fs", 2024-09-12T02:30:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-12T02:30:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "orchestrator": { 2024-09-12T02:30:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "orchestrator", 2024-09-12T02:30:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "cephadm", 2024-09-12T02:30:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "rook", 2024-09-12T02:30:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "test_orchestrator" 2024-09-12T02:30:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Orchestrator backend", 2024-09-12T02:30:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "osd_perf_query", 2024-09-12T02:30:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "osd_support", 2024-09-12T02:30:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "pg_autoscaler", 2024-09-12T02:30:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "threshold": { 2024-09-12T02:30:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "threshold", 2024-09-12T02:30:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "3.0", 2024-09-12T02:30:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1.0", 2024-09-12T02:30:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "scaling threshold", 2024-09-12T02:30:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-12T02:30:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "progress", 2024-09-12T02:30:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "allow_pg_recovery_event": { 2024-09-12T02:30:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "allow_pg_recovery_event", 2024-09-12T02:30:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-12T02:30:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": { 2024-09-12T02:30:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "enabled", 2024-09-12T02:30:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "max_completed_events": { 2024-09-12T02:30:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_completed_events", 2024-09-12T02:30:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "50", 2024-09-12T02:30:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "number of past completed events to remember", 2024-09-12T02:30:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "sleep_interval": { 2024-09-12T02:30:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "sleep_interval", 2024-09-12T02:30:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "5", 2024-09-12T02:30:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "how long the module is going to sleep", 2024-09-12T02:30:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "prometheus", 2024-09-12T02:30:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "cache": { 2024-09-12T02:30:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cache", 2024-09-12T02:30:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "exclude_perf_counters": { 2024-09-12T02:30:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "exclude_perf_counters", 2024-09-12T02:30:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-12T02:30:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-12T02:30:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "rbd_stats_pools": { 2024-09-12T02:30:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rbd_stats_pools", 2024-09-12T02:30:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-12T02:30:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-12T02:30:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "300", 2024-09-12T02:30:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "scrape_interval": { 2024-09-12T02:30:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "scrape_interval", 2024-09-12T02:30:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "15.0", 2024-09-12T02:30:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "server_addr": { 2024-09-12T02:30:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_addr", 2024-09-12T02:30:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "::", 2024-09-12T02:30:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-12T02:30:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "server_port": { 2024-09-12T02:30:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_port", 2024-09-12T02:30:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "9283", 2024-09-12T02:30:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-12T02:30:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "stale_cache_strategy": { 2024-09-12T02:30:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "stale_cache_strategy", 2024-09-12T02:30:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "log", 2024-09-12T02:30:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "standby_behaviour": { 2024-09-12T02:30:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "standby_behaviour", 2024-09-12T02:30:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "default", 2024-09-12T02:30:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "default", 2024-09-12T02:30:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "error" 2024-09-12T02:30:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "standby_error_status_code": { 2024-09-12T02:30:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "standby_error_status_code", 2024-09-12T02:30:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "500", 2024-09-12T02:30:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "400", 2024-09-12T02:30:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "599", 2024-09-12T02:30:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rbd_support", 2024-09-12T02:30:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.463 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "max_concurrent_snap_create": { 2024-09-12T02:30:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_concurrent_snap_create", 2024-09-12T02:30:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10", 2024-09-12T02:30:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "mirror_snapshot_schedule": { 2024-09-12T02:30:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "mirror_snapshot_schedule", 2024-09-12T02:30:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "trash_purge_schedule": { 2024-09-12T02:30:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "trash_purge_schedule", 2024-09-12T02:30:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.468 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "restful", 2024-09-12T02:30:47.469 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "enable_auth": { 2024-09-12T02:30:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "enable_auth", 2024-09-12T02:30:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.470 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "key_file": { 2024-09-12T02:30:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "key_file", 2024-09-12T02:30:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.471 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.472 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.473 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.474 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.475 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.476 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.477 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.478 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.479 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "server_addr": { 2024-09-12T02:30:47.480 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_addr", 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "server_port": { 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "server_port", 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.482 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rgw", 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.483 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.484 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.485 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.486 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.487 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.488 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.489 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rook", 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.490 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.491 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.492 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.494 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.495 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "storage_class": { 2024-09-12T02:30:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "storage_class", 2024-09-12T02:30:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "local", 2024-09-12T02:30:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-12T02:30:47.497 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "selftest", 2024-09-12T02:30:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.498 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.499 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.500 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.501 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.502 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.503 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.504 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.505 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "roption1": { 2024-09-12T02:30:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "roption1", 2024-09-12T02:30:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.506 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "roption2": { 2024-09-12T02:30:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "roption2", 2024-09-12T02:30:47.507 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "xyz", 2024-09-12T02:30:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.509 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption1": { 2024-09-12T02:30:47.509 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption1", 2024-09-12T02:30:47.509 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.509 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.509 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.509 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.509 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.509 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.509 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.509 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.509 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.510 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.510 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.510 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption2": { 2024-09-12T02:30:47.510 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption2", 2024-09-12T02:30:47.510 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.510 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.510 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.510 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.510 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.510 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.511 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.511 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.511 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.511 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.511 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.511 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption3": { 2024-09-12T02:30:47.511 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption3", 2024-09-12T02:30:47.511 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "float", 2024-09-12T02:30:47.511 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.511 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.511 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.512 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.512 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.512 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.512 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.512 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.512 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.512 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.512 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption4": { 2024-09-12T02:30:47.512 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption4", 2024-09-12T02:30:47.512 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.513 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.513 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.513 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.513 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.513 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.513 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.513 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.513 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.513 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.513 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.513 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption5": { 2024-09-12T02:30:47.514 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption5", 2024-09-12T02:30:47.514 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.514 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.514 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.514 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.514 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.514 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.514 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.514 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.514 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.514 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.515 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.515 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption6": { 2024-09-12T02:30:47.515 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption6", 2024-09-12T02:30:47.515 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.515 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.515 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.515 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.515 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.515 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.515 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.516 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.516 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.516 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.516 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.516 INFO:teuthology.orchestra.run.smithi110.stdout: "rwoption7": { 2024-09-12T02:30:47.516 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rwoption7", 2024-09-12T02:30:47.516 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.516 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.516 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.516 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.517 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "1", 2024-09-12T02:30:47.517 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "42", 2024-09-12T02:30:47.517 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.517 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.517 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.517 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.517 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.517 INFO:teuthology.orchestra.run.smithi110.stdout: "testkey": { 2024-09-12T02:30:47.517 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "testkey", 2024-09-12T02:30:47.517 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.517 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.518 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.518 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.518 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.518 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.518 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.518 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.518 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.518 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.518 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.518 INFO:teuthology.orchestra.run.smithi110.stdout: "testlkey": { 2024-09-12T02:30:47.519 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "testlkey", 2024-09-12T02:30:47.519 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.519 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.519 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.519 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.519 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.519 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.519 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.519 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.519 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.519 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.519 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.520 INFO:teuthology.orchestra.run.smithi110.stdout: "testnewline": { 2024-09-12T02:30:47.520 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "testnewline", 2024-09-12T02:30:47.520 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.520 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.520 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.520 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.520 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.520 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.520 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.520 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.521 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.521 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.521 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.521 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.521 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.521 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "snap_schedule", 2024-09-12T02:30:47.521 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.521 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.521 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.522 INFO:teuthology.orchestra.run.smithi110.stdout: "allow_m_granularity": { 2024-09-12T02:30:47.522 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "allow_m_granularity", 2024-09-12T02:30:47.522 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.522 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.522 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.522 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.522 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.522 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.522 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.522 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "allow minute scheduled snapshots", 2024-09-12T02:30:47.522 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.522 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.523 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.523 INFO:teuthology.orchestra.run.smithi110.stdout: "dump_on_update": { 2024-09-12T02:30:47.523 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "dump_on_update", 2024-09-12T02:30:47.523 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.523 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.523 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.523 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.523 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.523 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.523 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.524 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "dump database to debug log on update", 2024-09-12T02:30:47.524 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.524 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.524 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.524 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.524 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.524 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.524 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.524 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.524 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.525 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.526 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.527 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.528 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.529 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "stats", 2024-09-12T02:30:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.530 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.531 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.532 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.533 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.536 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "status", 2024-09-12T02:30:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.537 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.538 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.539 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.540 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.541 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.542 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.543 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "telegraf", 2024-09-12T02:30:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.544 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "address": { 2024-09-12T02:30:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "address", 2024-09-12T02:30:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-12T02:30:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.545 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "15", 2024-09-12T02:30:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.546 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.547 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.548 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.549 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.550 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.551 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.552 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.553 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "telemetry", 2024-09-12T02:30:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_basic": { 2024-09-12T02:30:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_basic", 2024-09-12T02:30:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.554 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-12T02:30:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_crash": { 2024-09-12T02:30:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_crash", 2024-09-12T02:30:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.555 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-12T02:30:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_device": { 2024-09-12T02:30:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_device", 2024-09-12T02:30:47.556 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-12T02:30:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.557 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_ident": { 2024-09-12T02:30:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_ident", 2024-09-12T02:30:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-12T02:30:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.558 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "channel_perf": { 2024-09-12T02:30:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "channel_perf", 2024-09-12T02:30:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.559 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-12T02:30:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "contact": { 2024-09-12T02:30:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "contact", 2024-09-12T02:30:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.560 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "description": { 2024-09-12T02:30:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "description", 2024-09-12T02:30:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.561 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "device_url": { 2024-09-12T02:30:47.562 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "device_url", 2024-09-12T02:30:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-12T02:30:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "enabled": { 2024-09-12T02:30:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "enabled", 2024-09-12T02:30:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.564 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "24", 2024-09-12T02:30:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "8", 2024-09-12T02:30:47.565 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "last_opt_revision": { 2024-09-12T02:30:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "last_opt_revision", 2024-09-12T02:30:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.566 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "1", 2024-09-12T02:30:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "leaderboard": { 2024-09-12T02:30:47.567 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "leaderboard", 2024-09-12T02:30:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.568 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "leaderboard_description": { 2024-09-12T02:30:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "leaderboard_description", 2024-09-12T02:30:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.569 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.570 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.571 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.572 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.573 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.574 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.575 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.576 INFO:teuthology.orchestra.run.smithi110.stdout: "organization": { 2024-09-12T02:30:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "organization", 2024-09-12T02:30:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.577 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "proxy": { 2024-09-12T02:30:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "proxy", 2024-09-12T02:30:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.578 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "url": { 2024-09-12T02:30:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "url", 2024-09-12T02:30:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.579 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-12T02:30:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "test_orchestrator", 2024-09-12T02:30:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.581 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.582 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.583 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.584 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.585 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.586 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "volumes", 2024-09-12T02:30:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.587 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.588 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.589 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.590 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.591 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.592 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.593 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "max_concurrent_clones": { 2024-09-12T02:30:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "max_concurrent_clones", 2024-09-12T02:30:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "4", 2024-09-12T02:30:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.594 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-12T02:30:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "periodic_async_work": { 2024-09-12T02:30:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "periodic_async_work", 2024-09-12T02:30:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.595 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Periodically check for async work", 2024-09-12T02:30:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "snapshot_clone_delay": { 2024-09-12T02:30:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "snapshot_clone_delay", 2024-09-12T02:30:47.596 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "0", 2024-09-12T02:30:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-12T02:30:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "snapshot_clone_no_wait": { 2024-09-12T02:30:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "snapshot_clone_no_wait", 2024-09-12T02:30:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "True", 2024-09-12T02:30:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-12T02:30:47.598 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "zabbix", 2024-09-12T02:30:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "can_run": true, 2024-09-12T02:30:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "error_string": "", 2024-09-12T02:30:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "module_options": { 2024-09-12T02:30:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "discovery_interval": { 2024-09-12T02:30:47.599 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "discovery_interval", 2024-09-12T02:30:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "uint", 2024-09-12T02:30:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "100", 2024-09-12T02:30:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.600 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "identifier": { 2024-09-12T02:30:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "identifier", 2024-09-12T02:30:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.601 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "interval": { 2024-09-12T02:30:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "interval", 2024-09-12T02:30:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "secs", 2024-09-12T02:30:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "60", 2024-09-12T02:30:47.602 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "log_level": { 2024-09-12T02:30:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_level", 2024-09-12T02:30:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.603 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.604 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster": { 2024-09-12T02:30:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster", 2024-09-12T02:30:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.605 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_cluster_level": { 2024-09-12T02:30:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_cluster_level", 2024-09-12T02:30:47.606 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "info", 2024-09-12T02:30:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [ 2024-09-12T02:30:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "", 2024-09-12T02:30:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "critical", 2024-09-12T02:30:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "debug", 2024-09-12T02:30:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "error", 2024-09-12T02:30:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "info", 2024-09-12T02:30:47.607 INFO:teuthology.orchestra.run.smithi110.stdout: "warning" 2024-09-12T02:30:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "log_to_file": { 2024-09-12T02:30:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "log_to_file", 2024-09-12T02:30:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "bool", 2024-09-12T02:30:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.608 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 1, 2024-09-12T02:30:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "False", 2024-09-12T02:30:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "zabbix_host": { 2024-09-12T02:30:47.609 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "zabbix_host", 2024-09-12T02:30:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "", 2024-09-12T02:30:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.610 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "zabbix_port": { 2024-09-12T02:30:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "zabbix_port", 2024-09-12T02:30:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "int", 2024-09-12T02:30:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.611 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "10051", 2024-09-12T02:30:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "zabbix_sender": { 2024-09-12T02:30:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "zabbix_sender", 2024-09-12T02:30:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "str", 2024-09-12T02:30:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "level": "advanced", 2024-09-12T02:30:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "flags": 0, 2024-09-12T02:30:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-12T02:30:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "min": "", 2024-09-12T02:30:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "max": "", 2024-09-12T02:30:47.613 INFO:teuthology.orchestra.run.smithi110.stdout: "enum_allowed": [], 2024-09-12T02:30:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "desc": "", 2024-09-12T02:30:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "long_desc": "", 2024-09-12T02:30:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "tags": [], 2024-09-12T02:30:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: "see_also": [] 2024-09-12T02:30:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.614 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "services": { 2024-09-12T02:30:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "dashboard": "https://172.21.15.110:8443/" 2024-09-12T02:30:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "always_on_modules": { 2024-09-12T02:30:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "octopus": [ 2024-09-12T02:30:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "balancer", 2024-09-12T02:30:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-12T02:30:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "devicehealth", 2024-09-12T02:30:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "orchestrator", 2024-09-12T02:30:47.615 INFO:teuthology.orchestra.run.smithi110.stdout: "pg_autoscaler", 2024-09-12T02:30:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "progress", 2024-09-12T02:30:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "rbd_support", 2024-09-12T02:30:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "status", 2024-09-12T02:30:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "telemetry", 2024-09-12T02:30:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "volumes" 2024-09-12T02:30:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "pacific": [ 2024-09-12T02:30:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "balancer", 2024-09-12T02:30:47.616 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-12T02:30:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "devicehealth", 2024-09-12T02:30:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "orchestrator", 2024-09-12T02:30:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "pg_autoscaler", 2024-09-12T02:30:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "progress", 2024-09-12T02:30:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "rbd_support", 2024-09-12T02:30:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "status", 2024-09-12T02:30:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "telemetry", 2024-09-12T02:30:47.617 INFO:teuthology.orchestra.run.smithi110.stdout: "volumes" 2024-09-12T02:30:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "quincy": [ 2024-09-12T02:30:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "balancer", 2024-09-12T02:30:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-12T02:30:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "devicehealth", 2024-09-12T02:30:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "orchestrator", 2024-09-12T02:30:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "pg_autoscaler", 2024-09-12T02:30:47.618 INFO:teuthology.orchestra.run.smithi110.stdout: "progress", 2024-09-12T02:30:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "rbd_support", 2024-09-12T02:30:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "status", 2024-09-12T02:30:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "telemetry", 2024-09-12T02:30:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "volumes" 2024-09-12T02:30:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "reef": [ 2024-09-12T02:30:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "balancer", 2024-09-12T02:30:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-12T02:30:47.619 INFO:teuthology.orchestra.run.smithi110.stdout: "devicehealth", 2024-09-12T02:30:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "orchestrator", 2024-09-12T02:30:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "pg_autoscaler", 2024-09-12T02:30:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "progress", 2024-09-12T02:30:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "rbd_support", 2024-09-12T02:30:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "status", 2024-09-12T02:30:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "telemetry", 2024-09-12T02:30:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "volumes" 2024-09-12T02:30:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-12T02:30:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "squid": [ 2024-09-12T02:30:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "balancer", 2024-09-12T02:30:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "crash", 2024-09-12T02:30:47.620 INFO:teuthology.orchestra.run.smithi110.stdout: "devicehealth", 2024-09-12T02:30:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "orchestrator", 2024-09-12T02:30:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "pg_autoscaler", 2024-09-12T02:30:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "progress", 2024-09-12T02:30:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "rbd_support", 2024-09-12T02:30:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "status", 2024-09-12T02:30:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "telemetry", 2024-09-12T02:30:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "volumes" 2024-09-12T02:30:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T02:30:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "last_failure_osd_epoch": 98, 2024-09-12T02:30:47.621 INFO:teuthology.orchestra.run.smithi110.stdout: "active_clients": [ 2024-09-12T02:30:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "devicehealth", 2024-09-12T02:30:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "addrvec": [ 2024-09-12T02:30:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v2", 2024-09-12T02:30:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "172.21.15.110:0", 2024-09-12T02:30:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 2155305032 2024-09-12T02:30:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T02:30:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.622 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "libcephsqlite", 2024-09-12T02:30:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "addrvec": [ 2024-09-12T02:30:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v2", 2024-09-12T02:30:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "172.21.15.110:0", 2024-09-12T02:30:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 3871464040 2024-09-12T02:30:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T02:30:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "rbd_support", 2024-09-12T02:30:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: "addrvec": [ 2024-09-12T02:30:47.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v2", 2024-09-12T02:30:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "172.21.15.110:0", 2024-09-12T02:30:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 2888769103 2024-09-12T02:30:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T02:30:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "snap_schedule", 2024-09-12T02:30:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "addrvec": [ 2024-09-12T02:30:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.624 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v2", 2024-09-12T02:30:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "172.21.15.110:0", 2024-09-12T02:30:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 2347233043 2024-09-12T02:30:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T02:30:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "snap_schedule", 2024-09-12T02:30:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "addrvec": [ 2024-09-12T02:30:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v2", 2024-09-12T02:30:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "172.21.15.110:0", 2024-09-12T02:30:47.625 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 3290823627 2024-09-12T02:30:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T02:30:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "volumes", 2024-09-12T02:30:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "addrvec": [ 2024-09-12T02:30:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-12T02:30:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "type": "v2", 2024-09-12T02:30:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "addr": "172.21.15.110:0", 2024-09-12T02:30:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: "nonce": 797812845 2024-09-12T02:30:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.626 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T02:30:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:47.627 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-12T02:30:47.627 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:30:47.628 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:46 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3048487670' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T02:30:47.628 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:46 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/1377049485' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:30:47.628 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:46 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3048487670' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T02:30:47.628 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:46 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/1377049485' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:30:47.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.937+0000 7f583ce00640 1 -- 172.21.15.110:0/1377049485 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f581c0a2d00 msgr2=0x7f581c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.937+0000 7f583ce00640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f581c0a2d00 0x7f581c0a51c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f58240095f0 tx=0x7f5824005f90 comp rx=0 tx=0).stop 2024-09-12T02:30:47.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.937+0000 7f583ce00640 1 -- 172.21.15.110:0/1377049485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838103f10 msgr2=0x7f583819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:30:47.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.937+0000 7f583ce00640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838103f10 0x7f583819a590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f582800e9f0 tx=0x7f582800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.937+0000 7f583ce00640 1 -- 172.21.15.110:0/1377049485 shutdown_connections 2024-09-12T02:30:47.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.937+0000 7f583ce00640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f581c0a2d00 0x7f581c0a51c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.937+0000 7f583ce00640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f583819ee50 0x7f583819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.937+0000 7f583ce00640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5838109060 0x7f583819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.937+0000 7f583ce00640 1 --2- 172.21.15.110:0/1377049485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5838103f10 0x7f583819a590 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:30:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.937+0000 7f583ce00640 1 -- 172.21.15.110:0/1377049485 >> 172.21.15.110:0/1377049485 conn(0x7f58380ff980 msgr2=0x7f5838100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:30:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.939+0000 7f583ce00640 1 -- 172.21.15.110:0/1377049485 shutdown_connections 2024-09-12T02:30:47.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:30:45.939+0000 7f583ce00640 1 -- 172.21.15.110:0/1377049485 wait complete. 2024-09-12T02:30:47.636 DEBUG:tasks.check_counter:Getting stats from a 2024-09-12T02:30:47.637 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-12T02:30:47.637 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:46 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3048487670' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-12T02:30:47.637 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:46 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/1377049485' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-12T02:30:47.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:47 smithi110 ceph-mon[30548]: pgmap v493: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 3.4 MiB/s wr, 411 op/s 2024-09-12T02:30:47.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:47 smithi115 ceph-mon[35351]: pgmap v493: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 3.4 MiB/s wr, 411 op/s 2024-09-12T02:30:47.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:47 smithi136 ceph-mon[35814]: pgmap v493: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 3.4 MiB/s wr, 411 op/s 2024-09-12T02:30:48.027 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:49.081 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:30:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:30:49.081 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 242, 2024-09-12T02:30:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 436, 2024-09-12T02:30:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 141601, 2024-09-12T02:30:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 723949, 2024-09-12T02:30:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 13, 2024-09-12T02:30:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 5, 2024-09-12T02:30:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.078606410, 2024-09-12T02:30:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.036808017, 2024-09-12T02:30:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.015954286, 2024-09-12T02:30:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.014708359, 2024-09-12T02:30:49.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 432, 2024-09-12T02:30:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.164393780, 2024-09-12T02:30:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000380541 2024-09-12T02:30:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 2, 2024-09-12T02:30:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000140, 2024-09-12T02:30:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000070 2024-09-12T02:30:49.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:30:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 517056 2024-09-12T02:30:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:30:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 5893, 2024-09-12T02:30:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 6056, 2024-09-12T02:30:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 3792384, 2024-09-12T02:30:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 8713183, 2024-09-12T02:30:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 12, 2024-09-12T02:30:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 5, 2024-09-12T02:30:49.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.741072831, 2024-09-12T02:30:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.267953623, 2024-09-12T02:30:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.517642691, 2024-09-12T02:30:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.060077780, 2024-09-12T02:30:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 6058, 2024-09-12T02:30:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 1.372120978, 2024-09-12T02:30:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000226497 2024-09-12T02:30:49.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 9710, 2024-09-12T02:30:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.002866076, 2024-09-12T02:30:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000295 2024-09-12T02:30:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 4080, 2024-09-12T02:30:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 133216 2024-09-12T02:30:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:30:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 2383, 2024-09-12T02:30:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 3258, 2024-09-12T02:30:49.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 2351521, 2024-09-12T02:30:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 1620346, 2024-09-12T02:30:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 13, 2024-09-12T02:30:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 7, 2024-09-12T02:30:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.918332839, 2024-09-12T02:30:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.706579091, 2024-09-12T02:30:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.315668834, 2024-09-12T02:30:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000849879, 2024-09-12T02:30:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:49.087 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 3255, 2024-09-12T02:30:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.739015316, 2024-09-12T02:30:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000227040 2024-09-12T02:30:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 2238, 2024-09-12T02:30:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.001246271, 2024-09-12T02:30:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000556 2024-09-12T02:30:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 1750688, 2024-09-12T02:30:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 206896 2024-09-12T02:30:49.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "cct": { 2024-09-12T02:30:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "total_workers": 1, 2024-09-12T02:30:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "unhealthy_workers": 0 2024-09-12T02:30:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "finisher-MDSRank": { 2024-09-12T02:30:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "queue_len": 0, 2024-09-12T02:30:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "complete_latency": { 2024-09-12T02:30:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 1705, 2024-09-12T02:30:49.089 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.978004320, 2024-09-12T02:30:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000573609 2024-09-12T02:30:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "finisher-PurgeQueue": { 2024-09-12T02:30:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "queue_len": 0, 2024-09-12T02:30:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "complete_latency": { 2024-09-12T02:30:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 23, 2024-09-12T02:30:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000973856, 2024-09-12T02:30:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000042341 2024-09-12T02:30:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": { 2024-09-12T02:30:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "request": 769, 2024-09-12T02:30:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "reply": 721, 2024-09-12T02:30:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "reply_latency": { 2024-09-12T02:30:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 721, 2024-09-12T02:30:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 6.203087660, 2024-09-12T02:30:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.008603450 2024-09-12T02:30:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "slow_reply": 0, 2024-09-12T02:30:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "forward": 48, 2024-09-12T02:30:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_fetch_complete": 10, 2024-09-12T02:30:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_fetch_keys": 0, 2024-09-12T02:30:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_commit": 20, 2024-09-12T02:30:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_split": 1, 2024-09-12T02:30:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_merge": 0, 2024-09-12T02:30:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes": 896, 2024-09-12T02:30:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_top": 53, 2024-09-12T02:30:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_bottom": 791, 2024-09-12T02:30:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_pin_tail": 52, 2024-09-12T02:30:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_pinned": 820, 2024-09-12T02:30:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_expired": 1711, 2024-09-12T02:30:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "inodes_with_caps": 246, 2024-09-12T02:30:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": 246, 2024-09-12T02:30:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "subtrees": 16, 2024-09-12T02:30:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse": 2727, 2024-09-12T02:30:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_hit": 2088, 2024-09-12T02:30:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_forward": 36, 2024-09-12T02:30:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_discover": 51, 2024-09-12T02:30:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_dir_fetch": 4, 2024-09-12T02:30:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_remote_ino": 0, 2024-09-12T02:30:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "traverse_lock": 103, 2024-09-12T02:30:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "load_cent": 14802, 2024-09-12T02:30:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "q": 0, 2024-09-12T02:30:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "exported": 9, 2024-09-12T02:30:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "exported_inodes": 1627, 2024-09-12T02:30:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "imported": 12, 2024-09-12T02:30:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "imported_inodes": 1868, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "openino_dir_fetch": 0, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "openino_peer_discover": 0, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "root_rfiles": 992, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "root_rbytes": 824794995, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "root_rsnaps": 0, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_set_tag": 0, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:30:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "scrub_file_inodes": 0, 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_inode_file_caps": 29, 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_revoke": 292, 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_grant": 497, 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_flushsnap_ack": 2, 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_caps": 939, 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_caps_dirty": 479, 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_cap_release": 67, 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "process_request_cap_release": 367 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_cache": { 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_update": 0, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_update_receipt": 0, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_try_discover": 0, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_send_discover": 97, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "dir_handle_discover": 62, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "num_strays": 10, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "num_strays_delayed": 0, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "strays_created": 94, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "strays_enqueued": 4, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "strays_reintegrated": 80, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "strays_migrated": 19, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "num_recovering_processing": 0, 2024-09-12T02:30:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "recovery_started": 0, 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "recovery_completed": 0, 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_exportdir": 10, 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_flush": 0, 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_fragmentdir": 1, 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_fragstats": 0, 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "ireq_inodestats": 0 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_log": { 2024-09-12T02:30:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "evlrg": 1, 2024-09-12T02:30:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "evadd": 1945, 2024-09-12T02:30:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "evex": 0, 2024-09-12T02:30:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "evtrm": 0, 2024-09-12T02:30:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "ev": 1945, 2024-09-12T02:30:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "evexg": 0, 2024-09-12T02:30:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "evexd": 0, 2024-09-12T02:30:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "segadd": 4, 2024-09-12T02:30:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "segex": 0, 2024-09-12T02:30:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "segtrm": 0, 2024-09-12T02:30:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "seg": 4, 2024-09-12T02:30:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "segmjr": 2, 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "segexg": 0, 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "segexd": 0, 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "expos": 4194304, 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "wrpos": 9691457, 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "rdpos": 0, 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "jlat": { 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 758, 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 10.269306112, 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.013547897 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "replayed": 0 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_mem": { 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "ino": 687, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "ino+": 2311, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "ino-": 1624, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "dir": 60, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "dir+": 86, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "dir-": 26, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "dn": 904, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "dn+": 2618, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "dn-": 1714, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "cap": 246, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "cap+": 572, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "cap-": 326, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "rss": 62312, 2024-09-12T02:30:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "heap": 223520 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_server": { 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "dispatch_client_request": 1950, 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "dispatch_server_request": 541, 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_request": 769, 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_client_session": 196, 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "handle_peer_request": 1051, 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "req_create_latency": { 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 27, 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.063284299, 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.002343862 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "req_getattr_latency": { 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 46, 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.067760876, 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.001473062 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "req_getfilelock_latency": { 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "req_link_latency": { 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 88, 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 1.398269498, 2024-09-12T02:30:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.015889426 2024-09-12T02:30:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookup_latency": { 2024-09-12T02:30:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 304, 2024-09-12T02:30:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.620851808, 2024-09-12T02:30:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.002042275 2024-09-12T02:30:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookuphash_latency": { 2024-09-12T02:30:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookupino_latency": { 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookupname_latency": { 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookupparent_latency": { 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lookupsnap_latency": { 2024-09-12T02:30:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "req_lssnap_latency": { 2024-09-12T02:30:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "req_mkdir_latency": { 2024-09-12T02:30:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "req_mknod_latency": { 2024-09-12T02:30:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "req_mksnap_latency": { 2024-09-12T02:30:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "req_open_latency": { 2024-09-12T02:30:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 39, 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.297533811, 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.007629072 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "req_readdir_latency": { 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 25, 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.037568609, 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.001502744 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "req_rename_latency": { 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 98, 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 3.266561677, 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.033332262 2024-09-12T02:30:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "req_renamesnap_latency": { 2024-09-12T02:30:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "req_snapdiff_latency": { 2024-09-12T02:30:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "req_rmdir_latency": { 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "req_rmsnap_latency": { 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "req_rmxattr_latency": { 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setattr_latency": { 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setdirlayout_latency": { 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setfilelock_latency": { 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setlayout_latency": { 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "req_setxattr_latency": { 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "req_symlink_latency": { 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "req_unlink_latency": { 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 94, 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.451257082, 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.004800607 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:30:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "req_getvxattr_latency": { 2024-09-12T02:30:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_sessions": { 2024-09-12T02:30:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "session_count": 2, 2024-09-12T02:30:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "session_add": 4, 2024-09-12T02:30:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "session_remove": 2, 2024-09-12T02:30:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "sessions_open": 2, 2024-09-12T02:30:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "sessions_stale": 0, 2024-09-12T02:30:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "total_load": 142, 2024-09-12T02:30:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "average_load": 71, 2024-09-12T02:30:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "avg_session_uptime": 915, 2024-09-12T02:30:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "mdthresh_evicted": 0 2024-09-12T02:30:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "mempool": { 2024-09-12T02:30:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:30:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_items": 0, 2024-09-12T02:30:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:30:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:30:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:30:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:30:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:30:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:30:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:30:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:30:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:30:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:30:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:30:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:30:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:30:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_items": 0, 2024-09-12T02:30:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:30:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_items": 0, 2024-09-12T02:30:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:30:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:30:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:30:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:30:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:30:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_items": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_items": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_bytes": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_items": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:30:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_bytes": 748194, 2024-09-12T02:30:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_items": 795, 2024-09-12T02:30:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:30:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_items": 0, 2024-09-12T02:30:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_bytes": 0, 2024-09-12T02:30:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_items": 0, 2024-09-12T02:30:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:30:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_items": 0, 2024-09-12T02:30:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:30:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_items": 0, 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_bytes": 9616, 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_items": 195, 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_bytes": 0, 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_items": 0, 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_bytes": 2617852, 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_items": 58867, 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_bytes": 0, 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_items": 0, 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_bytes": 0, 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_items": 0 2024-09-12T02:30:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "objecter": { 2024-09-12T02:30:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "op_active": 0, 2024-09-12T02:30:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "op_laggy": 0, 2024-09-12T02:30:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "op_send": 1043, 2024-09-12T02:30:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "op_send_bytes": 5727848, 2024-09-12T02:30:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "op_resend": 32, 2024-09-12T02:30:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "op_reply": 1043, 2024-09-12T02:30:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "op_latency": { 2024-09-12T02:30:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 1043, 2024-09-12T02:30:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 16.794721451, 2024-09-12T02:30:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.016102321 2024-09-12T02:30:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "op_inflight": 0, 2024-09-12T02:30:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "oplen_avg": { 2024-09-12T02:30:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 1043, 2024-09-12T02:30:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 1240 2024-09-12T02:30:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "op": 1043, 2024-09-12T02:30:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "op_r": 21, 2024-09-12T02:30:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "op_w": 1022, 2024-09-12T02:30:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "op_rmw": 0, 2024-09-12T02:30:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "op_pg": 0, 2024-09-12T02:30:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_stat": 0, 2024-09-12T02:30:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_create": 10, 2024-09-12T02:30:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_read": 1, 2024-09-12T02:30:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_write": 759, 2024-09-12T02:30:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_writefull": 64, 2024-09-12T02:30:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_writesame": 0, 2024-09-12T02:30:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_append": 0, 2024-09-12T02:30:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_zero": 1, 2024-09-12T02:30:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_truncate": 1, 2024-09-12T02:30:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_delete": 27, 2024-09-12T02:30:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_mapext": 0, 2024-09-12T02:30:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_sparse_read": 0, 2024-09-12T02:30:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_clonerange": 0, 2024-09-12T02:30:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_getxattr": 0, 2024-09-12T02:30:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_setxattr": 20, 2024-09-12T02:30:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:30:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_rmxattr": 0, 2024-09-12T02:30:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:30:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_call": 0, 2024-09-12T02:30:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_watch": 0, 2024-09-12T02:30:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_notify": 0, 2024-09-12T02:30:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:30:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_pgls": 0, 2024-09-12T02:30:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:30:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "osdop_other": 0, 2024-09-12T02:30:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "linger_active": 0, 2024-09-12T02:30:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "linger_send": 0, 2024-09-12T02:30:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "linger_resend": 0, 2024-09-12T02:30:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "linger_ping": 0, 2024-09-12T02:30:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "poolop_active": 0, 2024-09-12T02:30:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "poolop_send": 0, 2024-09-12T02:30:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "poolop_resend": 0, 2024-09-12T02:30:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "poolstat_active": 0, 2024-09-12T02:30:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "poolstat_send": 0, 2024-09-12T02:30:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "poolstat_resend": 0, 2024-09-12T02:30:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "statfs_active": 0, 2024-09-12T02:30:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "statfs_send": 0, 2024-09-12T02:30:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "statfs_resend": 0, 2024-09-12T02:30:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "command_active": 0, 2024-09-12T02:30:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "command_send": 0, 2024-09-12T02:30:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "command_resend": 0, 2024-09-12T02:30:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "map_epoch": 116, 2024-09-12T02:30:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "map_full": 0, 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "map_inc": 21, 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_sessions": 11, 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_session_open": 14, 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_session_close": 3, 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_laggy": 0, 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_wr": 264, 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_rd": 30, 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_del": 63 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "oft": { 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_total_objs": 1, 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:30:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_total_updates": 0, 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "omap_total_removes": 0 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "osd-slow-ops": { 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "slow_ops_count": 0 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "purge_queue": { 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executing_ops": 0, 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executing_ops_high_water": 15, 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executing": 0, 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executing_high_water": 4, 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executed_ops": 15, 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_executed": 4, 2024-09-12T02:30:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "pq_item_in_journal": 0 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 104857600, 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 8514, 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 5526700, 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 8514, 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 8514, 2024-09-12T02:30:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 5526700, 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-objecter_bytes": { 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 104857600, 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 0, 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 0, 2024-09-12T02:30:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 0, 2024-09-12T02:30:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 1043, 2024-09-12T02:30:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 5727741, 2024-09-12T02:30:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 1043, 2024-09-12T02:30:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 5727741, 2024-09-12T02:30:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-12T02:30:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-objecter_ops": { 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 1024, 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 0, 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 0, 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 0, 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 1043, 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 1043, 2024-09-12T02:30:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 1043, 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 1043, 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 3758096384, 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 4, 2024-09-12T02:30:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 476, 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 4, 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 1, 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 476, 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-write_buf_throttle-0x5561d5432960": { 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 2870, 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 3758096384, 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 1945, 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 5497153, 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 1945, 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 758, 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 5494283, 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:49.138 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:30:49.690 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:49 smithi110 ceph-mon[30548]: pgmap v494: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 2.8 MiB/s wr, 332 op/s 2024-09-12T02:30:49.805 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:49 smithi115 ceph-mon[35351]: pgmap v494: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 2.8 MiB/s wr, 332 op/s 2024-09-12T02:30:49.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:49 smithi136 ceph-mon[35814]: pgmap v494: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 2.8 MiB/s wr, 332 op/s 2024-09-12T02:30:50.083 INFO:tasks.check_counter:Daemon mds.a mds.exported=9 2024-09-12T02:30:50.083 INFO:tasks.check_counter:Daemon mds.a mds.imported=12 2024-09-12T02:30:50.083 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-12T02:30:50.083 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:30:50.084 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:30:50.084 DEBUG:tasks.check_counter:Getting stats from d 2024-09-12T02:30:50.084 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-12T02:30:50.454 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:51.081 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:30:51.081 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:30:51.081 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 324, 2024-09-12T02:30:51.081 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 311, 2024-09-12T02:30:51.081 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 1611872, 2024-09-12T02:30:51.081 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 191088, 2024-09-12T02:30:51.081 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 4, 2024-09-12T02:30:51.081 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 0, 2024-09-12T02:30:51.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.110039825, 2024-09-12T02:30:51.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.055652479, 2024-09-12T02:30:51.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.062550687, 2024-09-12T02:30:51.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:30:51.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:51.082 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 311, 2024-09-12T02:30:51.082 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.077558604, 2024-09-12T02:30:51.082 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000249384 2024-09-12T02:30:51.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:51.082 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 1611872, 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 191088 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 3, 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 237, 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 480, 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 277680, 2024-09-12T02:30:51.083 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 6, 2024-09-12T02:30:51.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 3, 2024-09-12T02:30:51.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.033853352, 2024-09-12T02:30:51.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.025502911, 2024-09-12T02:30:51.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.004614081, 2024-09-12T02:30:51.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:30:51.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:51.084 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 234, 2024-09-12T02:30:51.084 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.067737771, 2024-09-12T02:30:51.084 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000289477 2024-09-12T02:30:51.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:51.084 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:51.085 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:51.085 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:51.085 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:51.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:51.085 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-12T02:30:51.085 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 277680 2024-09-12T02:30:51.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:51.085 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:30:51.085 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 0, 2024-09-12T02:30:51.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 2, 2024-09-12T02:30:51.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:30:51.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 0, 2024-09-12T02:30:51.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 2, 2024-09-12T02:30:51.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 1, 2024-09-12T02:30:51.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.000805595, 2024-09-12T02:30:51.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:30:51.086 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.000672562, 2024-09-12T02:30:51.087 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:30:51.087 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:51.087 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:51.087 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:51.087 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:51.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:51.087 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:51.087 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:51.087 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:51.088 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:51.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:51.088 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:30:51.088 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:30:51.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:51.088 INFO:teuthology.orchestra.run.smithi110.stdout: "cct": { 2024-09-12T02:30:51.089 INFO:teuthology.orchestra.run.smithi110.stdout: "total_workers": 0, 2024-09-12T02:30:51.089 INFO:teuthology.orchestra.run.smithi110.stdout: "unhealthy_workers": 0 2024-09-12T02:30:51.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:51.089 INFO:teuthology.orchestra.run.smithi110.stdout: "mempool": { 2024-09-12T02:30:51.089 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:30:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_items": 0, 2024-09-12T02:30:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:30:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:30:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:30:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:30:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:30:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:30:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:30:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:30:51.090 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:30:51.091 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:30:51.091 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:30:51.091 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:30:51.091 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:30:51.091 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_items": 0, 2024-09-12T02:30:51.091 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:30:51.091 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_items": 0, 2024-09-12T02:30:51.091 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:30:51.092 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:30:51.092 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:30:51.092 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:30:51.092 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:30:51.092 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:30:51.092 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:30:51.092 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_items": 0, 2024-09-12T02:30:51.092 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:30:51.092 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:30:51.092 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:30:51.093 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_items": 0, 2024-09-12T02:30:51.093 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_bytes": 0, 2024-09-12T02:30:51.093 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_items": 0, 2024-09-12T02:30:51.093 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:30:51.093 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:30:51.093 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:30:51.093 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:30:51.093 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_bytes": 147930, 2024-09-12T02:30:51.093 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_items": 28, 2024-09-12T02:30:51.093 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:30:51.093 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_items": 0, 2024-09-12T02:30:51.093 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_bytes": 0, 2024-09-12T02:30:51.094 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_items": 0, 2024-09-12T02:30:51.094 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:30:51.094 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_items": 0, 2024-09-12T02:30:51.094 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:30:51.094 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_items": 0, 2024-09-12T02:30:51.094 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_bytes": 0, 2024-09-12T02:30:51.094 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_items": 0, 2024-09-12T02:30:51.094 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:30:51.094 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:30:51.095 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_bytes": 0, 2024-09-12T02:30:51.095 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_items": 0, 2024-09-12T02:30:51.095 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_bytes": 928, 2024-09-12T02:30:51.095 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_items": 2, 2024-09-12T02:30:51.095 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_bytes": 0, 2024-09-12T02:30:51.095 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_items": 0, 2024-09-12T02:30:51.095 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_bytes": 0, 2024-09-12T02:30:51.095 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_items": 0 2024-09-12T02:30:51.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:51.096 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:30:51.096 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-12T02:30:51.096 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 104857600, 2024-09-12T02:30:51.096 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-12T02:30:51.096 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 323, 2024-09-12T02:30:51.096 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 1563737, 2024-09-12T02:30:51.096 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:51.096 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 323, 2024-09-12T02:30:51.097 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-12T02:30:51.097 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-12T02:30:51.097 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 323, 2024-09-12T02:30:51.097 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 1563737, 2024-09-12T02:30:51.097 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-12T02:30:51.097 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:51.097 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:51.097 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:51.097 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:51.097 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:51.098 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:30:51.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:51 smithi110 ceph-mon[30548]: pgmap v495: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 2.8 MiB/s wr, 336 op/s 2024-09-12T02:30:51.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:51 smithi115 ceph-mon[35351]: pgmap v495: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 2.8 MiB/s wr, 336 op/s 2024-09-12T02:30:51.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:51 smithi136 ceph-mon[35814]: pgmap v495: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 2.8 MiB/s wr, 336 op/s 2024-09-12T02:30:51.923 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-12T02:30:51.923 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-12T02:30:51.923 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-12T02:30:51.923 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-12T02:30:51.923 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-12T02:30:51.923 DEBUG:tasks.check_counter:Getting stats from g 2024-09-12T02:30:51.924 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-12T02:30:52.291 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:52.972 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:30:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:30:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 0, 2024-09-12T02:30:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 2, 2024-09-12T02:30:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:30:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 0, 2024-09-12T02:30:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 4, 2024-09-12T02:30:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 0, 2024-09-12T02:30:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.003102266, 2024-09-12T02:30:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:30:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.000436351, 2024-09-12T02:30:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:30:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:30:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:30:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:30:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 319, 2024-09-12T02:30:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 306, 2024-09-12T02:30:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 1610448, 2024-09-12T02:30:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 188368, 2024-09-12T02:30:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 2, 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 1, 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.094481270, 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.047564295, 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.059909699, 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 306, 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.061401830, 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000200659 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 1610448, 2024-09-12T02:30:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 188368 2024-09-12T02:30:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:30:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 3, 2024-09-12T02:30:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 234, 2024-09-12T02:30:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 480, 2024-09-12T02:30:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 277152, 2024-09-12T02:30:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 6, 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 3, 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.033915800, 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.026957614, 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.003093140, 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 231, 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.066665884, 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000288596 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-12T02:30:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 277152 2024-09-12T02:30:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "cct": { 2024-09-12T02:30:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "total_workers": 0, 2024-09-12T02:30:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "unhealthy_workers": 0 2024-09-12T02:30:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "mempool": { 2024-09-12T02:30:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:30:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_items": 0, 2024-09-12T02:30:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:30:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:30:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:30:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:30:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:30:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:30:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:30:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:30:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:30:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:30:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:30:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:30:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:30:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_items": 0, 2024-09-12T02:30:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:30:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_items": 0, 2024-09-12T02:30:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:30:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:30:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:30:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:30:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:30:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:30:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:30:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_items": 0, 2024-09-12T02:30:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:30:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:30:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:30:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_items": 0, 2024-09-12T02:30:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_bytes": 0, 2024-09-12T02:30:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_items": 0, 2024-09-12T02:30:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:30:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:30:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:30:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:30:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_bytes": 147930, 2024-09-12T02:30:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_items": 28, 2024-09-12T02:30:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:30:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_items": 0, 2024-09-12T02:30:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_bytes": 0, 2024-09-12T02:30:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_items": 0, 2024-09-12T02:30:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:30:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_items": 0, 2024-09-12T02:30:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:30:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_items": 0, 2024-09-12T02:30:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_bytes": 0, 2024-09-12T02:30:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_items": 0, 2024-09-12T02:30:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_bytes": 0, 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_items": 0, 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_bytes": 928, 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_items": 2, 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_bytes": 0, 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_items": 0, 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_bytes": 0, 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_items": 0 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 104857600, 2024-09-12T02:30:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 318, 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 1563023, 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 318, 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 318, 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 1563023, 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:52.985 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:30:53.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:53 smithi110 ceph-mon[30548]: pgmap v496: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 1.3 MiB/s wr, 155 op/s 2024-09-12T02:30:53.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:53 smithi115 ceph-mon[35351]: pgmap v496: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 1.3 MiB/s wr, 155 op/s 2024-09-12T02:30:53.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:53 smithi136 ceph-mon[35814]: pgmap v496: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 1.3 MiB/s wr, 155 op/s 2024-09-12T02:30:54.005 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-12T02:30:54.005 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-12T02:30:54.006 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-12T02:30:54.006 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-12T02:30:54.006 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-12T02:30:54.006 DEBUG:tasks.check_counter:Getting stats from j 2024-09-12T02:30:54.006 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-12T02:30:54.373 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:30:55.040 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-12T02:30:55.040 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:30:55.040 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 326, 2024-09-12T02:30:55.040 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 313, 2024-09-12T02:30:55.040 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 1612416, 2024-09-12T02:30:55.040 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 192368, 2024-09-12T02:30:55.040 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 4, 2024-09-12T02:30:55.041 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 0, 2024-09-12T02:30:55.041 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.094880080, 2024-09-12T02:30:55.041 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.041577353, 2024-09-12T02:30:55.041 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.068553243, 2024-09-12T02:30:55.041 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:30:55.041 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:55.041 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 313, 2024-09-12T02:30:55.041 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.093024726, 2024-09-12T02:30:55.041 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000297203 2024-09-12T02:30:55.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:55.041 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:55.042 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:55.042 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:55.042 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:55.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:55.042 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 1612416, 2024-09-12T02:30:55.042 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 192368 2024-09-12T02:30:55.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:55.042 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:30:55.042 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 3, 2024-09-12T02:30:55.042 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 239, 2024-09-12T02:30:55.042 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 480, 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 278032, 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 6, 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 3, 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.035868963, 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.028245860, 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.003478570, 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 236, 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.078856945, 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000334139 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:55.043 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:55.044 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:55.044 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:55.044 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:55.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:55.044 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-12T02:30:55.044 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 278032 2024-09-12T02:30:55.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:55.044 INFO:teuthology.orchestra.run.smithi110.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:30:55.044 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_messages": 0, 2024-09-12T02:30:55.044 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages": 2, 2024-09-12T02:30:55.044 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:30:55.044 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_bytes": 0, 2024-09-12T02:30:55.045 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_created_connections": 2, 2024-09-12T02:30:55.045 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_active_connections": 1, 2024-09-12T02:30:55.045 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_total_time": 0.000595775, 2024-09-12T02:30:55.045 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:30:55.045 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_recv_time": 0.000479874, 2024-09-12T02:30:55.045 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:30:55.045 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:55.045 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:55.045 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:55.045 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:55.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:55.046 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:55.046 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:55.046 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:55.046 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:55.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:55.046 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:30:55.046 INFO:teuthology.orchestra.run.smithi110.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:30:55.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:55.046 INFO:teuthology.orchestra.run.smithi110.stdout: "cct": { 2024-09-12T02:30:55.046 INFO:teuthology.orchestra.run.smithi110.stdout: "total_workers": 0, 2024-09-12T02:30:55.046 INFO:teuthology.orchestra.run.smithi110.stdout: "unhealthy_workers": 0 2024-09-12T02:30:55.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:55.047 INFO:teuthology.orchestra.run.smithi110.stdout: "mempool": { 2024-09-12T02:30:55.047 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:30:55.047 INFO:teuthology.orchestra.run.smithi110.stdout: "bloom_filter_items": 0, 2024-09-12T02:30:55.047 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:30:55.047 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:30:55.047 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:30:55.047 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:30:55.047 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:30:55.047 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:30:55.047 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:30:55.047 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_extent_items": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_blob_items": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:30:55.048 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_txc_items": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluestore_writing_items": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_bytes": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_items": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:30:55.049 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_bytes": 147930, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_anon_items": 28, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "buffer_meta_items": 0, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_bytes": 0, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_items": 0, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_mapbl_items": 0, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "osd_pglog_items": 0, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_bytes": 0, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_items": 0, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:30:55.050 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_bytes": 0, 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "pgmap_items": 0, 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_bytes": 928, 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "mds_co_items": 2, 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_bytes": 0, 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_1_items": 0, 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_bytes": 0, 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "unittest_2_items": 0 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "val": 0, 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "max": 104857600, 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "get_started": 0, 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "get": 325, 2024-09-12T02:30:55.051 INFO:teuthology.orchestra.run.smithi110.stdout: "get_sum": 1563997, 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout: "get_or_fail_success": 325, 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout: "take": 0, 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout: "take_sum": 0, 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout: "put": 325, 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout: "put_sum": 1563997, 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout: "wait": { 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout: "avgcount": 0, 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout: "sum": 0.000000000, 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout: "avgtime": 0.000000000 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-12T02:30:55.052 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-12T02:30:55.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:55 smithi110 ceph-mon[30548]: pgmap v497: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 517 KiB/s wr, 61 op/s 2024-09-12T02:30:55.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:55 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:55.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:55 smithi115 ceph-mon[35351]: pgmap v497: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 517 KiB/s wr, 61 op/s 2024-09-12T02:30:55.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:55 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:55.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:55 smithi136 ceph-mon[35814]: pgmap v497: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 517 KiB/s wr, 61 op/s 2024-09-12T02:30:55.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:55 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T02:30:55.965 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-12T02:30:55.966 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-12T02:30:55.966 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-12T02:30:55.966 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-12T02:30:55.966 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-12T02:30:55.966 DEBUG:tasks.check_counter:Getting stats from b 2024-09-12T02:30:55.966 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-12T02:30:56.361 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:30:56.675 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:56 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:56.675 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:56 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:56.675 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:56 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:30:56.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:56 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:56.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:56 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:56.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:56 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:30:56.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:56 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T02:30:56.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:56 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T02:30:56.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:56 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' 2024-09-12T02:30:57.098 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-12T02:30:57.098 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:30:57.098 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 3399, 2024-09-12T02:30:57.098 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 3666, 2024-09-12T02:30:57.098 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 1347091, 2024-09-12T02:30:57.098 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 15798211, 2024-09-12T02:30:57.098 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 11, 2024-09-12T02:30:57.098 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 3, 2024-09-12T02:30:57.098 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.284806515, 2024-09-12T02:30:57.098 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.103397386, 2024-09-12T02:30:57.098 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.133005606, 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.057190517, 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3665, 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.363659484, 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000099224 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3836, 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000731678, 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000190 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 46128, 2024-09-12T02:30:57.099 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 3344 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 1441, 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 1437, 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 2088699, 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 13182112, 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 13, 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 5, 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.159221553, 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.059300381, 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.077994320, 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.035936153, 2024-09-12T02:30:57.100 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1435, 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.768658199, 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000535650 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 306, 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000074027, 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000241 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 1867184, 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 670384 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.101 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 11150, 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 13189, 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 5480521, 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 15807711, 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 15, 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 7, 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.772833971, 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.275113798, 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.452013816, 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.120610619, 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 13187, 2024-09-12T02:30:57.102 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 1.177070100, 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000089259 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 13916, 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.003408296, 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000244 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 473904, 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 290624 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "cct": { 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "total_workers": 1, 2024-09-12T02:30:57.103 INFO:teuthology.orchestra.run.smithi115.stdout: "unhealthy_workers": 0 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-MDSRank": { 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2880, 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 2.194276720, 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000761901 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-PurgeQueue": { 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-12T02:30:57.104 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 778, 2024-09-12T02:30:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.046521927, 2024-09-12T02:30:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000059796 2024-09-12T02:30:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:30:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-12T02:30:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: "request": 2733, 2024-09-12T02:30:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: "reply": 2607, 2024-09-12T02:30:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: "reply_latency": { 2024-09-12T02:30:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2607, 2024-09-12T02:30:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 8.026229809, 2024-09-12T02:30:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.003078722 2024-09-12T02:30:57.105 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_reply": 0, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "forward": 126, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_complete": 1, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_keys": 0, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_commit": 47, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_split": 4, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_merge": 0, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes": 1028, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_top": 48, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_bottom": 782, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pin_tail": 198, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pinned": 959, 2024-09-12T02:30:57.106 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_expired": 2486, 2024-09-12T02:30:57.107 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_with_caps": 439, 2024-09-12T02:30:57.107 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": 439, 2024-09-12T02:30:57.107 INFO:teuthology.orchestra.run.smithi115.stdout: "subtrees": 47, 2024-09-12T02:30:57.107 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse": 3756, 2024-09-12T02:30:57.107 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_hit": 3010, 2024-09-12T02:30:57.107 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_forward": 105, 2024-09-12T02:30:57.107 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_discover": 16, 2024-09-12T02:30:57.107 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:30:57.107 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_remote_ino": 0, 2024-09-12T02:30:57.107 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_lock": 62, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "load_cent": 11606, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "q": 0, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "exported": 25, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "exported_inodes": 2448, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "imported": 8, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "imported_inodes": 1647, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_dir_fetch": 0, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_peer_discover": 3, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rfiles": 1001, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rbytes": 1248894468, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rsnaps": 6, 2024-09-12T02:30:57.108 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:30:57.109 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_set_tag": 0, 2024-09-12T02:30:57.109 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:30:57.109 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:30:57.109 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:30:57.109 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:30:57.109 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:30:57.109 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_file_inodes": 0, 2024-09-12T02:30:57.109 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_inode_file_caps": 19, 2024-09-12T02:30:57.109 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_revoke": 245, 2024-09-12T02:30:57.109 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_grant": 2093, 2024-09-12T02:30:57.109 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:30:57.109 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps": 2193, 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps_dirty": 1481, 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_cap_release": 173, 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: "process_request_cap_release": 675 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_cache": { 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update": 0, 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update_receipt": 0, 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_try_discover": 0, 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_send_discover": 29, 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_handle_discover": 55, 2024-09-12T02:30:57.110 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays": 2, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_delayed": 0, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_created": 274, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_enqueued": 236, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_reintegrated": 32, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_migrated": 9, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_processing": 0, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_started": 0, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_completed": 0, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:30:57.111 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_exportdir": 25, 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_flush": 0, 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragmentdir": 4, 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragstats": 0, 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_inodestats": 0 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_log": { 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "evlrg": 1, 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "evadd": 4899, 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "evex": 0, 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "evtrm": 0, 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "ev": 4899, 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "evexg": 0, 2024-09-12T02:30:57.112 INFO:teuthology.orchestra.run.smithi115.stdout: "evexd": 0, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "segadd": 12, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "segex": 0, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "segtrm": 0, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "seg": 12, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "segmjr": 2, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "segexg": 0, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "segexd": 0, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "expos": 4194304, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "wrpos": 39931505, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "rdpos": 0, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "jlat": { 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1648, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 26.679062158, 2024-09-12T02:30:57.113 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.016188751 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: "replayed": 0 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_mem": { 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: "ino": 817, 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: "ino+": 3434, 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: "ino-": 2617, 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: "dir": 106, 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: "dir+": 126, 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: "dir-": 20, 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: "dn": 876, 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: "dn+": 3860, 2024-09-12T02:30:57.114 INFO:teuthology.orchestra.run.smithi115.stdout: "dn-": 2984, 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "cap": 399, 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "cap+": 1851, 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "cap-": 1452, 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "rss": 69184, 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "heap": 231712 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_server": { 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_client_request": 3177, 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_server_request": 644, 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_request": 2733, 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_session": 262, 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_peer_request": 1057, 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "req_create_latency": { 2024-09-12T02:30:57.115 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1230, 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 4.242755365, 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.003449394 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getattr_latency": { 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 209, 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.110197274, 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000527259 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getfilelock_latency": { 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: "req_link_latency": { 2024-09-12T02:30:57.116 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 32, 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.174554281, 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.005454821 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookup_latency": { 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 235, 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.840177122, 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.003575221 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookuphash_latency": { 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupino_latency": { 2024-09-12T02:30:57.117 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 1, 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000142374, 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000142374 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupname_latency": { 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupparent_latency": { 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupsnap_latency": { 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.118 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.119 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.119 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lssnap_latency": { 2024-09-12T02:30:57.119 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 15, 2024-09-12T02:30:57.119 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.002210481, 2024-09-12T02:30:57.119 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000147365 2024-09-12T02:30:57.119 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mkdir_latency": { 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 37, 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.322424743, 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.008714182 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mknod_latency": { 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mksnap_latency": { 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 15, 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.430935429, 2024-09-12T02:30:57.120 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.028729028 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: "req_open_latency": { 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 410, 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.073527742, 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000179335 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: "req_readdir_latency": { 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 79, 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.130265225, 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.001648926 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rename_latency": { 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 265, 2024-09-12T02:30:57.121 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 1.211537427, 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.004571839 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: "req_renamesnap_latency": { 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: "req_snapdiff_latency": { 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.122 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmdir_latency": { 2024-09-12T02:30:57.123 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2, 2024-09-12T02:30:57.123 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.011031859, 2024-09-12T02:30:57.123 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.005515929 2024-09-12T02:30:57.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.123 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmsnap_latency": { 2024-09-12T02:30:57.123 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 9, 2024-09-12T02:30:57.123 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.189134377, 2024-09-12T02:30:57.123 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.021014930 2024-09-12T02:30:57.123 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.123 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmxattr_latency": { 2024-09-12T02:30:57.123 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.123 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setattr_latency": { 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 2, 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.001399151, 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000699575 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setdirlayout_latency": { 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setfilelock_latency": { 2024-09-12T02:30:57.124 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setlayout_latency": { 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setxattr_latency": { 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 8, 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.019956329, 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.002494541 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.125 INFO:teuthology.orchestra.run.smithi115.stdout: "req_symlink_latency": { 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "req_unlink_latency": { 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 58, 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.265980630, 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.004585872 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getvxattr_latency": { 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.126 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_sessions": { 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: "session_count": 2, 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: "session_add": 6, 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: "session_remove": 4, 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_open": 2, 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_stale": 0, 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: "total_load": 144, 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: "average_load": 72, 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: "avg_session_uptime": 922, 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: "mdthresh_evicted": 0 2024-09-12T02:30:57.127 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "mempool": { 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_items": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:30:57.128 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:30:57.129 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:30:57.129 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_items": 0, 2024-09-12T02:30:57.129 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:30:57.129 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_items": 0, 2024-09-12T02:30:57.129 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:30:57.129 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:30:57.129 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:30:57.129 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:30:57.129 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_items": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_items": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_bytes": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_items": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:30:57.130 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_bytes": 442968, 2024-09-12T02:30:57.131 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_items": 1094, 2024-09-12T02:30:57.131 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_bytes": 880, 2024-09-12T02:30:57.131 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_items": 10, 2024-09-12T02:30:57.131 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_bytes": 0, 2024-09-12T02:30:57.131 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_items": 0, 2024-09-12T02:30:57.131 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:30:57.131 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_items": 0, 2024-09-12T02:30:57.131 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:30:57.131 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_items": 0, 2024-09-12T02:30:57.131 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_bytes": 9616, 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_items": 195, 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_bytes": 0, 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_items": 0, 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_bytes": 3569225, 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_items": 42618, 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_bytes": 0, 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_items": 0, 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_bytes": 0, 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_items": 0 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.132 INFO:teuthology.orchestra.run.smithi115.stdout: "objecter": { 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "op_active": 0, 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "op_laggy": 0, 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send": 3218, 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send_bytes": 36332832, 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "op_resend": 34, 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "op_reply": 3218, 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "op_latency": { 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3218, 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 94.428139166, 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.029343734 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "op_inflight": 0, 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "oplen_avg": { 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3218, 2024-09-12T02:30:57.133 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 3473 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "op": 3218, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "op_r": 90, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "op_w": 3128, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "op_rmw": 0, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "op_pg": 0, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_stat": 0, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_create": 11, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_read": 89, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_write": 1737, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writefull": 143, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writesame": 0, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_append": 0, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_zero": 0, 2024-09-12T02:30:57.134 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_truncate": 3, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_delete": 1005, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_mapext": 0, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_sparse_read": 0, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_clonerange": 0, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_getxattr": 0, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_setxattr": 22, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_rmxattr": 0, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_call": 0, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_watch": 0, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_notify": 0, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:30:57.135 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_other": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_active": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_send": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_resend": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_ping": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_active": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_send": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_resend": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_active": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_send": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_resend": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_active": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_send": 0, 2024-09-12T02:30:57.136 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_resend": 0, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "command_active": 0, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "command_send": 0, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "command_resend": 0, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "map_epoch": 116, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "map_full": 0, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "map_inc": 30, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_sessions": 12, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_open": 12, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_close": 0, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_laggy": 0, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_wr": 378, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_rd": 2, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_del": 83 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.137 INFO:teuthology.orchestra.run.smithi115.stdout: "oft": { 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_objs": 1, 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_updates": 0, 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_removes": 0 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "osd-slow-ops": { 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_ops_count": 0 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "purge_queue": { 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops": 0, 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops_high_water": 18, 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing": 0, 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_high_water": 8, 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed_ops": 484, 2024-09-12T02:30:57.138 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed": 236, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_item_in_journal": 0 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 15986, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 7486096, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 15986, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 15986, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 7486096, 2024-09-12T02:30:57.139 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_bytes": { 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-12T02:30:57.140 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 3218, 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 36359396, 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 3218, 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 36359396, 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_ops": { 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 1024, 2024-09-12T02:30:57.141 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 3218, 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 3218, 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 3218, 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 3218, 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:30:57.142 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 236, 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 26580, 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 236, 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 89, 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 26580, 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-12T02:30:57.143 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle-0x556b87e34960": { 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 4899, 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 35737201, 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 4899, 2024-09-12T02:30:57.144 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-12T02:30:57.145 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-12T02:30:57.145 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 1648, 2024-09-12T02:30:57.145 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 35737201, 2024-09-12T02:30:57.145 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-12T02:30:57.145 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:57.145 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:57.145 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:57.145 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:30:57.145 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:30:57.145 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-12T02:30:57.687 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:57 smithi110 ceph-mon[30548]: pgmap v498: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 107 KiB/s wr, 16 op/s 2024-09-12T02:30:57.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:57 smithi115 ceph-mon[35351]: pgmap v498: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 107 KiB/s wr, 16 op/s 2024-09-12T02:30:57.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:57 smithi136 ceph-mon[35814]: pgmap v498: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 107 KiB/s wr, 16 op/s 2024-09-12T02:30:58.072 INFO:tasks.check_counter:Daemon mds.b mds.exported=25 2024-09-12T02:30:58.073 INFO:tasks.check_counter:Daemon mds.b mds.imported=8 2024-09-12T02:30:58.073 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-12T02:30:58.073 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=15 2024-09-12T02:30:58.073 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=9 2024-09-12T02:30:58.073 DEBUG:tasks.check_counter:Getting stats from e 2024-09-12T02:30:58.073 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-12T02:30:58.332 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:30:58.972 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-12T02:30:58.972 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:30:58.972 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 0, 2024-09-12T02:30:58.972 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 2, 2024-09-12T02:30:58.972 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:30:58.972 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 0, 2024-09-12T02:30:58.972 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 4, 2024-09-12T02:30:58.972 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 0, 2024-09-12T02:30:58.972 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.001088528, 2024-09-12T02:30:58.972 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.000217667, 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:30:58.973 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 3, 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 238, 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 480, 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 277856, 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 6, 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 3, 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.012361221, 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.008332737, 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.001853668, 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:58.974 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 235, 2024-09-12T02:30:58.975 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.030623375, 2024-09-12T02:30:58.975 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000130312 2024-09-12T02:30:58.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:58.975 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:58.975 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:58.975 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:58.975 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:58.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:58.975 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-12T02:30:58.975 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 277856 2024-09-12T02:30:58.975 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:58.975 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 325, 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 312, 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 1612144, 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 191728, 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 2, 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 1, 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.048457938, 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.017966047, 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.044770347, 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 312, 2024-09-12T02:30:58.976 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.019508138, 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000062526 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 1612144, 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 191728 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: "cct": { 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: "total_workers": 0, 2024-09-12T02:30:58.977 INFO:teuthology.orchestra.run.smithi115.stdout: "unhealthy_workers": 0 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "mempool": { 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_items": 0, 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:30:58.978 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_items": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_items": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_items": 0, 2024-09-12T02:30:58.979 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_items": 0, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_bytes": 0, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_items": 0, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_bytes": 147987, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_items": 30, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_items": 0, 2024-09-12T02:30:58.980 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_bytes": 0, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_items": 0, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_items": 0, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_items": 0, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_bytes": 0, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_items": 0, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_bytes": 0, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_items": 0, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_bytes": 928, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_items": 2, 2024-09-12T02:30:58.981 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_bytes": 0, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_items": 0, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_bytes": 0, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_items": 0 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 324, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 1563867, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 324, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 324, 2024-09-12T02:30:58.982 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 1563867, 2024-09-12T02:30:58.983 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-12T02:30:58.983 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:30:58.983 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:30:58.983 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:30:58.983 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:30:58.983 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:30:58.983 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-12T02:30:59.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:30:59 smithi110 ceph-mon[30548]: pgmap v499: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 51 KiB/s wr, 8 op/s 2024-09-12T02:30:59.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:30:59 smithi115 ceph-mon[35351]: pgmap v499: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 51 KiB/s wr, 8 op/s 2024-09-12T02:30:59.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:30:59 smithi136 ceph-mon[35814]: pgmap v499: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 51 KiB/s wr, 8 op/s 2024-09-12T02:30:59.972 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-09-12T02:30:59.972 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-09-12T02:30:59.972 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-12T02:30:59.972 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-12T02:30:59.972 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-12T02:30:59.972 DEBUG:tasks.check_counter:Getting stats from h 2024-09-12T02:30:59.973 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-12T02:31:00.230 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:31:00.664 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:00 smithi115 ceph-mon[35351]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:31:00.772 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-12T02:31:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:31:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 3297, 2024-09-12T02:31:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 3299, 2024-09-12T02:31:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 6554543, 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 1048453, 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 6, 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 2, 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.245747437, 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.066007973, 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.069367491, 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.093276010, 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3297, 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.129560694, 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000039296 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 374, 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 339, 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 1740492, 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 196314, 2024-09-12T02:31:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 3, 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 2, 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.051916236, 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.018226988, 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.049092584, 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000072874, 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 339, 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.024734993, 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000072964 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 1739936, 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 195616 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 4, 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 238, 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 748, 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 653278, 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 8, 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 4, 2024-09-12T02:31:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.012406040, 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.008087072, 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.002165415, 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000034032, 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 235, 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.025191362, 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000107197 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 652960 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: "cct": { 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: "total_workers": 1, 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: "unhealthy_workers": 0 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-MDSRank": { 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 5557, 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.129098934, 2024-09-12T02:31:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000023231 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: "finisher-PurgeQueue": { 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: "queue_len": 0, 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: "complete_latency": { 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: "mds": { 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: "request": 0, 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: "reply": 0, 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: "reply_latency": { 2024-09-12T02:31:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_reply": 0, 2024-09-12T02:31:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: "forward": 0, 2024-09-12T02:31:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_complete": 0, 2024-09-12T02:31:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_fetch_keys": 0, 2024-09-12T02:31:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_commit": 0, 2024-09-12T02:31:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_split": 0, 2024-09-12T02:31:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_merge": 0, 2024-09-12T02:31:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes": 1021, 2024-09-12T02:31:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_top": 7, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_bottom": 1014, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pin_tail": 0, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_pinned": 1011, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_expired": 0, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "inodes_with_caps": 0, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "caps": 0, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "subtrees": 14, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse": 0, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_hit": 0, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_forward": 0, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_discover": 0, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:31:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_remote_ino": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "traverse_lock": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "load_cent": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "q": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "exported": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "exported_inodes": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "imported": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "imported_inodes": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_dir_fetch": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "openino_peer_discover": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rfiles": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rbytes": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "root_rsnaps": 0, 2024-09-12T02:31:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_set_tag": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "scrub_file_inodes": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:31:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps": 0, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_cap_release": 0, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "process_request_cap_release": 0 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_cache": { 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update": 0, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_update_receipt": 0, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_try_discover": 0, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_send_discover": 0, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "dir_handle_discover": 0, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays": 0, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_delayed": 0, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:31:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_created": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_enqueued": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_reintegrated": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "strays_migrated": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_processing": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_started": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "recovery_completed": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_exportdir": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_flush": 0, 2024-09-12T02:31:00.785 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_fragstats": 0, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "ireq_inodestats": 0 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_log": { 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "evlrg": 0, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "evadd": 0, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "evex": 0, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "evtrm": 0, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "ev": 1950, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "evexg": 0, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "evexd": 0, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "segadd": 0, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "segex": 0, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "segtrm": 0, 2024-09-12T02:31:00.786 INFO:teuthology.orchestra.run.smithi115.stdout: "seg": 4, 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: "segmjr": 2, 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: "segexg": 0, 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: "segexd": 0, 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: "expos": 4194304, 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: "wrpos": 9804065, 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: "rdpos": 9804004, 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: "jlat": { 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: "replayed": 1950 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.787 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_mem": { 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "ino": 789, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "ino+": 2411, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "ino-": 1622, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "dir": 25, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "dir+": 82, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "dir-": 57, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "dn": 1021, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "dn+": 2653, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "dn-": 1632, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "cap": 0, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "cap+": 0, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "cap-": 0, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "rss": 58816, 2024-09-12T02:31:00.788 INFO:teuthology.orchestra.run.smithi115.stdout: "heap": 215328 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_server": { 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_client_request": 0, 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: "dispatch_server_request": 0, 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_request": 0, 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_client_session": 0, 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: "handle_peer_request": 0, 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: "req_create_latency": { 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getattr_latency": { 2024-09-12T02:31:00.789 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getfilelock_latency": { 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: "req_link_latency": { 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.790 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookup_latency": { 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookuphash_latency": { 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupino_latency": { 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.791 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupname_latency": { 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupparent_latency": { 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lookupsnap_latency": { 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.792 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: "req_lssnap_latency": { 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mkdir_latency": { 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mknod_latency": { 2024-09-12T02:31:00.793 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: "req_mksnap_latency": { 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: "req_open_latency": { 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.794 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: "req_readdir_latency": { 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rename_latency": { 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: "req_renamesnap_latency": { 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.795 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: "req_snapdiff_latency": { 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmdir_latency": { 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmsnap_latency": { 2024-09-12T02:31:00.796 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: "req_rmxattr_latency": { 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setattr_latency": { 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.797 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setdirlayout_latency": { 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setfilelock_latency": { 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setlayout_latency": { 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.798 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: "req_setxattr_latency": { 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: "req_symlink_latency": { 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: "req_unlink_latency": { 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.799 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: "req_getvxattr_latency": { 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_sessions": { 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: "session_count": 2, 2024-09-12T02:31:00.800 INFO:teuthology.orchestra.run.smithi115.stdout: "session_add": 4, 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: "session_remove": 2, 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_open": 3, 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: "sessions_stale": 0, 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: "total_load": 0, 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: "average_load": 0, 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: "avg_session_uptime": 3211, 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: "mdthresh_evicted": 0 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: "mempool": { 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_items": 0, 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:31:00.801 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:31:00.802 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:31:00.802 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:31:00.802 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:31:00.802 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:31:00.802 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:31:00.802 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:31:00.802 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:31:00.802 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:31:00.802 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:31:00.802 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:31:00.802 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:31:00.802 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_items": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_items": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_items": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:31:00.803 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_items": 0, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_bytes": 0, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_items": 0, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_bytes": 213842, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_items": 907, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_items": 0, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_bytes": 0, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_items": 0, 2024-09-12T02:31:00.804 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_items": 0, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_items": 0, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_bytes": 9616, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_items": 195, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_bytes": 0, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_items": 0, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_bytes": 2733448, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_items": 62042, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_bytes": 0, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_items": 0, 2024-09-12T02:31:00.805 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_bytes": 0, 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_items": 0 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "objecter": { 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "op_active": 0, 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "op_laggy": 0, 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send": 3300, 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "op_send_bytes": 21, 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "op_resend": 3, 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "op_reply": 3300, 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "op_latency": { 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3300, 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 34.555324936, 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.010471310 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.806 INFO:teuthology.orchestra.run.smithi115.stdout: "op_inflight": 0, 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "oplen_avg": { 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3300, 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 3301 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "op": 3300, 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "op_r": 3300, 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "op_w": 0, 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "op_rmw": 0, 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "op_pg": 0, 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_stat": 2011, 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_create": 0, 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_read": 1287, 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_write": 0, 2024-09-12T02:31:00.807 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writefull": 0, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_writesame": 0, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_append": 0, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_zero": 0, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_truncate": 0, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_delete": 0, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_mapext": 0, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_sparse_read": 0, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_clonerange": 0, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_getxattr": 1, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_setxattr": 0, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_rmxattr": 0, 2024-09-12T02:31:00.808 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_call": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_watch": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_notify": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "osdop_other": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_active": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_send": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_resend": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "linger_ping": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_active": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_send": 0, 2024-09-12T02:31:00.809 INFO:teuthology.orchestra.run.smithi115.stdout: "poolop_resend": 0, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_active": 0, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_send": 0, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "poolstat_resend": 0, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_active": 0, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_send": 0, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "statfs_resend": 0, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "command_active": 0, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "command_send": 0, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "command_resend": 0, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "map_epoch": 116, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "map_full": 0, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "map_inc": 21, 2024-09-12T02:31:00.810 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_sessions": 4, 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_open": 5, 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_session_close": 1, 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_laggy": 0, 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_wr": 0, 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_rd": 2, 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_del": 0 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: "oft": { 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_objs": 0, 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_updates": 0, 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: "omap_total_removes": 0 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.811 INFO:teuthology.orchestra.run.smithi115.stdout: "osd-slow-ops": { 2024-09-12T02:31:00.812 INFO:teuthology.orchestra.run.smithi115.stdout: "slow_ops_count": 0 2024-09-12T02:31:00.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.812 INFO:teuthology.orchestra.run.smithi115.stdout: "purge_queue": { 2024-09-12T02:31:00.812 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops": 0, 2024-09-12T02:31:00.812 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:31:00.812 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing": 0, 2024-09-12T02:31:00.812 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executing_high_water": 0, 2024-09-12T02:31:00.812 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed_ops": 0, 2024-09-12T02:31:00.812 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_executed": 0, 2024-09-12T02:31:00.812 INFO:teuthology.orchestra.run.smithi115.stdout: "pq_item_in_journal": 0 2024-09-12T02:31:00.812 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.812 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 3671, 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 7943595, 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 3671, 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 3671, 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 7943595, 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.813 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.814 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.814 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:31:00.814 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.814 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_bytes": { 2024-09-12T02:31:00.814 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-12T02:31:00.814 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-12T02:31:00.814 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-12T02:31:00.814 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-12T02:31:00.814 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-12T02:31:00.814 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:00.815 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:00.815 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 3300, 2024-09-12T02:31:00.815 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 5630581, 2024-09-12T02:31:00.815 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 3300, 2024-09-12T02:31:00.815 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 5630581, 2024-09-12T02:31:00.815 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-12T02:31:00.816 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.816 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.816 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.816 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:31:00.816 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.816 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-objecter_ops": { 2024-09-12T02:31:00.816 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-12T02:31:00.816 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 1024, 2024-09-12T02:31:00.816 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-12T02:31:00.816 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-12T02:31:00.816 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-12T02:31:00.816 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 3300, 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 3300, 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 3300, 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 3300, 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:31:00.817 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 0, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 0, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.818 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-write_buf_throttle-0x55b12b168b40": { 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 3758096384, 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 0, 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 0, 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 0, 2024-09-12T02:31:00.819 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 0, 2024-09-12T02:31:00.820 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-12T02:31:00.820 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:00.820 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:00.820 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:00.820 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:31:00.820 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:31:00.820 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-12T02:31:00.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:00 smithi136 ceph-mon[35814]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:31:00.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:00 smithi110 ceph-mon[30548]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-12T02:31:01.542 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-12T02:31:01.543 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-12T02:31:01.543 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-12T02:31:01.543 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:31:01.543 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:31:01.543 DEBUG:tasks.check_counter:Getting stats from k 2024-09-12T02:31:01.543 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-12T02:31:01.792 INFO:teuthology.orchestra.run.smithi115.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.b/config 2024-09-12T02:31:01.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:01 smithi115 ceph-mon[35351]: pgmap v500: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 59 KiB/s wr, 10 op/s 2024-09-12T02:31:01.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:01 smithi136 ceph-mon[35814]: pgmap v500: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 59 KiB/s wr, 10 op/s 2024-09-12T02:31:01.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:01 smithi110 ceph-mon[30548]: pgmap v500: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 59 KiB/s wr, 10 op/s 2024-09-12T02:31:02.306 INFO:teuthology.orchestra.run.smithi115.stdout:{ 2024-09-12T02:31:02.307 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:31:02.307 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 4, 2024-09-12T02:31:02.307 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 4, 2024-09-12T02:31:02.307 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 2992, 2024-09-12T02:31:02.307 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 448, 2024-09-12T02:31:02.307 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 4, 2024-09-12T02:31:02.307 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 0, 2024-09-12T02:31:02.307 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.002891487, 2024-09-12T02:31:02.307 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.000035923, 2024-09-12T02:31:02.307 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.002126259, 2024-09-12T02:31:02.308 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:31:02.308 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:02.308 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 3, 2024-09-12T02:31:02.308 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.003891296, 2024-09-12T02:31:02.308 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.001297098 2024-09-12T02:31:02.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:02.308 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:02.308 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:02.308 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:02.308 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:02.308 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:02.308 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 448 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 325, 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 314, 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 1610240, 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 193840, 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 2, 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 1, 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.049962394, 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.018428771, 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.045913214, 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:31:02.309 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 313, 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.024384526, 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000077905 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 1610240, 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 193840 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:31:02.310 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_messages": 3, 2024-09-12T02:31:02.311 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages": 240, 2024-09-12T02:31:02.311 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_bytes": 480, 2024-09-12T02:31:02.311 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_bytes": 278208, 2024-09-12T02:31:02.311 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_created_connections": 6, 2024-09-12T02:31:02.311 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_active_connections": 3, 2024-09-12T02:31:02.311 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_total_time": 0.013047592, 2024-09-12T02:31:02.311 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_send_time": 0.008991627, 2024-09-12T02:31:02.311 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_recv_time": 0.001845873, 2024-09-12T02:31:02.311 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:31:02.311 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:02.311 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 237, 2024-09-12T02:31:02.311 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.024051888, 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000101484 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: "msgr_send_encrypted_bytes": 278208 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: "cct": { 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: "total_workers": 0, 2024-09-12T02:31:02.312 INFO:teuthology.orchestra.run.smithi115.stdout: "unhealthy_workers": 0 2024-09-12T02:31:02.313 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:02.313 INFO:teuthology.orchestra.run.smithi115.stdout: "mempool": { 2024-09-12T02:31:02.313 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:31:02.313 INFO:teuthology.orchestra.run.smithi115.stdout: "bloom_filter_items": 0, 2024-09-12T02:31:02.313 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:31:02.313 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:31:02.313 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:31:02.313 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:31:02.313 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:31:02.313 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:31:02.313 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:31:02.313 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_extent_items": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_blob_items": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:31:02.314 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_txc_items": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluestore_writing_items": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_bytes": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_items": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:31:02.315 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_bytes": 147948, 2024-09-12T02:31:02.316 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_anon_items": 29, 2024-09-12T02:31:02.316 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:31:02.316 INFO:teuthology.orchestra.run.smithi115.stdout: "buffer_meta_items": 0, 2024-09-12T02:31:02.316 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_bytes": 0, 2024-09-12T02:31:02.316 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_items": 0, 2024-09-12T02:31:02.316 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:31:02.316 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_mapbl_items": 0, 2024-09-12T02:31:02.316 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:31:02.316 INFO:teuthology.orchestra.run.smithi115.stdout: "osd_pglog_items": 0, 2024-09-12T02:31:02.316 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_bytes": 0, 2024-09-12T02:31:02.316 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_items": 0, 2024-09-12T02:31:02.316 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_bytes": 0, 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "pgmap_items": 0, 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_bytes": 928, 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "mds_co_items": 2, 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_bytes": 0, 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_1_items": 0, 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_bytes": 0, 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "unittest_2_items": 0 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: }, 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "val": 0, 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "max": 104857600, 2024-09-12T02:31:02.317 INFO:teuthology.orchestra.run.smithi115.stdout: "get_started": 0, 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: "get": 328, 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: "get_sum": 1564387, 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: "get_or_fail_success": 328, 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: "take": 0, 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: "take_sum": 0, 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: "put": 328, 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: "put_sum": 1564387, 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: "wait": { 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: "avgcount": 0, 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: "sum": 0.000000000, 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: "avgtime": 0.000000000 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:31:02.318 INFO:teuthology.orchestra.run.smithi115.stdout: } 2024-09-12T02:31:02.319 INFO:teuthology.orchestra.run.smithi115.stdout:} 2024-09-12T02:31:03.032 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-12T02:31:03.032 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-12T02:31:03.032 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-12T02:31:03.032 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-12T02:31:03.032 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-12T02:31:03.032 DEBUG:tasks.check_counter:Getting stats from c 2024-09-12T02:31:03.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-12T02:31:03.361 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:31:03.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:03 smithi115 ceph-mon[35351]: pgmap v501: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-09-12T02:31:03.822 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:03 smithi136 ceph-mon[35814]: pgmap v501: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-09-12T02:31:03.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:03 smithi110 ceph-mon[30548]: pgmap v501: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-09-12T02:31:04.382 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-09-12T02:31:04.382 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:31:04.382 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 1056, 2024-09-12T02:31:04.382 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 1023, 2024-09-12T02:31:04.382 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 10299819, 2024-09-12T02:31:04.383 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 414117, 2024-09-12T02:31:04.383 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 6, 2024-09-12T02:31:04.383 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 2, 2024-09-12T02:31:04.383 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.116892788, 2024-09-12T02:31:04.383 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.035614992, 2024-09-12T02:31:04.383 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.071208213, 2024-09-12T02:31:04.383 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.020370859, 2024-09-12T02:31:04.383 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:04.383 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1022, 2024-09-12T02:31:04.383 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.050142324, 2024-09-12T02:31:04.383 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000049062 2024-09-12T02:31:04.384 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.384 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:04.384 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.384 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.384 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.384 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.384 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 1737376, 2024-09-12T02:31:04.384 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 195968 2024-09-12T02:31:04.384 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.384 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:31:04.384 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 2087, 2024-09-12T02:31:04.384 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 2320, 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 15587310, 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 1227115, 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 8, 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 6, 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.203249322, 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.061353795, 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.061366176, 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.062941006, 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2318, 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.134851209, 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000058175 2024-09-12T02:31:04.385 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.386 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:04.386 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.386 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.386 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.386 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.386 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-12T02:31:04.386 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 565296 2024-09-12T02:31:04.386 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.386 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:31:04.386 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 806, 2024-09-12T02:31:04.386 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 808, 2024-09-12T02:31:04.386 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 12854976, 2024-09-12T02:31:04.387 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 256323, 2024-09-12T02:31:04.387 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 5, 2024-09-12T02:31:04.387 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 4, 2024-09-12T02:31:04.387 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.078421007, 2024-09-12T02:31:04.387 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.017819917, 2024-09-12T02:31:04.387 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.027965302, 2024-09-12T02:31:04.387 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.026539079, 2024-09-12T02:31:04.387 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:04.387 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 806, 2024-09-12T02:31:04.387 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.047210373, 2024-09-12T02:31:04.387 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000058573 2024-09-12T02:31:04.387 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.388 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:04.388 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.388 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.388 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.388 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:31:04.388 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:31:04.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.388 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-09-12T02:31:04.388 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-09-12T02:31:04.388 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-09-12T02:31:04.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.389 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-09-12T02:31:04.389 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-12T02:31:04.389 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-12T02:31:04.389 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 6033, 2024-09-12T02:31:04.389 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.157383945, 2024-09-12T02:31:04.389 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000026087 2024-09-12T02:31:04.389 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:04.389 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.389 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-09-12T02:31:04.389 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-12T02:31:04.389 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-12T02:31:04.389 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 0, 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 0, 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.390 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 0, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 0, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 0, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 0, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 1123, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 44, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 1079, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 0, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 1059, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 0, 2024-09-12T02:31:04.391 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 0, 2024-09-12T02:31:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 0, 2024-09-12T02:31:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 47, 2024-09-12T02:31:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 0, 2024-09-12T02:31:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 0, 2024-09-12T02:31:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 0, 2024-09-12T02:31:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 0, 2024-09-12T02:31:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:31:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 0, 2024-09-12T02:31:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 0, 2024-09-12T02:31:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 0, 2024-09-12T02:31:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 0, 2024-09-12T02:31:04.392 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 0, 2024-09-12T02:31:04.393 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 0, 2024-09-12T02:31:04.393 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 0, 2024-09-12T02:31:04.393 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 0, 2024-09-12T02:31:04.393 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-09-12T02:31:04.393 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:31:04.393 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 0, 2024-09-12T02:31:04.393 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 1001, 2024-09-12T02:31:04.393 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 1248894468, 2024-09-12T02:31:04.393 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 6, 2024-09-12T02:31:04.393 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:31:04.393 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-09-12T02:31:04.393 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:31:04.394 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:31:04.394 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:31:04.394 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:31:04.394 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:31:04.394 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 0, 2024-09-12T02:31:04.394 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:31:04.394 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:31:04.394 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:31:04.394 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:31:04.394 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:31:04.394 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:31:04.394 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 0, 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 0, 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 0 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 0, 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 0, 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 0, 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 0, 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 0, 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 0, 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:31:04.395 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 0, 2024-09-12T02:31:04.396 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 0, 2024-09-12T02:31:04.396 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 0, 2024-09-12T02:31:04.396 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 0, 2024-09-12T02:31:04.396 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-09-12T02:31:04.396 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:31:04.396 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:31:04.396 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-09-12T02:31:04.396 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-09-12T02:31:04.396 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:31:04.396 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:31:04.396 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:31:04.396 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 0, 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: "evlrg": 0, 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 0, 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 4917, 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-09-12T02:31:04.397 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 0, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 12, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "segmjr": 2, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 4194304, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 40134554, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 40134494, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.398 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 4917 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 833, 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 3450, 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 2617, 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 101, 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 158, 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 57, 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 1127, 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 3566, 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 2439, 2024-09-12T02:31:04.399 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 0, 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 0, 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 0, 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 57472, 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 215328 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 0, 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 0, 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 0, 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 0, 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 0, 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.400 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.401 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.402 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.403 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.404 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-09-12T02:31:04.404 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.404 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.404 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.404 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-09-12T02:31:04.404 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.404 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.404 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.405 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-09-12T02:31:04.405 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.410 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.410 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.410 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.410 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-09-12T02:31:04.410 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.410 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.411 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.412 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-09-12T02:31:04.413 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.414 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.415 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-09-12T02:31:04.415 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.415 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.415 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.415 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.415 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-09-12T02:31:04.415 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.415 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.415 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.415 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.415 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-09-12T02:31:04.415 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.416 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.416 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.416 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-09-12T02:31:04.416 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.416 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.416 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.417 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-09-12T02:31:04.418 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.418 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.418 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.418 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-09-12T02:31:04.418 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.418 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.418 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.418 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:31:04.418 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:31:04.418 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 2, 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 6, 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 4, 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 4, 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 0, 2024-09-12T02:31:04.419 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 0, 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 3991, 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:31:04.420 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:31:04.421 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:31:04.422 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 252078, 2024-09-12T02:31:04.423 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 1045, 2024-09-12T02:31:04.423 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:31:04.423 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-09-12T02:31:04.423 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-09-12T02:31:04.423 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-09-12T02:31:04.423 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:31:04.423 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-09-12T02:31:04.423 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:31:04.423 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-09-12T02:31:04.423 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 9616, 2024-09-12T02:31:04.423 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 195, 2024-09-12T02:31:04.423 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 3115665, 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 28532, 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-09-12T02:31:04.424 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 3573, 2024-09-12T02:31:04.425 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 26, 2024-09-12T02:31:04.425 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 4, 2024-09-12T02:31:04.425 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 3573, 2024-09-12T02:31:04.425 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-09-12T02:31:04.425 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3573, 2024-09-12T02:31:04.425 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 33.554236588, 2024-09-12T02:31:04.425 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.009391054 2024-09-12T02:31:04.425 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.425 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-09-12T02:31:04.425 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-09-12T02:31:04.425 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3573, 2024-09-12T02:31:04.426 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 3574 2024-09-12T02:31:04.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.426 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 3573, 2024-09-12T02:31:04.426 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 3573, 2024-09-12T02:31:04.426 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 0, 2024-09-12T02:31:04.426 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-09-12T02:31:04.426 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-09-12T02:31:04.427 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 2100, 2024-09-12T02:31:04.427 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 0, 2024-09-12T02:31:04.427 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 1470, 2024-09-12T02:31:04.427 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 0, 2024-09-12T02:31:04.427 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 0, 2024-09-12T02:31:04.427 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-09-12T02:31:04.428 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-09-12T02:31:04.428 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-09-12T02:31:04.428 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 0, 2024-09-12T02:31:04.428 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 0, 2024-09-12T02:31:04.428 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-09-12T02:31:04.429 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-09-12T02:31:04.429 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-09-12T02:31:04.429 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 2, 2024-09-12T02:31:04.429 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 0, 2024-09-12T02:31:04.429 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:31:04.429 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-09-12T02:31:04.429 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:31:04.430 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-09-12T02:31:04.430 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-09-12T02:31:04.430 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-09-12T02:31:04.430 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:31:04.430 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-09-12T02:31:04.430 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:31:04.430 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-09-12T02:31:04.431 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-09-12T02:31:04.431 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-09-12T02:31:04.431 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-09-12T02:31:04.431 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-09-12T02:31:04.431 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-09-12T02:31:04.431 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-09-12T02:31:04.431 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-09-12T02:31:04.431 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-09-12T02:31:04.432 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-09-12T02:31:04.432 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-09-12T02:31:04.432 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-09-12T02:31:04.432 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-09-12T02:31:04.432 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-09-12T02:31:04.432 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-09-12T02:31:04.433 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-09-12T02:31:04.433 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-09-12T02:31:04.433 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 116, 2024-09-12T02:31:04.433 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-09-12T02:31:04.433 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 21, 2024-09-12T02:31:04.433 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 8, 2024-09-12T02:31:04.433 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 8, 2024-09-12T02:31:04.433 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 0, 2024-09-12T02:31:04.433 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-09-12T02:31:04.434 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 0, 2024-09-12T02:31:04.434 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 2, 2024-09-12T02:31:04.434 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 0 2024-09-12T02:31:04.434 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.434 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-09-12T02:31:04.434 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 0, 2024-09-12T02:31:04.434 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:31:04.434 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-09-12T02:31:04.434 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-09-12T02:31:04.434 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.434 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-09-12T02:31:04.434 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 0 2024-09-12T02:31:04.435 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.435 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-09-12T02:31:04.435 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-09-12T02:31:04.435 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:31:04.435 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-09-12T02:31:04.435 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 0, 2024-09-12T02:31:04.435 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed_ops": 0, 2024-09-12T02:31:04.435 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 0, 2024-09-12T02:31:04.435 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-09-12T02:31:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:31:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-12T02:31:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 3945, 2024-09-12T02:31:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 38365202, 2024-09-12T02:31:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 3945, 2024-09-12T02:31:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-12T02:31:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-12T02:31:04.436 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 3945, 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 38365202, 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-12T02:31:04.437 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 3573, 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 36008701, 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 3573, 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 36008701, 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-09-12T02:31:04.438 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:04.439 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-09-12T02:31:04.439 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:04.439 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-12T02:31:04.439 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-12T02:31:04.439 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:04.439 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:04.439 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 3573, 2024-09-12T02:31:04.439 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 3573, 2024-09-12T02:31:04.439 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 3573, 2024-09-12T02:31:04.439 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 3573, 2024-09-12T02:31:04.439 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:04.439 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:04.440 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x56351e9c6b40": { 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-12T02:31:04.441 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:04.442 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:04.443 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-09-12T02:31:05.320 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-12T02:31:05.320 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-12T02:31:05.320 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-12T02:31:05.320 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:31:05.320 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:31:05.320 DEBUG:tasks.check_counter:Getting stats from f 2024-09-12T02:31:05.320 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-12T02:31:05.573 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:31:05.721 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:05 smithi136 ceph-mon[35814]: pgmap v502: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 82 KiB/s wr, 25 op/s 2024-09-12T02:31:05.721 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:05 smithi136 ceph-mon[35814]: osdmap e117: 12 total, 12 up, 12 in 2024-09-12T02:31:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:05 smithi115 ceph-mon[35351]: pgmap v502: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 82 KiB/s wr, 25 op/s 2024-09-12T02:31:05.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:05 smithi115 ceph-mon[35351]: osdmap e117: 12 total, 12 up, 12 in 2024-09-12T02:31:05.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:05 smithi110 ceph-mon[30548]: pgmap v502: 129 pgs: 129 active+clean; 3.2 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 82 KiB/s wr, 25 op/s 2024-09-12T02:31:05.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:05 smithi110 ceph-mon[30548]: osdmap e117: 12 total, 12 up, 12 in 2024-09-12T02:31:06.099 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-09-12T02:31:06.099 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:31:06.099 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 376, 2024-09-12T02:31:06.099 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 341, 2024-09-12T02:31:06.099 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 1742038, 2024-09-12T02:31:06.100 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 197395, 2024-09-12T02:31:06.100 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 6, 2024-09-12T02:31:06.100 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 1, 2024-09-12T02:31:06.100 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.055648165, 2024-09-12T02:31:06.100 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.019952802, 2024-09-12T02:31:06.100 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.051334075, 2024-09-12T02:31:06.100 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.000032474, 2024-09-12T02:31:06.100 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:06.100 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 341, 2024-09-12T02:31:06.100 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.029246160, 2024-09-12T02:31:06.100 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000085765 2024-09-12T02:31:06.100 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.101 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:06.101 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.101 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.101 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.101 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.101 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 1741792, 2024-09-12T02:31:06.101 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 197072 2024-09-12T02:31:06.101 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.101 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:31:06.101 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 5, 2024-09-12T02:31:06.101 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 241, 2024-09-12T02:31:06.101 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 1582, 2024-09-12T02:31:06.102 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 655570, 2024-09-12T02:31:06.102 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 10, 2024-09-12T02:31:06.102 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 5, 2024-09-12T02:31:06.102 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.014294645, 2024-09-12T02:31:06.102 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.008983413, 2024-09-12T02:31:06.102 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.002993029, 2024-09-12T02:31:06.102 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.000048203, 2024-09-12T02:31:06.102 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:06.102 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 238, 2024-09-12T02:31:06.102 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.023598173, 2024-09-12T02:31:06.103 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000099151 2024-09-12T02:31:06.103 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.103 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:06.103 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.103 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.103 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.103 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.103 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-12T02:31:06.103 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 654928 2024-09-12T02:31:06.103 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.103 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:31:06.103 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 3305, 2024-09-12T02:31:06.104 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 3307, 2024-09-12T02:31:06.104 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 4095549, 2024-09-12T02:31:06.104 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 1051048, 2024-09-12T02:31:06.104 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 5, 2024-09-12T02:31:06.104 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 4, 2024-09-12T02:31:06.104 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.294359866, 2024-09-12T02:31:06.104 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.067472182, 2024-09-12T02:31:06.104 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.081644773, 2024-09-12T02:31:06.104 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.125663281, 2024-09-12T02:31:06.104 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:06.104 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3305, 2024-09-12T02:31:06.104 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.176323154, 2024-09-12T02:31:06.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000053350 2024-09-12T02:31:06.105 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.105 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:06.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.105 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.105 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.105 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:31:06.105 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:31:06.105 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.105 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-09-12T02:31:06.105 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-09-12T02:31:06.106 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-09-12T02:31:06.106 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.106 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-09-12T02:31:06.106 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-12T02:31:06.106 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-12T02:31:06.106 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 5640, 2024-09-12T02:31:06.106 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.145218238, 2024-09-12T02:31:06.106 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000025747 2024-09-12T02:31:06.106 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:06.106 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.106 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-09-12T02:31:06.106 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-12T02:31:06.107 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-12T02:31:06.107 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.107 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.107 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.107 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:06.107 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.107 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-09-12T02:31:06.107 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 0, 2024-09-12T02:31:06.107 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 0, 2024-09-12T02:31:06.107 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-09-12T02:31:06.108 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.108 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.108 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.108 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.108 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-09-12T02:31:06.108 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 0, 2024-09-12T02:31:06.108 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 0, 2024-09-12T02:31:06.108 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-09-12T02:31:06.108 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 0, 2024-09-12T02:31:06.108 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 0, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 993, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 16, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 977, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 0, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 970, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 0, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 0, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 0, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 35, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 0, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 0, 2024-09-12T02:31:06.109 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 0, 2024-09-12T02:31:06.110 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 0, 2024-09-12T02:31:06.110 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:31:06.110 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 0, 2024-09-12T02:31:06.110 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 0, 2024-09-12T02:31:06.110 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 0, 2024-09-12T02:31:06.110 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 0, 2024-09-12T02:31:06.110 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 0, 2024-09-12T02:31:06.110 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 0, 2024-09-12T02:31:06.110 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 0, 2024-09-12T02:31:06.110 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 0, 2024-09-12T02:31:06.110 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-09-12T02:31:06.110 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 0, 2024-09-12T02:31:06.111 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 0, 2024-09-12T02:31:06.112 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 0, 2024-09-12T02:31:06.112 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:31:06.112 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:31:06.112 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:31:06.112 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 0, 2024-09-12T02:31:06.112 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 0, 2024-09-12T02:31:06.112 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 0, 2024-09-12T02:31:06.112 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 0 2024-09-12T02:31:06.112 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.112 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 0, 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 0, 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 0, 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 0, 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 0, 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 0, 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 0, 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 0, 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 0, 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 0, 2024-09-12T02:31:06.113 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-09-12T02:31:06.114 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:31:06.114 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:31:06.114 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-09-12T02:31:06.114 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-09-12T02:31:06.114 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:31:06.114 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:31:06.114 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:31:06.114 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 0, 2024-09-12T02:31:06.114 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-09-12T02:31:06.114 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 0, 2024-09-12T02:31:06.114 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-09-12T02:31:06.114 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-09-12T02:31:06.115 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.115 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-09-12T02:31:06.115 INFO:teuthology.orchestra.run.smithi136.stdout: "evlrg": 0, 2024-09-12T02:31:06.115 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 0, 2024-09-12T02:31:06.115 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-09-12T02:31:06.115 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-09-12T02:31:06.115 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 2314, 2024-09-12T02:31:06.115 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-09-12T02:31:06.115 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-09-12T02:31:06.116 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 0, 2024-09-12T02:31:06.116 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-09-12T02:31:06.116 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-09-12T02:31:06.116 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 4, 2024-09-12T02:31:06.116 INFO:teuthology.orchestra.run.smithi136.stdout: "segmjr": 2, 2024-09-12T02:31:06.116 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-09-12T02:31:06.116 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-09-12T02:31:06.116 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 4194304, 2024-09-12T02:31:06.116 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 7363516, 2024-09-12T02:31:06.116 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 7362942, 2024-09-12T02:31:06.116 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-09-12T02:31:06.116 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.117 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.117 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.117 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.117 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 2314 2024-09-12T02:31:06.117 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.117 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-09-12T02:31:06.117 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 879, 2024-09-12T02:31:06.117 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 940, 2024-09-12T02:31:06.118 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 61, 2024-09-12T02:31:06.118 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 45, 2024-09-12T02:31:06.118 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 49, 2024-09-12T02:31:06.118 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 4, 2024-09-12T02:31:06.118 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 993, 2024-09-12T02:31:06.118 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 1052, 2024-09-12T02:31:06.119 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 59, 2024-09-12T02:31:06.119 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 0, 2024-09-12T02:31:06.119 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 0, 2024-09-12T02:31:06.119 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 0, 2024-09-12T02:31:06.119 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 53520, 2024-09-12T02:31:06.119 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 215328 2024-09-12T02:31:06.120 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.120 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-09-12T02:31:06.120 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 0, 2024-09-12T02:31:06.120 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 0, 2024-09-12T02:31:06.120 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 0, 2024-09-12T02:31:06.120 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 0, 2024-09-12T02:31:06.121 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 0, 2024-09-12T02:31:06.121 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-09-12T02:31:06.121 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.121 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.121 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.121 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.122 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-09-12T02:31:06.122 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.122 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.122 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.122 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.123 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-09-12T02:31:06.123 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.123 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.123 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.123 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.123 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-09-12T02:31:06.124 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.124 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.124 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.124 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.124 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-09-12T02:31:06.125 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.125 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.125 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.125 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.125 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-09-12T02:31:06.125 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.126 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.126 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.126 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.126 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-09-12T02:31:06.126 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.126 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.127 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.127 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.127 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-09-12T02:31:06.127 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.127 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.128 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.128 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.128 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-09-12T02:31:06.128 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.128 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.128 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.129 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.129 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-09-12T02:31:06.129 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.129 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.129 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.130 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.130 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-09-12T02:31:06.130 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.130 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.130 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.130 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.131 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-09-12T02:31:06.131 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.131 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.131 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.131 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.132 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-09-12T02:31:06.132 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.132 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.132 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.132 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.132 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-09-12T02:31:06.133 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.133 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.133 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.133 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.133 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-09-12T02:31:06.134 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.134 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.134 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.134 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.134 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-09-12T02:31:06.135 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.135 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.135 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.135 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.135 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-09-12T02:31:06.135 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.136 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.136 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.136 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.136 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-09-12T02:31:06.136 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.137 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.137 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.137 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.137 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-09-12T02:31:06.137 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.137 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.138 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.138 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.138 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-09-12T02:31:06.138 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.138 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.139 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.139 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.139 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-09-12T02:31:06.139 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.139 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.139 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.140 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.140 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-09-12T02:31:06.140 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.140 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.140 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.140 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.141 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-09-12T02:31:06.141 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.141 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.141 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.141 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.142 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-09-12T02:31:06.142 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.142 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.142 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.142 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.142 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-09-12T02:31:06.143 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.143 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.143 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.143 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.143 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-09-12T02:31:06.143 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.143 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.144 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.144 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.144 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-09-12T02:31:06.144 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.144 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.145 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.145 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.145 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-09-12T02:31:06.145 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.145 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.145 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.145 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.146 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-09-12T02:31:06.146 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.146 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.146 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.146 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.146 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:31:06.146 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:31:06.146 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-09-12T02:31:06.146 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.146 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.146 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.146 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:06.147 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.147 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-09-12T02:31:06.147 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 2, 2024-09-12T02:31:06.147 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 2, 2024-09-12T02:31:06.147 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 0, 2024-09-12T02:31:06.147 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 2, 2024-09-12T02:31:06.147 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-09-12T02:31:06.147 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 0, 2024-09-12T02:31:06.147 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 0, 2024-09-12T02:31:06.147 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 2477, 2024-09-12T02:31:06.148 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-09-12T02:31:06.148 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.148 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-09-12T02:31:06.148 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:31:06.148 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-09-12T02:31:06.148 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:31:06.148 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:31:06.148 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:31:06.148 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:31:06.148 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:31:06.148 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:31:06.148 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:31:06.149 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:31:06.150 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:31:06.150 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:31:06.150 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:31:06.150 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-09-12T02:31:06.150 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:31:06.150 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:31:06.150 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:31:06.150 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-09-12T02:31:06.150 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-09-12T02:31:06.150 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-09-12T02:31:06.150 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:31:06.150 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 232365, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 959, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 9616, 2024-09-12T02:31:06.151 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 195, 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 2872854, 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 35258, 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-09-12T02:31:06.152 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-09-12T02:31:06.153 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-09-12T02:31:06.153 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 3308, 2024-09-12T02:31:06.153 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 21, 2024-09-12T02:31:06.153 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 3, 2024-09-12T02:31:06.153 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 3308, 2024-09-12T02:31:06.153 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-09-12T02:31:06.153 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3308, 2024-09-12T02:31:06.153 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 16.301636792, 2024-09-12T02:31:06.153 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.004927943 2024-09-12T02:31:06.153 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.153 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-09-12T02:31:06.153 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-09-12T02:31:06.154 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3308, 2024-09-12T02:31:06.154 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 3309 2024-09-12T02:31:06.154 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.154 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 3308, 2024-09-12T02:31:06.154 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 3308, 2024-09-12T02:31:06.154 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 0, 2024-09-12T02:31:06.154 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-09-12T02:31:06.154 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-09-12T02:31:06.154 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 2013, 2024-09-12T02:31:06.154 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 0, 2024-09-12T02:31:06.154 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 1293, 2024-09-12T02:31:06.154 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 1, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:31:06.155 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-09-12T02:31:06.156 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 117, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 22, 2024-09-12T02:31:06.157 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 6, 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 9, 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 3, 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 0, 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 2, 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 0 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 0, 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-09-12T02:31:06.158 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 0 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 0, 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 0, 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed_ops": 0, 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 0, 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-12T02:31:06.159 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 3682, 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 5485837, 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 3682, 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 3682, 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 5485837, 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.160 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:06.161 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.161 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-09-12T02:31:06.161 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:06.161 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-12T02:31:06.161 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:06.161 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-12T02:31:06.161 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-12T02:31:06.161 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:06.161 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:06.161 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 3308, 2024-09-12T02:31:06.162 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 3169217, 2024-09-12T02:31:06.162 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 3308, 2024-09-12T02:31:06.162 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 3169217, 2024-09-12T02:31:06.162 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:06.162 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.162 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.162 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.162 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 3308, 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 3308, 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 3308, 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 3308, 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:06.163 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:06.164 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-12T02:31:06.165 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-12T02:31:06.165 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-09-12T02:31:06.165 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-09-12T02:31:06.165 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:06.165 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.165 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.165 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.165 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:06.165 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:06.165 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x559530c82b40": { 2024-09-12T02:31:06.166 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:06.166 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-12T02:31:06.166 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:06.166 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-12T02:31:06.166 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-12T02:31:06.166 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:06.166 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:06.166 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-12T02:31:06.166 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-12T02:31:06.166 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-09-12T02:31:06.166 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-09-12T02:31:06.166 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:06.167 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:06.167 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:06.167 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:06.167 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:06.167 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:06.167 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-09-12T02:31:06.942 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-12T02:31:06.942 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-12T02:31:06.942 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-12T02:31:06.942 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:31:06.942 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:31:06.942 DEBUG:tasks.check_counter:Getting stats from i 2024-09-12T02:31:06.942 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-12T02:31:07.189 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:31:07.595 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:07 smithi136 ceph-mon[35814]: pgmap v504: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 74 KiB/s wr, 27 op/s 2024-09-12T02:31:07.697 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-09-12T02:31:07.698 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:31:07.698 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 2814, 2024-09-12T02:31:07.698 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 2710, 2024-09-12T02:31:07.698 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 1117879, 2024-09-12T02:31:07.698 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 3820388, 2024-09-12T02:31:07.698 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 15, 2024-09-12T02:31:07.698 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 8, 2024-09-12T02:31:07.698 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.165101925, 2024-09-12T02:31:07.698 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.057705532, 2024-09-12T02:31:07.698 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.101243599, 2024-09-12T02:31:07.698 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.020611514, 2024-09-12T02:31:07.699 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:07.699 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2706, 2024-09-12T02:31:07.699 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.130397152, 2024-09-12T02:31:07.699 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000048188 2024-09-12T02:31:07.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.699 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:07.699 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3955, 2024-09-12T02:31:07.699 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000626659, 2024-09-12T02:31:07.699 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000158 2024-09-12T02:31:07.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.699 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 3776, 2024-09-12T02:31:07.699 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 18272 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 2662, 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 2266, 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 3128232, 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 1309186, 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 7, 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 5, 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.207746944, 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.075845625, 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.156206950, 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.010427736, 2024-09-12T02:31:07.700 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:07.701 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2268, 2024-09-12T02:31:07.701 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.153331258, 2024-09-12T02:31:07.701 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000067606 2024-09-12T02:31:07.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.701 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:07.701 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3795, 2024-09-12T02:31:07.701 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000681505, 2024-09-12T02:31:07.701 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000179 2024-09-12T02:31:07.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.701 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 1753008, 2024-09-12T02:31:07.701 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 200960 2024-09-12T02:31:07.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.702 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:31:07.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 1507, 2024-09-12T02:31:07.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 2373, 2024-09-12T02:31:07.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 472702, 2024-09-12T02:31:07.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 1807663, 2024-09-12T02:31:07.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 11, 2024-09-12T02:31:07.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 7, 2024-09-12T02:31:07.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.113883435, 2024-09-12T02:31:07.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.048893643, 2024-09-12T02:31:07.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.076109968, 2024-09-12T02:31:07.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.000910015, 2024-09-12T02:31:07.702 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2370, 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.097296669, 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000041053 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1469, 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000729991, 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000496 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 566288 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.703 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-09-12T02:31:07.704 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-09-12T02:31:07.704 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-09-12T02:31:07.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.704 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-09-12T02:31:07.704 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-12T02:31:07.704 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-12T02:31:07.704 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1172, 2024-09-12T02:31:07.704 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.346769685, 2024-09-12T02:31:07.704 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000295878 2024-09-12T02:31:07.704 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:07.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.704 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 57, 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.002129488, 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000037359 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 567, 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 511, 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 511, 2024-09-12T02:31:07.705 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 2.624660730, 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.005136322 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 56, 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 4, 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 35, 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 3, 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 1003, 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 140, 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 667, 2024-09-12T02:31:07.706 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 196, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 803, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 125, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 372, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 373, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 43, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 1691, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 1390, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 51, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 48, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 1, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 35, 2024-09-12T02:31:07.707 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 11403, 2024-09-12T02:31:07.708 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 1, 2024-09-12T02:31:07.708 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 1, 2024-09-12T02:31:07.708 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 59, 2024-09-12T02:31:07.708 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 13, 2024-09-12T02:31:07.708 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 476, 2024-09-12T02:31:07.708 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-09-12T02:31:07.708 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 0, 2024-09-12T02:31:07.708 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 3, 2024-09-12T02:31:07.708 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 992, 2024-09-12T02:31:07.708 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 824794995, 2024-09-12T02:31:07.708 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-09-12T02:31:07.708 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 0, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 0, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 0, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 0, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 28, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 215, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 357, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-12T02:31:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 759, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 391, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 39, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 147 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 0, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 0, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 0, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 54, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 63, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 6, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-09-12T02:31:07.710 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 36, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 8, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 27, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 11, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_path": 0, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_quiesce_inode": 0, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 2, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-09-12T02:31:07.711 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 3, 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: "evlrg": 0, 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 2314, 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 2314, 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 4, 2024-09-12T02:31:07.712 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 4, 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: "segmjr": 2, 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 4194304, 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 7363516, 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 0, 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 502, 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 5.259822379, 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.010477733 2024-09-12T02:31:07.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 0 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 902, 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 960, 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 58, 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 64, 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 68, 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 4, 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 1009, 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 1147, 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 138, 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 373, 2024-09-12T02:31:07.714 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 765, 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 392, 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 59388, 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 223520 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 1204, 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 321, 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 567, 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 70, 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 685, 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 8, 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.017061539, 2024-09-12T02:31:07.715 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002132692 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 19, 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.006423945, 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000338102 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 35, 2024-09-12T02:31:07.716 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.557498698, 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.015928534 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 301, 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.159482178, 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000529841 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.717 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1, 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000223550, 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000223550 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.718 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.719 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-09-12T02:31:07.719 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.719 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.719 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.719 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-09-12T02:31:07.719 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.720 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.720 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.720 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-09-12T02:31:07.720 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.720 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.720 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.720 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-09-12T02:31:07.720 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.720 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.720 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 24, 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.072270088, 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.003011253 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-09-12T02:31:07.721 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 44, 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.033989825, 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000772496 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 43, 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1.607866640, 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.037392247 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.722 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.724 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.725 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 36, 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.169844267, 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.004717896 2024-09-12T02:31:07.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 2, 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 2, 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 0, 2024-09-12T02:31:07.727 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 2, 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 109, 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 54, 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 934, 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:31:07.728 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-09-12T02:31:07.729 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-09-12T02:31:07.730 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 614580, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 677, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-09-12T02:31:07.731 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 9856, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 201, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 3107325, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 38672, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-09-12T02:31:07.732 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 752, 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 3418673, 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 28, 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 752, 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 752, 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 10.905758685, 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.014502338 2024-09-12T02:31:07.733 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 752, 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 889 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 752, 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 13, 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 739, 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 0, 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 10, 2024-09-12T02:31:07.734 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 6, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 508, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 69, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 0, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 34, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 0, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 20, 2024-09-12T02:31:07.735 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-09-12T02:31:07.736 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 117, 2024-09-12T02:31:07.737 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 22, 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 12, 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 12, 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 0, 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 196, 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 11, 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 35 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 1, 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-09-12T02:31:07.738 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 1 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 6, 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 3, 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed_ops": 19, 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 8, 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-09-12T02:31:07.739 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 6979, 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 4090436, 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 6979, 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 6979, 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 4090436, 2024-09-12T02:31:07.740 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:07.741 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 752, 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 3419703, 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 752, 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 3419703, 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-09-12T02:31:07.742 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 752, 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 752, 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 752, 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 752, 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:07.743 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 8, 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 1168, 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 8, 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 6, 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 1168, 2024-09-12T02:31:07.744 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x557930e58960": { 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 2314, 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 3169212, 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 2314, 2024-09-12T02:31:07.745 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-12T02:31:07.746 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-12T02:31:07.746 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 502, 2024-09-12T02:31:07.746 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 3169212, 2024-09-12T02:31:07.746 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:07.746 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:07.746 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:07.746 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:07.746 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:07.746 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:07.746 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-09-12T02:31:07.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:07 smithi115 ceph-mon[35351]: pgmap v504: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 74 KiB/s wr, 27 op/s 2024-09-12T02:31:07.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:07 smithi110 ceph-mon[30548]: pgmap v504: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 74 KiB/s wr, 27 op/s 2024-09-12T02:31:08.497 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-09-12T02:31:08.497 INFO:tasks.check_counter:Daemon mds.i mds.imported=13 2024-09-12T02:31:08.497 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=0 2024-09-12T02:31:08.497 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-12T02:31:08.497 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-12T02:31:08.497 DEBUG:tasks.check_counter:Getting stats from l 2024-09-12T02:31:08.498 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-12T02:31:08.745 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.c/config 2024-09-12T02:31:09.240 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-09-12T02:31:09.240 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-09-12T02:31:09.240 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 0, 2024-09-12T02:31:09.240 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 2, 2024-09-12T02:31:09.240 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 0, 2024-09-12T02:31:09.240 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 0, 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 4, 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 0, 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.001053017, 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.000000000, 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.000231754, 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:09.241 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 0 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 6, 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 244, 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 3312, 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 200176, 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 5, 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 3, 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.014524040, 2024-09-12T02:31:09.242 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.008906145, 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.003477287, 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 242, 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.030699754, 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000126858 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:09.243 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 200176 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 327, 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 316, 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 1610784, 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 195120, 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 2, 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 1, 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.048456200, 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.018460739, 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.043749739, 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-12T02:31:09.244 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 315, 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.015133313, 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000048042 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 1610784, 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 195120 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:09.245 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 0, 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-12T02:31:09.246 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-09-12T02:31:09.247 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 148714, 2024-09-12T02:31:09.248 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 30, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-09-12T02:31:09.249 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 928, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 2, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 329, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 1564620, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-09-12T02:31:09.250 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 329, 2024-09-12T02:31:09.251 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-09-12T02:31:09.251 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-09-12T02:31:09.251 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 329, 2024-09-12T02:31:09.251 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 1564620, 2024-09-12T02:31:09.251 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-09-12T02:31:09.251 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-09-12T02:31:09.251 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-09-12T02:31:09.251 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-09-12T02:31:09.251 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:09.251 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-09-12T02:31:09.251 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-09-12T02:31:09.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:09 smithi115 ceph-mon[35351]: pgmap v505: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 74 KiB/s wr, 27 op/s 2024-09-12T02:31:09.845 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:09 smithi136 ceph-mon[35814]: pgmap v505: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 74 KiB/s wr, 27 op/s 2024-09-12T02:31:09.873 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-12T02:31:09.873 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-12T02:31:09.873 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-12T02:31:09.873 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-12T02:31:09.873 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-12T02:31:09.873 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T02:31:09.883 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T02:31:09.883 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:31:09.883 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:31:09.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:09 smithi110 ceph-mon[30548]: pgmap v505: 129 pgs: 2 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 120 active+clean; 3.1 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 74 KiB/s wr, 27 op/s 2024-09-12T02:31:09.942 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-12T02:31:09.942 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T02:31:10.020 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T02:31:10.432 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:11.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.085+0000 7f83b7e00640 1 -- 172.21.15.110:0/528379790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b8102360 msgr2=0x7f83b810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:11.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.085+0000 7f83b7e00640 1 --2- 172.21.15.110:0/528379790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b8102360 0x7f83b810e890 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009cd0 tx=0x7f83b002a8e0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.085+0000 7f83b7e00640 1 -- 172.21.15.110:0/528379790 shutdown_connections 2024-09-12T02:31:11.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.085+0000 7f83b7e00640 1 --2- 172.21.15.110:0/528379790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b8102360 0x7f83b810e890 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.085+0000 7f83b7e00640 1 --2- 172.21.15.110:0/528379790 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83b81019c0 0x7f83b8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.085+0000 7f83b7e00640 1 --2- 172.21.15.110:0/528379790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83b81079c0 0x7f83b8107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.085+0000 7f83b7e00640 1 -- 172.21.15.110:0/528379790 >> 172.21.15.110:0/528379790 conn(0x7f83b80fd740 msgr2=0x7f83b80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:11.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.085+0000 7f83b7e00640 1 -- 172.21.15.110:0/528379790 shutdown_connections 2024-09-12T02:31:11.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.085+0000 7f83b7e00640 1 -- 172.21.15.110:0/528379790 wait complete. 2024-09-12T02:31:11.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.086+0000 7f83b7e00640 1 Processor -- start 2024-09-12T02:31:11.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.086+0000 7f83b7e00640 1 -- start start 2024-09-12T02:31:11.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.087+0000 7f83b7e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83b81019c0 0x7f83b8198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:11.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.087+0000 7f83b7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b8102360 0x7f83b8198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:11.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.087+0000 7f83b7e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83b81079c0 0x7f83b819cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:11.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.087+0000 7f83b7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8111e10 con 0x7f83b8102360 2024-09-12T02:31:11.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.087+0000 7f83b7e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8111c90 con 0x7f83b81079c0 2024-09-12T02:31:11.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.087+0000 7f83b7e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f83b8111f90 con 0x7f83b81019c0 2024-09-12T02:31:11.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.087+0000 7f83b6000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b8102360 0x7f83b8198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:11.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.087+0000 7f83b6000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b8102360 0x7f83b8198770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33152/0 (socket says 172.21.15.110:33152) 2024-09-12T02:31:11.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.087+0000 7f83b7400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83b81079c0 0x7f83b819cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:11.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.087+0000 7f83b6a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83b81019c0 0x7f83b8198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:11.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.087+0000 7f83b6000640 1 -- 172.21.15.110:0/4203028466 learned_addr learned my addr 172.21.15.110:0/4203028466 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:31:11.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.088+0000 7f83b7400640 1 -- 172.21.15.110:0/4203028466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83b81019c0 msgr2=0x7f83b8198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:11.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.088+0000 7f83b7400640 1 --2- 172.21.15.110:0/4203028466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83b81019c0 0x7f83b8198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.088+0000 7f83b7400640 1 -- 172.21.15.110:0/4203028466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b8102360 msgr2=0x7f83b8198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:11.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.088+0000 7f83b7400640 1 --2- 172.21.15.110:0/4203028466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b8102360 0x7f83b8198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.088+0000 7f83b7400640 1 -- 172.21.15.110:0/4203028466 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b819d1e0 con 0x7f83b81079c0 2024-09-12T02:31:11.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.088+0000 7f83b7400640 1 --2- 172.21.15.110:0/4203028466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83b81079c0 0x7f83b819cb00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009ca0 tx=0x7f83b0031e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:11.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.088+0000 7f83af400640 1 -- 172.21.15.110:0/4203028466 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0004040 con 0x7f83b81079c0 2024-09-12T02:31:11.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.088+0000 7f83af400640 1 -- 172.21.15.110:0/4203028466 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83b00046c0 con 0x7f83b81079c0 2024-09-12T02:31:11.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.088+0000 7f83b7e00640 1 -- 172.21.15.110:0/4203028466 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b819d470 con 0x7f83b81079c0 2024-09-12T02:31:11.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.089+0000 7f83af400640 1 -- 172.21.15.110:0/4203028466 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0030e40 con 0x7f83b81079c0 2024-09-12T02:31:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.089+0000 7f83b7e00640 1 -- 172.21.15.110:0/4203028466 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b81a4db0 con 0x7f83b81079c0 2024-09-12T02:31:11.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.090+0000 7f83b7e00640 1 -- 172.21.15.110:0/4203028466 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b8101e20 con 0x7f83b81079c0 2024-09-12T02:31:11.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.092+0000 7f83af400640 1 -- 172.21.15.110:0/4203028466 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f83b00305a0 con 0x7f83b81079c0 2024-09-12T02:31:11.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.093+0000 7f83af400640 1 --2- 172.21.15.110:0/4203028466 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f839c0a2cf0 0x7f839c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:11.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.093+0000 7f83af400640 1 -- 172.21.15.110:0/4203028466 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9592+0+0 (secure 0 0 0) 0x7f83b002e030 con 0x7f83b81079c0 2024-09-12T02:31:11.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.093+0000 7f83b6a00640 1 --2- 172.21.15.110:0/4203028466 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f839c0a2cf0 0x7f839c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:11.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.094+0000 7f83b6a00640 1 --2- 172.21.15.110:0/4203028466 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f839c0a2cf0 0x7f839c0a51b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009b50 tx=0x7f83a8005f90 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:11.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.096+0000 7f83af400640 1 -- 172.21.15.110:0/4203028466 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f83b004b060 con 0x7f83b81079c0 2024-09-12T02:31:11.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.288+0000 7f83b7e00640 1 -- 172.21.15.110:0/4203028466 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f83b81a4f80 con 0x7f83b81079c0 2024-09-12T02:31:11.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.289+0000 7f83af400640 1 -- 172.21.15.110:0/4203028466 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v117) ==== 81+0+959 (secure 0 0 0) 0x7f83b00bd850 con 0x7f83b81079c0 2024-09-12T02:31:11.290 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3294226687 2024-09-13T02:15:01.680986+0000 2024-09-12T02:31:11.290 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/511769794 2024-09-13T02:15:01.680986+0000 2024-09-12T02:31:11.290 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/511769794 2024-09-13T02:15:01.680986+0000 2024-09-12T02:31:11.290 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3947837481 2024-09-13T02:04:17.987172+0000 2024-09-12T02:31:11.290 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/3368055532 2024-09-13T02:04:17.987172+0000 2024-09-12T02:31:11.291 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6800/3137576010 2024-09-13T02:04:45.356605+0000 2024-09-12T02:31:11.291 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3644360562 2024-09-13T02:04:17.987172+0000 2024-09-12T02:31:11.291 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/3137576010 2024-09-13T02:04:45.356605+0000 2024-09-12T02:31:11.291 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/2413734786 2024-09-13T02:04:45.356605+0000 2024-09-12T02:31:11.291 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/667674244 2024-09-13T02:04:17.987172+0000 2024-09-12T02:31:11.291 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:6801/3368055532 2024-09-13T02:04:17.987172+0000 2024-09-12T02:31:11.291 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/2826731707 2024-09-13T02:04:45.356605+0000 2024-09-12T02:31:11.291 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/3490929121 2024-09-13T02:04:45.356605+0000 2024-09-12T02:31:11.291 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/1555464732 2024-09-13T02:15:01.680986+0000 2024-09-12T02:31:11.291 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/1450306336 2024-09-13T02:15:01.680986+0000 2024-09-12T02:31:11.291 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110:0/2937283686 2024-09-13T02:15:01.680986+0000 2024-09-12T02:31:11.291 INFO:teuthology.orchestra.run.smithi110.stderr:listed 16 entries 2024-09-12T02:31:11.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.291+0000 7f83b7e00640 1 -- 172.21.15.110:0/4203028466 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f839c0a2cf0 msgr2=0x7f839c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.291+0000 7f83b7e00640 1 --2- 172.21.15.110:0/4203028466 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f839c0a2cf0 0x7f839c0a51b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009b50 tx=0x7f83a8005f90 comp rx=0 tx=0).stop 2024-09-12T02:31:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.291+0000 7f83b7e00640 1 -- 172.21.15.110:0/4203028466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83b81079c0 msgr2=0x7f83b819cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.291+0000 7f83b7e00640 1 --2- 172.21.15.110:0/4203028466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83b81079c0 0x7f83b819cb00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f83b0009ca0 tx=0x7f83b0031e60 comp rx=0 tx=0).stop 2024-09-12T02:31:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.291+0000 7f83b7e00640 1 -- 172.21.15.110:0/4203028466 shutdown_connections 2024-09-12T02:31:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.291+0000 7f83b7e00640 1 --2- 172.21.15.110:0/4203028466 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f839c0a2cf0 0x7f839c0a51b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.291+0000 7f83b7e00640 1 --2- 172.21.15.110:0/4203028466 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f83b81079c0 0x7f83b819cb00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.291+0000 7f83b7e00640 1 --2- 172.21.15.110:0/4203028466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83b8102360 0x7f83b8198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.291+0000 7f83b7e00640 1 --2- 172.21.15.110:0/4203028466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83b81019c0 0x7f83b8198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.291+0000 7f83b7e00640 1 -- 172.21.15.110:0/4203028466 >> 172.21.15.110:0/4203028466 conn(0x7f83b80fd740 msgr2=0x7f83b80fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.292+0000 7f83b7e00640 1 -- 172.21.15.110:0/4203028466 shutdown_connections 2024-09-12T02:31:11.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:11.292+0000 7f83b7e00640 1 -- 172.21.15.110:0/4203028466 wait complete. 2024-09-12T02:31:11.675 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:11 smithi110 ceph-mon[30548]: pgmap v506: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-09-12T02:31:11.676 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:11 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/4203028466' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:31:11.794 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:11 smithi115 ceph-mon[35351]: pgmap v506: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-09-12T02:31:11.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:11 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/4203028466' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:31:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:11 smithi136 ceph-mon[35814]: pgmap v506: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-09-12T02:31:11.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:11 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/4203028466' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T02:31:12.107 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T02:31:12.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:31:12.108 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /tmp/cephfs 2024-09-12T02:31:12.247 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T02:31:12.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:31:12.248 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-12T02:31:12.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:31:12.385 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-09-12T02:31:12.479 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-12T02:31:12.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:31:12.479 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-12T02:31:12.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T02:31:12.539 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-09-12T02:31:12.909 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T02:31:12.920 INFO:tasks.cephadm:Teardown begin 2024-09-12T02:31:12.920 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T02:31:12.921 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:31:13.352 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:13.752 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:13 smithi110 ceph-mon[30548]: pgmap v507: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 61 KiB/s wr, 26 op/s 2024-09-12T02:31:13.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:13 smithi136 ceph-mon[35814]: pgmap v507: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 61 KiB/s wr, 26 op/s 2024-09-12T02:31:14.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:13.998+0000 7fade7200640 1 -- 172.21.15.110:0/442880999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade0076720 msgr2=0x7fade0076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:14.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:13.998+0000 7fade7200640 1 --2- 172.21.15.110:0/442880999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade0076720 0x7fade0076b00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009900 tx=0x7fadd002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:31:14.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:13.998+0000 7fade7200640 1 -- 172.21.15.110:0/442880999 shutdown_connections 2024-09-12T02:31:14.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:13.998+0000 7fade7200640 1 --2- 172.21.15.110:0/442880999 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fade0112a30 0x7fade0114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:14.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:13.998+0000 7fade7200640 1 --2- 172.21.15.110:0/442880999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fade0077040 0x7fade01124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:14.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:13.998+0000 7fade7200640 1 --2- 172.21.15.110:0/442880999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade0076720 0x7fade0076b00 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:14.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:13.998+0000 7fade7200640 1 -- 172.21.15.110:0/442880999 >> 172.21.15.110:0/442880999 conn(0x7fade00ffa90 msgr2=0x7fade0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:13.998+0000 7fade7200640 1 -- 172.21.15.110:0/442880999 shutdown_connections 2024-09-12T02:31:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:13.998+0000 7fade7200640 1 -- 172.21.15.110:0/442880999 wait complete. 2024-09-12T02:31:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:13.999+0000 7fade7200640 1 Processor -- start 2024-09-12T02:31:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:13.999+0000 7fade7200640 1 -- start start 2024-09-12T02:31:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.000+0000 7fade7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade0076720 0x7fade01a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.000+0000 7fade7200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fade0077040 0x7fade01a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.000+0000 7fade7200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fade0112a30 0x7fade019e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.000+0000 7fade7200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fade01185a0 con 0x7fade0076720 2024-09-12T02:31:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.000+0000 7fade7200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fade0118420 con 0x7fade0112a30 2024-09-12T02:31:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.000+0000 7fade7200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fade0118720 con 0x7fade0077040 2024-09-12T02:31:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.000+0000 7faddfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade0076720 0x7fade01a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:14.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.000+0000 7faddfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade0076720 0x7fade01a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33174/0 (socket says 172.21.15.110:33174) 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.000+0000 7faddfe00640 1 -- 172.21.15.110:0/355250872 learned_addr learned my addr 172.21.15.110:0/355250872 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.000+0000 7fade5200640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fade0112a30 0x7fade019e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.000+0000 7faddf400640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fade0077040 0x7fade01a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.001+0000 7fade5200640 1 -- 172.21.15.110:0/355250872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fade0077040 msgr2=0x7fade01a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.001+0000 7fade5200640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fade0077040 0x7fade01a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.001+0000 7fade5200640 1 -- 172.21.15.110:0/355250872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade0076720 msgr2=0x7fade01a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.001+0000 7fade5200640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade0076720 0x7fade01a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.001+0000 7fade5200640 1 -- 172.21.15.110:0/355250872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade019efe0 con 0x7fade0112a30 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.001+0000 7fade5200640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fade0112a30 0x7fade019e8b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fade007aa10 tx=0x7fadd800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.002+0000 7faddcc00640 1 -- 172.21.15.110:0/355250872 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd800cdf0 con 0x7fade0112a30 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.002+0000 7faddcc00640 1 -- 172.21.15.110:0/355250872 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadd8005020 con 0x7fade0112a30 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.002+0000 7faddcc00640 1 -- 172.21.15.110:0/355250872 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8010670 con 0x7fade0112a30 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.002+0000 7fade7200640 1 -- 172.21.15.110:0/355250872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade019f2d0 con 0x7fade0112a30 2024-09-12T02:31:14.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.002+0000 7fade7200640 1 -- 172.21.15.110:0/355250872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade01ab5c0 con 0x7fade0112a30 2024-09-12T02:31:14.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.003+0000 7fade7200640 1 -- 172.21.15.110:0/355250872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade0076b00 con 0x7fade0112a30 2024-09-12T02:31:14.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.005+0000 7faddcc00640 1 -- 172.21.15.110:0/355250872 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fadd80054d0 con 0x7fade0112a30 2024-09-12T02:31:14.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.006+0000 7faddcc00640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fadc40a2d70 0x7fadc40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:14.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.006+0000 7faddcc00640 1 -- 172.21.15.110:0/355250872 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9592+0+0 (secure 0 0 0) 0x7fadd80cfea0 con 0x7fade0112a30 2024-09-12T02:31:14.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.006+0000 7faddfe00640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fadc40a2d70 0x7fadc40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:14.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.007+0000 7faddfe00640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fadc40a2d70 0x7fadc40a5230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadd00096c0 tx=0x7fadd0005a20 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:14.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.010+0000 7faddcc00640 1 -- 172.21.15.110:0/355250872 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fadd809c630 con 0x7fade0112a30 2024-09-12T02:31:14.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:13 smithi115 ceph-mon[35351]: pgmap v507: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 61 KiB/s wr, 26 op/s 2024-09-12T02:31:14.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.229+0000 7fade7200640 1 -- 172.21.15.110:0/355250872 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fade002d7c0 con 0x7fade0112a30 2024-09-12T02:31:14.230 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.230+0000 7faddcc00640 1 -- 172.21.15.110:0/355250872 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11936 (secure 0 0 0) 0x7fadd809bf30 con 0x7fade0112a30 2024-09-12T02:31:14.231 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:31:14.231 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":46,"btime":"2024-09-12T02:30:59:428039+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:12:13.698489+0000","modified":"2024-09-12T02:30:58.658514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.110:6841/4021694968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":4021694968},{"type":"v1","addr":"172.21.15.110:6841","nonce":4021694968}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6839/1796624254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1796624254},{"type":"v1","addr":"172.21.15.115:6839","nonce":1796624254}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24517,24538,24539]},"id":1}]} 2024-09-12T02:31:14.231 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 46 2024-09-12T02:31:14.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.232+0000 7fade7200640 1 -- 172.21.15.110:0/355250872 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fadc40a2d70 msgr2=0x7fadc40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:14.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.232+0000 7fade7200640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fadc40a2d70 0x7fadc40a5230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadd00096c0 tx=0x7fadd0005a20 comp rx=0 tx=0).stop 2024-09-12T02:31:14.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.232+0000 7fade7200640 1 -- 172.21.15.110:0/355250872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fade0112a30 msgr2=0x7fade019e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:14.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.232+0000 7fade7200640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fade0112a30 0x7fade019e8b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fade007aa10 tx=0x7fadd800ef10 comp rx=0 tx=0).stop 2024-09-12T02:31:14.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.232+0000 7fade7200640 1 -- 172.21.15.110:0/355250872 shutdown_connections 2024-09-12T02:31:14.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.232+0000 7fade7200640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fadc40a2d70 0x7fadc40a5230 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:14.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.232+0000 7fade7200640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fade0112a30 0x7fade019e8b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:14.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.232+0000 7fade7200640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fade0077040 0x7fade01a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:14.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.232+0000 7fade7200640 1 --2- 172.21.15.110:0/355250872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fade0076720 0x7fade01a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:14.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.232+0000 7fade7200640 1 -- 172.21.15.110:0/355250872 >> 172.21.15.110:0/355250872 conn(0x7fade00ffa90 msgr2=0x7fade0101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:14.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.232+0000 7fade7200640 1 -- 172.21.15.110:0/355250872 shutdown_connections 2024-09-12T02:31:14.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:14.233+0000 7fade7200640 1 -- 172.21.15.110:0/355250872 wait complete. 2024-09-12T02:31:14.751 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:14 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/355250872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:14.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:14 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/355250872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:15.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:14 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/355250872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:15.169 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T02:31:15.544 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:15.854 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:15 smithi110 ceph-mon[30548]: pgmap v508: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 61 KiB/s wr, 9 op/s 2024-09-12T02:31:15.854 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:15 smithi110 ceph-mon[30548]: osdmap e118: 12 total, 12 up, 12 in 2024-09-12T02:31:15.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:15 smithi136 ceph-mon[35814]: pgmap v508: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 61 KiB/s wr, 9 op/s 2024-09-12T02:31:15.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:15 smithi136 ceph-mon[35814]: osdmap e118: 12 total, 12 up, 12 in 2024-09-12T02:31:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:15 smithi115 ceph-mon[35351]: pgmap v508: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 61 KiB/s wr, 9 op/s 2024-09-12T02:31:16.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:15 smithi115 ceph-mon[35351]: osdmap e118: 12 total, 12 up, 12 in 2024-09-12T02:31:16.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.133+0000 7f99d6000640 1 -- 172.21.15.110:0/3779578696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99d0104010 msgr2=0x7f99d01043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.133+0000 7f99d6000640 1 --2- 172.21.15.110:0/3779578696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99d0104010 0x7f99d01043f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009900 tx=0x7f99c002a410 comp rx=0 tx=0).stop 2024-09-12T02:31:16.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.133+0000 7f99d6000640 1 -- 172.21.15.110:0/3779578696 shutdown_connections 2024-09-12T02:31:16.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.133+0000 7f99d6000640 1 --2- 172.21.15.110:0/3779578696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99d0109140 0x7f99d0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.133+0000 7f99d6000640 1 --2- 172.21.15.110:0/3779578696 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d01049c0 0x7f99d0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.133+0000 7f99d6000640 1 --2- 172.21.15.110:0/3779578696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99d0104010 0x7f99d01043f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.133+0000 7f99d6000640 1 -- 172.21.15.110:0/3779578696 >> 172.21.15.110:0/3779578696 conn(0x7f99d00ffa50 msgr2=0x7f99d0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:16.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.133+0000 7f99d6000640 1 -- 172.21.15.110:0/3779578696 shutdown_connections 2024-09-12T02:31:16.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.133+0000 7f99d6000640 1 -- 172.21.15.110:0/3779578696 wait complete. 2024-09-12T02:31:16.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.134+0000 7f99d6000640 1 Processor -- start 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.134+0000 7f99d6000640 1 -- start start 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.135+0000 7f99d6000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d0104010 0x7f99d019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.135+0000 7f99d6000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99d01049c0 0x7f99d019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.135+0000 7f99d6000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99d0109140 0x7f99d019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.135+0000 7f99d6000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f99d0114170 con 0x7f99d0109140 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.135+0000 7f99d6000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f99d0113ff0 con 0x7f99d0104010 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.135+0000 7f99d6000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f99d01142f0 con 0x7f99d01049c0 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.135+0000 7f99cea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99d01049c0 0x7f99d019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.135+0000 7f99cfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99d0109140 0x7f99d019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.135+0000 7f99cf400640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d0104010 0x7f99d019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.135+0000 7f99cea00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99d01049c0 0x7f99d019ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:34524/0 (socket says 172.21.15.110:34524) 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.135+0000 7f99cea00640 1 -- 172.21.15.110:0/2808309398 learned_addr learned my addr 172.21.15.110:0/2808309398 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:31:16.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.136+0000 7f99cea00640 1 -- 172.21.15.110:0/2808309398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d0104010 msgr2=0x7f99d019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.136+0000 7f99cea00640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d0104010 0x7f99d019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.136+0000 7f99cea00640 1 -- 172.21.15.110:0/2808309398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99d0109140 msgr2=0x7f99d019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.136+0000 7f99cea00640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99d0109140 0x7f99d019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.136+0000 7f99cea00640 1 -- 172.21.15.110:0/2808309398 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d019f600 con 0x7f99d01049c0 2024-09-12T02:31:16.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.136+0000 7f99cf400640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d0104010 0x7f99d019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T02:31:16.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.136+0000 7f99cea00640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99d01049c0 0x7f99d019ab90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00e9f0 tx=0x7f99bc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:16.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.136+0000 7f99c7e00640 1 -- 172.21.15.110:0/2808309398 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc00cd80 con 0x7f99d01049c0 2024-09-12T02:31:16.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.136+0000 7f99d6000640 1 -- 172.21.15.110:0/2808309398 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d019f8f0 con 0x7f99d01049c0 2024-09-12T02:31:16.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.137+0000 7f99c7e00640 1 -- 172.21.15.110:0/2808309398 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99bc010910 con 0x7f99d01049c0 2024-09-12T02:31:16.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.137+0000 7f99d6000640 1 -- 172.21.15.110:0/2808309398 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d01a71d0 con 0x7f99d01049c0 2024-09-12T02:31:16.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.137+0000 7f99c7e00640 1 -- 172.21.15.110:0/2808309398 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc018980 con 0x7f99d01049c0 2024-09-12T02:31:16.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.138+0000 7f99d6000640 1 -- 172.21.15.110:0/2808309398 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d01043f0 con 0x7f99d01049c0 2024-09-12T02:31:16.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.141+0000 7f99c7e00640 1 -- 172.21.15.110:0/2808309398 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f99bc010ac0 con 0x7f99d01049c0 2024-09-12T02:31:16.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.142+0000 7f99c7e00640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f99b40a2d70 0x7f99b40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:16.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.142+0000 7f99c7e00640 1 -- 172.21.15.110:0/2808309398 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9504+0+0 (secure 0 0 0) 0x7f99bc0cfd60 con 0x7f99d01049c0 2024-09-12T02:31:16.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.142+0000 7f99cf400640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f99b40a2d70 0x7f99b40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:16.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.143+0000 7f99cf400640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f99b40a2d70 0x7f99b40a5230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009230 tx=0x7f99c00058d0 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:16.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.143+0000 7f99c7e00640 1 -- 172.21.15.110:0/2808309398 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f99bc09bf20 con 0x7f99d01049c0 2024-09-12T02:31:16.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.358+0000 7f99d6000640 1 -- 172.21.15.110:0/2808309398 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99d019b9b0 con 0x7f99d01049c0 2024-09-12T02:31:16.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.359+0000 7f99c7e00640 1 -- 172.21.15.110:0/2808309398 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11936 (secure 0 0 0) 0x7f99d019b9b0 con 0x7f99d01049c0 2024-09-12T02:31:16.361 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:31:16.361 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":46,"btime":"2024-09-12T02:30:59:428039+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14448,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1116222673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1116222673},{"type":"v1","addr":"172.21.15.110:6835","nonce":1116222673}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14460,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/574606945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":574606945},{"type":"v1","addr":"172.21.15.110:6837","nonce":574606945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14502,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/647319477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6838","nonce":647319477},{"type":"v1","addr":"172.21.15.110:6839","nonce":647319477}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24446,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6833/2767472507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":2767472507},{"type":"v1","addr":"172.21.15.115:6833","nonce":2767472507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/701119527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":701119527},{"type":"v1","addr":"172.21.15.136:6833","nonce":701119527}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24476,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3409231586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3409231586},{"type":"v1","addr":"172.21.15.115:6835","nonce":3409231586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-12T02:12:13.698489+0000","modified":"2024-09-12T02:30:58.658514+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24539,"mds_1":24538,"mds_2":24517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24493":{"gid":24493,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2205978549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2205978549},{"type":"v1","addr":"172.21.15.136:6835","nonce":2205978549}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.115:6837/1922841773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":1922841773},{"type":"v1","addr":"172.21.15.115:6837","nonce":1922841773}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6837/3503120492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3503120492},{"type":"v1","addr":"172.21.15.136:6837","nonce":3503120492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":20,"addr":"172.21.15.136:6839/3572987086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":3572987086},{"type":"v1","addr":"172.21.15.136:6839","nonce":3572987086}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":17,"addr":"172.21.15.110:6841/4021694968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6840","nonce":4021694968},{"type":"v1","addr":"172.21.15.110:6841","nonce":4021694968}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24539":{"gid":24539,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.115:6839/1796624254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1796624254},{"type":"v1","addr":"172.21.15.115:6839","nonce":1796624254}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24539,"qdb_cluster":[24517,24538,24539]},"id":1}]} 2024-09-12T02:31:16.361 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 46 2024-09-12T02:31:16.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.362+0000 7f99d6000640 1 -- 172.21.15.110:0/2808309398 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f99b40a2d70 msgr2=0x7f99b40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.362+0000 7f99d6000640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f99b40a2d70 0x7f99b40a5230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009230 tx=0x7f99c00058d0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.362+0000 7f99d6000640 1 -- 172.21.15.110:0/2808309398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99d01049c0 msgr2=0x7f99d019ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:16.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.362+0000 7f99d6000640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99d01049c0 0x7f99d019ab90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00e9f0 tx=0x7f99bc00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.362+0000 7f99d6000640 1 -- 172.21.15.110:0/2808309398 shutdown_connections 2024-09-12T02:31:16.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.362+0000 7f99d6000640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f99b40a2d70 0x7f99b40a5230 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.362+0000 7f99d6000640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99d0109140 0x7f99d019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.362+0000 7f99d6000640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f99d01049c0 0x7f99d019ab90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.362+0000 7f99d6000640 1 --2- 172.21.15.110:0/2808309398 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99d0104010 0x7f99d019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:16.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.362+0000 7f99d6000640 1 -- 172.21.15.110:0/2808309398 >> 172.21.15.110:0/2808309398 conn(0x7f99d00ffa50 msgr2=0x7f99d0100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:16.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.362+0000 7f99d6000640 1 -- 172.21.15.110:0/2808309398 shutdown_connections 2024-09-12T02:31:16.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:16.362+0000 7f99d6000640 1 -- 172.21.15.110:0/2808309398 wait complete. 2024-09-12T02:31:16.686 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:16 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2808309398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:16.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:16 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2808309398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:17.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:16 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2808309398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T02:31:17.218 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T02:31:17.592 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:17.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:17 smithi136 ceph-mon[35814]: pgmap v510: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 9 op/s 2024-09-12T02:31:17.928 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:17 smithi110 ceph-mon[30548]: pgmap v510: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 9 op/s 2024-09-12T02:31:18.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:17 smithi115 ceph-mon[35351]: pgmap v510: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 9 op/s 2024-09-12T02:31:18.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.315+0000 7f0233e00640 1 -- 172.21.15.110:0/4158186532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0234108f60 msgr2=0x7f0234110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.315+0000 7f0233e00640 1 --2- 172.21.15.110:0/4158186532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0234108f60 0x7f0234110ae0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f022c009900 tx=0x7f022c02a410 comp rx=0 tx=0).stop 2024-09-12T02:31:18.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.315+0000 7f0233e00640 1 -- 172.21.15.110:0/4158186532 shutdown_connections 2024-09-12T02:31:18.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.315+0000 7f0233e00640 1 --2- 172.21.15.110:0/4158186532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0234108f60 0x7f0234110ae0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.315+0000 7f0233e00640 1 --2- 172.21.15.110:0/4158186532 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02341047e0 0x7f0234108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.315+0000 7f0233e00640 1 --2- 172.21.15.110:0/4158186532 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0234103e30 0x7f0234104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.315+0000 7f0233e00640 1 -- 172.21.15.110:0/4158186532 >> 172.21.15.110:0/4158186532 conn(0x7f02340ff8d0 msgr2=0x7f0234101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:18.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.315+0000 7f0233e00640 1 -- 172.21.15.110:0/4158186532 shutdown_connections 2024-09-12T02:31:18.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.315+0000 7f0233e00640 1 -- 172.21.15.110:0/4158186532 wait complete. 2024-09-12T02:31:18.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.316+0000 7f0233e00640 1 Processor -- start 2024-09-12T02:31:18.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.316+0000 7f0233e00640 1 -- start start 2024-09-12T02:31:18.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.316+0000 7f0233e00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0234103e30 0x7f023419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.316+0000 7f0233e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02341047e0 0x7f023419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.316+0000 7f0233e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0234108f60 0x7f023419ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.316+0000 7f0233e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f0234113fc0 con 0x7f0234108f60 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.316+0000 7f0233e00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0234113e40 con 0x7f0234103e30 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.316+0000 7f0233e00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0234114140 con 0x7f02341047e0 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.316+0000 7f0232a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0234103e30 0x7f023419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.317+0000 7f0232a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0234103e30 0x7f023419a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.110:54068/0 (socket says 172.21.15.110:54068) 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.317+0000 7f0232a00640 1 -- 172.21.15.110:0/2655334665 learned_addr learned my addr 172.21.15.110:0/2655334665 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.317+0000 7f0232000640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02341047e0 0x7f023419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.317+0000 7f0233400640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0234108f60 0x7f023419ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.317+0000 7f0232a00640 1 -- 172.21.15.110:0/2655334665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02341047e0 msgr2=0x7f023419a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.317+0000 7f0232a00640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02341047e0 0x7f023419a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.317+0000 7f0232a00640 1 -- 172.21.15.110:0/2655334665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0234108f60 msgr2=0x7f023419ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.317+0000 7f0232a00640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0234108f60 0x7f023419ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.317+0000 7f0232a00640 1 -- 172.21.15.110:0/2655334665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023419f3d0 con 0x7f0234103e30 2024-09-12T02:31:18.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.317+0000 7f0232a00640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0234103e30 0x7f023419a420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f022400db80 tx=0x7f022400b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:18.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.317+0000 7f022b400640 1 -- 172.21.15.110:0/2655334665 <== mon.2 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224017070 con 0x7f0234103e30 2024-09-12T02:31:18.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.318+0000 7f0233e00640 1 -- 172.21.15.110:0/2655334665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023419f6c0 con 0x7f0234103e30 2024-09-12T02:31:18.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.318+0000 7f022b400640 1 -- 172.21.15.110:0/2655334665 <== mon.2 v2:172.21.15.115:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0224003b70 con 0x7f0234103e30 2024-09-12T02:31:18.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.318+0000 7f022b400640 1 -- 172.21.15.110:0/2655334665 <== mon.2 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02240106c0 con 0x7f0234103e30 2024-09-12T02:31:18.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.318+0000 7f0233e00640 1 -- 172.21.15.110:0/2655334665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02341a6fa0 con 0x7f0234103e30 2024-09-12T02:31:18.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.319+0000 7f0233e00640 1 -- 172.21.15.110:0/2655334665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0234104210 con 0x7f0234103e30 2024-09-12T02:31:18.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.321+0000 7f022b400640 1 -- 172.21.15.110:0/2655334665 <== mon.2 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f0224004020 con 0x7f0234103e30 2024-09-12T02:31:18.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.322+0000 7f022b400640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f02180a2cf0 0x7f02180a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:18.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.322+0000 7f022b400640 1 -- 172.21.15.110:0/2655334665 <== mon.2 v2:172.21.15.115:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9504+0+0 (secure 0 0 0) 0x7f02240cf910 con 0x7f0234103e30 2024-09-12T02:31:18.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.323+0000 7f0232000640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f02180a2cf0 0x7f02180a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:18.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.323+0000 7f0232000640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f02180a2cf0 0x7f02180a51b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f023410a930 tx=0x7f0220005f90 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:18.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.324+0000 7f022b400640 1 -- 172.21.15.110:0/2655334665 <== mon.2 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0224020070 con 0x7f0234103e30 2024-09-12T02:31:18.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.499+0000 7f0233e00640 1 -- 172.21.15.110:0/2655334665 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f023419b780 con 0x7f0234103e30 2024-09-12T02:31:18.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.501+0000 7f022b400640 1 -- 172.21.15.110:0/2655334665 <== mon.2 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+25506 (secure 0 0 0) 0x7f022409c120 con 0x7f0234103e30 2024-09-12T02:31:18.501 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-12T02:31:18.501 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":118,"fsid":"10ead734-70ab-11ef-bcea-c7b262605968","created":"2024-09-12T02:03:43.877844+0000","modified":"2024-09-12T02:31:15.529856+0000","last_up_change":"2024-09-12T02:11:11.511950+0000","last_in_change":"2024-09-12T02:10:48.596268+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T02:07:07.945973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T02:12:08.596125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T02:12:11.312393+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-12T02:12:21.215161+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":27,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a36656f3-7a9c-4a0d-a44e-95a4791d8f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6803","nonce":1183571640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6805","nonce":1183571640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6809","nonce":1183571640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":1183571640},{"type":"v1","addr":"172.21.15.110:6807","nonce":1183571640}]},"public_addr":"172.21.15.110:6803/1183571640","cluster_addr":"172.21.15.110:6805/1183571640","heartbeat_back_addr":"172.21.15.110:6809/1183571640","heartbeat_front_addr":"172.21.15.110:6807/1183571640","state":["exists","up"]},{"osd":1,"uuid":"e9b02030-b19e-481a-9b91-4f7cb561b6b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6801","nonce":4233466070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6803","nonce":4233466070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6807","nonce":4233466070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":4233466070},{"type":"v1","addr":"172.21.15.115:6805","nonce":4233466070}]},"public_addr":"172.21.15.115:6801/4233466070","cluster_addr":"172.21.15.115:6803/4233466070","heartbeat_back_addr":"172.21.15.115:6807/4233466070","heartbeat_front_addr":"172.21.15.115:6805/4233466070","state":["exists","up"]},{"osd":2,"uuid":"5383e300-6d1a-419d-ac6c-a918c7541c7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6801","nonce":1988990192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6803","nonce":1988990192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6807","nonce":1988990192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1988990192},{"type":"v1","addr":"172.21.15.136:6805","nonce":1988990192}]},"public_addr":"172.21.15.136:6801/1988990192","cluster_addr":"172.21.15.136:6803/1988990192","heartbeat_back_addr":"172.21.15.136:6807/1988990192","heartbeat_front_addr":"172.21.15.136:6805/1988990192","state":["exists","up"]},{"osd":3,"uuid":"f22237a9-ac1e-47a9-8092-d54dbf752521","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6811","nonce":938081925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6813","nonce":938081925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6817","nonce":938081925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":938081925},{"type":"v1","addr":"172.21.15.110:6815","nonce":938081925}]},"public_addr":"172.21.15.110:6811/938081925","cluster_addr":"172.21.15.110:6813/938081925","heartbeat_back_addr":"172.21.15.110:6817/938081925","heartbeat_front_addr":"172.21.15.110:6815/938081925","state":["exists","up"]},{"osd":4,"uuid":"e70c0a05-336f-4ace-8f41-682059272b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6809","nonce":3669727119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6811","nonce":3669727119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6814","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6815","nonce":3669727119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":3669727119},{"type":"v1","addr":"172.21.15.115:6813","nonce":3669727119}]},"public_addr":"172.21.15.115:6809/3669727119","cluster_addr":"172.21.15.115:6811/3669727119","heartbeat_back_addr":"172.21.15.115:6815/3669727119","heartbeat_front_addr":"172.21.15.115:6813/3669727119","state":["exists","up"]},{"osd":5,"uuid":"9e4d3a1c-22e7-460a-b1c5-5ee8b4abdeca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6809","nonce":3847045265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6811","nonce":3847045265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6815","nonce":3847045265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3847045265},{"type":"v1","addr":"172.21.15.136:6813","nonce":3847045265}]},"public_addr":"172.21.15.136:6809/3847045265","cluster_addr":"172.21.15.136:6811/3847045265","heartbeat_back_addr":"172.21.15.136:6815/3847045265","heartbeat_front_addr":"172.21.15.136:6813/3847045265","state":["exists","up"]},{"osd":6,"uuid":"2e5987bb-997f-4503-9b12-f6de1c456e69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6819","nonce":2221895141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6821","nonce":2221895141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6825","nonce":2221895141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2221895141},{"type":"v1","addr":"172.21.15.110:6823","nonce":2221895141}]},"public_addr":"172.21.15.110:6819/2221895141","cluster_addr":"172.21.15.110:6821/2221895141","heartbeat_back_addr":"172.21.15.110:6825/2221895141","heartbeat_front_addr":"172.21.15.110:6823/2221895141","state":["exists","up"]},{"osd":7,"uuid":"0736750a-3ed6-4092-8e11-5951827b7810","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6817","nonce":2297193086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6818","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6819","nonce":2297193086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6822","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6823","nonce":2297193086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":2297193086},{"type":"v1","addr":"172.21.15.115:6821","nonce":2297193086}]},"public_addr":"172.21.15.115:6817/2297193086","cluster_addr":"172.21.15.115:6819/2297193086","heartbeat_back_addr":"172.21.15.115:6823/2297193086","heartbeat_front_addr":"172.21.15.115:6821/2297193086","state":["exists","up"]},{"osd":8,"uuid":"cf7a657a-cbdd-4b88-b71c-d98a74ffec5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6817","nonce":3872859118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6819","nonce":3872859118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6823","nonce":3872859118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":3872859118},{"type":"v1","addr":"172.21.15.136:6821","nonce":3872859118}]},"public_addr":"172.21.15.136:6817/3872859118","cluster_addr":"172.21.15.136:6819/3872859118","heartbeat_back_addr":"172.21.15.136:6823/3872859118","heartbeat_front_addr":"172.21.15.136:6821/3872859118","state":["exists","up"]},{"osd":9,"uuid":"ea0c28ea-24c9-47b0-80cc-ba8ccc4d36f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6827","nonce":558612753}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6829","nonce":558612753}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6833","nonce":558612753}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":558612753},{"type":"v1","addr":"172.21.15.110:6831","nonce":558612753}]},"public_addr":"172.21.15.110:6827/558612753","cluster_addr":"172.21.15.110:6829/558612753","heartbeat_back_addr":"172.21.15.110:6833/558612753","heartbeat_front_addr":"172.21.15.110:6831/558612753","state":["exists","up"]},{"osd":10,"uuid":"9409f555-8139-4a02-9fe2-446f30072aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6825","nonce":4061070814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6826","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6827","nonce":4061070814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6830","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6831","nonce":4061070814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":4061070814},{"type":"v1","addr":"172.21.15.115:6829","nonce":4061070814}]},"public_addr":"172.21.15.115:6825/4061070814","cluster_addr":"172.21.15.115:6827/4061070814","heartbeat_back_addr":"172.21.15.115:6831/4061070814","heartbeat_front_addr":"172.21.15.115:6829/4061070814","state":["exists","up"]},{"osd":11,"uuid":"a4bd515e-6eb9-4eae-9a85-ca9a1d8e2e16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6825","nonce":1064088671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6827","nonce":1064088671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6831","nonce":1064088671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":1064088671},{"type":"v1","addr":"172.21.15.136:6829","nonce":1064088671}]},"public_addr":"172.21.15.136:6825/1064088671","cluster_addr":"172.21.15.136:6827/1064088671","heartbeat_back_addr":"172.21.15.136:6831/1064088671","heartbeat_front_addr":"172.21.15.136:6829/1064088671","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:13.917213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:06:40.143298+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:04.142449+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:33.724225+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:07:59.170730+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:25.628923+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:08:54.909043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:22.176621+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:09:47.599717+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:17.553963+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:10:44.787108+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T02:11:10.180421+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.27","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3294226687":"2024-09-13T02:15:01.680986+0000","172.21.15.110:6801/511769794":"2024-09-13T02:15:01.680986+0000","172.21.15.110:6800/511769794":"2024-09-13T02:15:01.680986+0000","172.21.15.110:0/3947837481":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6800/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/3644360562":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6801/3137576010":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/2413734786":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/667674244":"2024-09-13T02:04:17.987172+0000","172.21.15.110:6801/3368055532":"2024-09-13T02:04:17.987172+0000","172.21.15.110:0/2826731707":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/3490929121":"2024-09-13T02:04:45.356605+0000","172.21.15.110:0/1555464732":"2024-09-13T02:15:01.680986+0000","172.21.15.110:0/1450306336":"2024-09-13T02:15:01.680986+0000","172.21.15.110:0/2937283686":"2024-09-13T02:15:01.680986+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]},{"pool":4,"snaps":[{"begin":14,"length":1},{"begin":27,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T02:31:18.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.503+0000 7f0233e00640 1 -- 172.21.15.110:0/2655334665 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f02180a2cf0 msgr2=0x7f02180a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.503+0000 7f0233e00640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f02180a2cf0 0x7f02180a51b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f023410a930 tx=0x7f0220005f90 comp rx=0 tx=0).stop 2024-09-12T02:31:18.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.503+0000 7f0233e00640 1 -- 172.21.15.110:0/2655334665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0234103e30 msgr2=0x7f023419a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:18.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.503+0000 7f0233e00640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0234103e30 0x7f023419a420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f022400db80 tx=0x7f022400b630 comp rx=0 tx=0).stop 2024-09-12T02:31:18.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.503+0000 7f0233e00640 1 -- 172.21.15.110:0/2655334665 shutdown_connections 2024-09-12T02:31:18.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.503+0000 7f0233e00640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f02180a2cf0 0x7f02180a51b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.503+0000 7f0233e00640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0234108f60 0x7f023419ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.503+0000 7f0233e00640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02341047e0 0x7f023419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.503+0000 7f0233e00640 1 --2- 172.21.15.110:0/2655334665 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0234103e30 0x7f023419a420 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:18.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.503+0000 7f0233e00640 1 -- 172.21.15.110:0/2655334665 >> 172.21.15.110:0/2655334665 conn(0x7f02340ff8d0 msgr2=0x7f0234100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:18.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.504+0000 7f0233e00640 1 -- 172.21.15.110:0/2655334665 shutdown_connections 2024-09-12T02:31:18.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:18.504+0000 7f0233e00640 1 -- 172.21.15.110:0/2655334665 wait complete. 2024-09-12T02:31:18.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:18 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2655334665' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:31:18.924 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:18 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2655334665' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:31:19.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:18 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2655334665' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T02:31:19.337 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-12T02:31:19.702 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:19.840 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:19 smithi110 ceph-mon[30548]: pgmap v511: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 9 op/s 2024-09-12T02:31:19.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:19 smithi136 ceph-mon[35814]: pgmap v511: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 9 op/s 2024-09-12T02:31:20.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:19 smithi115 ceph-mon[35351]: pgmap v511: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 9 op/s 2024-09-12T02:31:20.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.443+0000 7f9486000640 1 -- 172.21.15.110:0/275054261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9480076720 msgr2=0x7f9480076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.443+0000 7f9486000640 1 --2- 172.21.15.110:0/275054261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9480076720 0x7f9480076b00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9470009900 tx=0x7f947002a3f0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.443+0000 7f9486000640 1 -- 172.21.15.110:0/275054261 shutdown_connections 2024-09-12T02:31:20.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.443+0000 7f9486000640 1 --2- 172.21.15.110:0/275054261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9480112a30 0x7f9480114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.443+0000 7f9486000640 1 --2- 172.21.15.110:0/275054261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9480077040 0x7f94801124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.443+0000 7f9486000640 1 --2- 172.21.15.110:0/275054261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9480076720 0x7f9480076b00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.443+0000 7f9486000640 1 -- 172.21.15.110:0/275054261 >> 172.21.15.110:0/275054261 conn(0x7f94800ffa90 msgr2=0x7f9480101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:20.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.443+0000 7f9486000640 1 -- 172.21.15.110:0/275054261 shutdown_connections 2024-09-12T02:31:20.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.443+0000 7f9486000640 1 -- 172.21.15.110:0/275054261 wait complete. 2024-09-12T02:31:20.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.444+0000 7f9486000640 1 Processor -- start 2024-09-12T02:31:20.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.444+0000 7f9486000640 1 -- start start 2024-09-12T02:31:20.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f9486000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9480076720 0x7f94801a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f9486000640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9480077040 0x7f94801a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f9486000640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9480112a30 0x7f948019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f9486000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f9480118610 con 0x7f9480076720 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f9486000640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9480118490 con 0x7f9480077040 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f9486000640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9480118790 con 0x7f9480112a30 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f947f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9480076720 0x7f94801a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f947fe00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9480112a30 0x7f948019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f947f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9480076720 0x7f94801a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:52988/0 (socket says 172.21.15.110:52988) 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f947f400640 1 -- 172.21.15.110:0/4231379939 learned_addr learned my addr 172.21.15.110:0/4231379939 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f947ea00640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9480077040 0x7f94801a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f947fe00640 1 -- 172.21.15.110:0/4231379939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9480077040 msgr2=0x7f94801a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f947fe00640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9480077040 0x7f94801a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f947fe00640 1 -- 172.21.15.110:0/4231379939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9480076720 msgr2=0x7f94801a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f947fe00640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9480076720 0x7f94801a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.445+0000 7f947fe00640 1 -- 172.21.15.110:0/4231379939 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948019eff0 con 0x7f9480112a30 2024-09-12T02:31:20.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.446+0000 7f947fe00640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9480112a30 0x7f948019e8c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f948007aa10 tx=0x7f947800dea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:20.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.446+0000 7f9477e00640 1 -- 172.21.15.110:0/4231379939 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947800bd40 con 0x7f9480112a30 2024-09-12T02:31:20.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.446+0000 7f9486000640 1 -- 172.21.15.110:0/4231379939 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948019f2e0 con 0x7f9480112a30 2024-09-12T02:31:20.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.446+0000 7f9477e00640 1 -- 172.21.15.110:0/4231379939 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9478003e50 con 0x7f9480112a30 2024-09-12T02:31:20.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.446+0000 7f9477e00640 1 -- 172.21.15.110:0/4231379939 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94780106c0 con 0x7f9480112a30 2024-09-12T02:31:20.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.446+0000 7f9486000640 1 -- 172.21.15.110:0/4231379939 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94801ab5d0 con 0x7f9480112a30 2024-09-12T02:31:20.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.447+0000 7f9486000640 1 -- 172.21.15.110:0/4231379939 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9480076b00 con 0x7f9480112a30 2024-09-12T02:31:20.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.449+0000 7f9477e00640 1 -- 172.21.15.110:0/4231379939 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f9478003970 con 0x7f9480112a30 2024-09-12T02:31:20.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.451+0000 7f9477e00640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f94640a2cf0 0x7f94640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:20.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.451+0000 7f9477e00640 1 -- 172.21.15.110:0/4231379939 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9504+0+0 (secure 0 0 0) 0x7f94780cfe80 con 0x7f9480112a30 2024-09-12T02:31:20.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.451+0000 7f947f400640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f94640a2cf0 0x7f94640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:20.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.452+0000 7f947f400640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f94640a2cf0 0x7f94640a51b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f94700096c0 tx=0x7f94700046c0 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:20.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.453+0000 7f9477e00640 1 -- 172.21.15.110:0/4231379939 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f947809c690 con 0x7f9480112a30 2024-09-12T02:31:20.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.666+0000 7f9486000640 1 -- 172.21.15.110:0/4231379939 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f948019fdf0 con 0x7f9480112a30 2024-09-12T02:31:20.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.675+0000 7f9477e00640 1 -- 172.21.15.110:0/4231379939 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) ==== 161+0+0 (secure 0 0 0) 0x7f948019fdf0 con 0x7f9480112a30 2024-09-12T02:31:20.933 INFO:teuthology.orchestra.run.smithi110.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T02:31:20.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.678+0000 7f9486000640 1 -- 172.21.15.110:0/4231379939 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f94640a2cf0 msgr2=0x7f94640a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.678+0000 7f9486000640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f94640a2cf0 0x7f94640a51b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f94700096c0 tx=0x7f94700046c0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.678+0000 7f9486000640 1 -- 172.21.15.110:0/4231379939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9480112a30 msgr2=0x7f948019e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:20.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.678+0000 7f9486000640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9480112a30 0x7f948019e8c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f948007aa10 tx=0x7f947800dea0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.678+0000 7f9486000640 1 -- 172.21.15.110:0/4231379939 shutdown_connections 2024-09-12T02:31:20.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.678+0000 7f9486000640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f94640a2cf0 0x7f94640a51b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.678+0000 7f9486000640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9480112a30 0x7f948019e8c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.678+0000 7f9486000640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9480077040 0x7f94801a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.678+0000 7f9486000640 1 --2- 172.21.15.110:0/4231379939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9480076720 0x7f94801a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:20.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.678+0000 7f9486000640 1 -- 172.21.15.110:0/4231379939 >> 172.21.15.110:0/4231379939 conn(0x7f94800ffa90 msgr2=0x7f9480101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:20.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.678+0000 7f9486000640 1 -- 172.21.15.110:0/4231379939 shutdown_connections 2024-09-12T02:31:20.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:20.678+0000 7f9486000640 1 -- 172.21.15.110:0/4231379939 wait complete. 2024-09-12T02:31:20.934 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:20 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a[30544]: 2024-09-12T02:31:20.667+0000 7f558b200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:31:21.046 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:31:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b[65150]: ignoring --setuser ceph since I am not root 2024-09-12T02:31:21.046 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:31:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b[65150]: ignoring --setgroup ceph since I am not root 2024-09-12T02:31:21.046 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:31:20 smithi115 ceph-mds[65154]: -- 172.21.15.115:0/1088705801 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a41e233c20 con 0x55a41e210800 2024-09-12T02:31:21.046 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:31:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b[65150]: starting mds.b at 2024-09-12T02:31:21.046 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:31:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h[64847]: ignoring --setuser ceph since I am not root 2024-09-12T02:31:21.047 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:31:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h[64847]: ignoring --setgroup ceph since I am not root 2024-09-12T02:31:21.047 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:31:20 smithi115 ceph-mds[64851]: -- 172.21.15.115:0/4011040438 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aaae45fc20 con 0x55aaae43d000 2024-09-12T02:31:21.047 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:31:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h[64847]: starting mds.h at 2024-09-12T02:31:21.047 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:31:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h[64847]: 2024-09-12T02:31:20.744+0000 7fc25debd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6836/0: (98) Address already in use 2024-09-12T02:31:21.131 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:31:20 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a[72164]: ignoring --setuser ceph since I am not root 2024-09-12T02:31:21.131 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:31:20 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a[72164]: ignoring --setgroup ceph since I am not root 2024-09-12T02:31:21.131 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:31:20 smithi110 ceph-mds[72171]: -- 172.21.15.110:0/3420975537 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559ec2de1860 con 0x559ec2dbf000 2024-09-12T02:31:21.131 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:31:20 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a[72164]: starting mds.a at 2024-09-12T02:31:21.159 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:31:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-f[65776]: ignoring --setuser ceph since I am not root 2024-09-12T02:31:21.159 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:31:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-f[65776]: ignoring --setgroup ceph since I am not root 2024-09-12T02:31:21.159 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:31:20 smithi136 ceph-mds[65780]: -- 172.21.15.136:0/4143738087 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560efaaf3c20 con 0x560efaad0800 2024-09-12T02:31:21.160 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:31:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-f[65776]: starting mds.f at 2024-09-12T02:31:21.160 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:31:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c[66075]: ignoring --setuser ceph since I am not root 2024-09-12T02:31:21.160 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:31:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c[66075]: ignoring --setgroup ceph since I am not root 2024-09-12T02:31:21.160 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:31:20 smithi136 ceph-mds[66079]: -- 172.21.15.136:0/2337684306 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563b9de9d860 con 0x563b9de7b400 2024-09-12T02:31:21.160 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:31:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c[66075]: starting mds.c at 2024-09-12T02:31:21.160 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:31:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-i[66380]: ignoring --setuser ceph since I am not root 2024-09-12T02:31:21.160 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:31:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-i[66380]: ignoring --setgroup ceph since I am not root 2024-09-12T02:31:21.161 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:31:20 smithi136 ceph-mds[66384]: -- 172.21.15.136:0/3575004588 <== mon.2 v2:172.21.15.115:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55991d9cb860 con 0x55991d9a8800 2024-09-12T02:31:21.161 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:31:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-i[66380]: starting mds.i at 2024-09-12T02:31:21.550 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T02:31:21.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:21 smithi136 ceph-mon[35814]: pgmap v512: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 78 KiB/s wr, 9 op/s 2024-09-12T02:31:21.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:21 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/4231379939' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:31:21.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:21 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:31:21.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:21 smithi136 ceph-mon[35814]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:31:21.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:21 smithi136 ceph-mon[35814]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:31:21.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:21 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:31:21.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:21 smithi136 ceph-mon[35814]: osdmap e119: 12 total, 12 up, 12 in 2024-09-12T02:31:21.910 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:21 smithi136 ceph-mon[35814]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T02:31:21.925 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:21.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:21 smithi110 ceph-mon[30548]: pgmap v512: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 78 KiB/s wr, 9 op/s 2024-09-12T02:31:21.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:21 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/4231379939' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:31:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:21 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:31:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:21 smithi110 ceph-mon[30548]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:31:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:21 smithi110 ceph-mon[30548]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:31:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:21 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:31:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:21 smithi110 ceph-mon[30548]: osdmap e119: 12 total, 12 up, 12 in 2024-09-12T02:31:21.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:21 smithi110 ceph-mon[30548]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T02:31:22.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:21 smithi115 ceph-mon[35351]: pgmap v512: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 78 KiB/s wr, 9 op/s 2024-09-12T02:31:22.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:21 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/4231379939' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:31:22.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:21 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-12T02:31:22.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:21 smithi115 ceph-mon[35351]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T02:31:22.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:21 smithi115 ceph-mon[35351]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T02:31:22.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:21 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-12T02:31:22.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:21 smithi115 ceph-mon[35351]: osdmap e119: 12 total, 12 up, 12 in 2024-09-12T02:31:22.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:21 smithi115 ceph-mon[35351]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-12T02:31:22.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.517+0000 7f6c33c00640 1 -- 172.21.15.110:0/788890001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2c106f10 msgr2=0x7f6c2c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:22.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.517+0000 7f6c33c00640 1 --2- 172.21.15.110:0/788890001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2c106f10 0x7f6c2c10ea90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009ca0 tx=0x7f6c2402a8c0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.517+0000 7f6c33c00640 1 -- 172.21.15.110:0/788890001 shutdown_connections 2024-09-12T02:31:22.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.517+0000 7f6c33c00640 1 --2- 172.21.15.110:0/788890001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2c106f10 0x7f6c2c10ea90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.517+0000 7f6c33c00640 1 --2- 172.21.15.110:0/788890001 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c2c102790 0x7f6c2c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.517+0000 7f6c33c00640 1 --2- 172.21.15.110:0/788890001 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c2c101de0 0x7f6c2c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.517+0000 7f6c33c00640 1 -- 172.21.15.110:0/788890001 >> 172.21.15.110:0/788890001 conn(0x7f6c2c0fd8c0 msgr2=0x7f6c2c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:22.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.518+0000 7f6c33c00640 1 -- 172.21.15.110:0/788890001 shutdown_connections 2024-09-12T02:31:22.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.518+0000 7f6c33c00640 1 -- 172.21.15.110:0/788890001 wait complete. 2024-09-12T02:31:22.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.518+0000 7f6c33c00640 1 Processor -- start 2024-09-12T02:31:22.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.519+0000 7f6c33c00640 1 -- start start 2024-09-12T02:31:22.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.519+0000 7f6c33c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2c101de0 0x7f6c2c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.519+0000 7f6c33c00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c2c102790 0x7f6c2c19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.519+0000 7f6c33c00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c2c106f10 0x7f6c2c19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.519+0000 7f6c33c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c111fc0 con 0x7f6c2c101de0 2024-09-12T02:31:22.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.519+0000 7f6c33c00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c111e40 con 0x7f6c2c106f10 2024-09-12T02:31:22.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.519+0000 7f6c33c00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c112140 con 0x7f6c2c102790 2024-09-12T02:31:22.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.519+0000 7f6c31200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2c101de0 0x7f6c2c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.519+0000 7f6c31200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2c101de0 0x7f6c2c19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53038/0 (socket says 172.21.15.110:53038) 2024-09-12T02:31:22.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.519+0000 7f6c31200640 1 -- 172.21.15.110:0/2760474189 learned_addr learned my addr 172.21.15.110:0/2760474189 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:31:22.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.519+0000 7f6c23e00640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c2c102790 0x7f6c2c19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.519+0000 7f6c31c00640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c2c106f10 0x7f6c2c19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.520+0000 7f6c31200640 1 -- 172.21.15.110:0/2760474189 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c2c102790 msgr2=0x7f6c2c19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.520+0000 7f6c31200640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c2c102790 0x7f6c2c19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.520+0000 7f6c31200640 1 -- 172.21.15.110:0/2760474189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c2c106f10 msgr2=0x7f6c2c19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.520+0000 7f6c31200640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c2c106f10 0x7f6c2c19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.520+0000 7f6c31200640 1 -- 172.21.15.110:0/2760474189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c19f590 con 0x7f6c2c101de0 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.520+0000 7f6c31c00640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c2c106f10 0x7f6c2c19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.520+0000 7f6c31200640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2c101de0 0x7f6c2c19a5e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00e9f0 tx=0x7f6c1c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.520+0000 7f6c2a000640 1 -- 172.21.15.110:0/2760474189 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c00cd80 con 0x7f6c2c101de0 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.520+0000 7f6c2a000640 1 -- 172.21.15.110:0/2760474189 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c1c010910 con 0x7f6c2c101de0 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.520+0000 7f6c2a000640 1 -- 172.21.15.110:0/2760474189 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c018990 con 0x7f6c2c101de0 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.520+0000 7f6c33c00640 1 -- 172.21.15.110:0/2760474189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c19f880 con 0x7f6c2c101de0 2024-09-12T02:31:22.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.520+0000 7f6c33c00640 1 -- 172.21.15.110:0/2760474189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c1a7160 con 0x7f6c2c101de0 2024-09-12T02:31:22.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.522+0000 7f6c33c00640 1 -- 172.21.15.110:0/2760474189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c2c1021c0 con 0x7f6c2c101de0 2024-09-12T02:31:22.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.523+0000 7f6c2a000640 1 -- 172.21.15.110:0/2760474189 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f6c1c010ac0 con 0x7f6c2c101de0 2024-09-12T02:31:22.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.525+0000 7f6c2a000640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f6c100a2cf0 0x7f6c100a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:22.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.525+0000 7f6c2a000640 1 -- 172.21.15.110:0/2760474189 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9674+0+0 (secure 0 0 0) 0x7f6c1c0cfcf0 con 0x7f6c2c101de0 2024-09-12T02:31:22.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.525+0000 7f6c23e00640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f6c100a2cf0 0x7f6c100a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:22.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.526+0000 7f6c23e00640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f6c100a2cf0 0x7f6c100a51b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c076480 tx=0x7f6c1400b390 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:22.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.529+0000 7f6c2a000640 1 -- 172.21.15.110:0/2760474189 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6c1c09c430 con 0x7f6c2c101de0 2024-09-12T02:31:22.677 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.115:6837/1229190778,v1:172.21.15.115:6839/1229190778] up:boot 2024-09-12T02:31:22.677 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.115:6836/14119278,v1:172.21.15.115:6838/14119278] up:boot 2024-09-12T02:31:22.677 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.136:6834/1389267599,v1:172.21.15.136:6837/1389267599] up:boot 2024-09-12T02:31:22.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:22.741+0000 7f6c33c00640 1 -- 172.21.15.110:0/2760474189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6c2c1a7400 con 0x7f6c2c101de0 2024-09-12T02:31:22.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.136:6835/2738524339,v1:172.21.15.136:6838/2738524339] up:boot 2024-09-12T02:31:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.136:6836/666014805,v1:172.21.15.136:6839/666014805] up:boot 2024-09-12T02:31:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: mds.? [v2:172.21.15.110:6840/3413201599,v1:172.21.15.110:6841/3413201599] up:boot 2024-09-12T02:31:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T02:31:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:31:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:31:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:31:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:31:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:31:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:31:22.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:22 smithi110 ceph-mon[30548]: pgmap v514: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 54 KiB/s wr, 9 op/s 2024-09-12T02:31:23.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.115:6837/1229190778,v1:172.21.15.115:6839/1229190778] up:boot 2024-09-12T02:31:23.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.115:6836/14119278,v1:172.21.15.115:6838/14119278] up:boot 2024-09-12T02:31:23.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.136:6834/1389267599,v1:172.21.15.136:6837/1389267599] up:boot 2024-09-12T02:31:23.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.136:6835/2738524339,v1:172.21.15.136:6838/2738524339] up:boot 2024-09-12T02:31:23.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.136:6836/666014805,v1:172.21.15.136:6839/666014805] up:boot 2024-09-12T02:31:23.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: mds.? [v2:172.21.15.110:6840/3413201599,v1:172.21.15.110:6841/3413201599] up:boot 2024-09-12T02:31:23.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T02:31:23.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:31:23.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:31:23.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:31:23.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:31:23.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:31:23.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:31:23.046 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:22 smithi115 ceph-mon[35351]: pgmap v514: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 54 KiB/s wr, 9 op/s 2024-09-12T02:31:23.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.115:6837/1229190778,v1:172.21.15.115:6839/1229190778] up:boot 2024-09-12T02:31:23.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.115:6836/14119278,v1:172.21.15.115:6838/14119278] up:boot 2024-09-12T02:31:23.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.136:6834/1389267599,v1:172.21.15.136:6837/1389267599] up:boot 2024-09-12T02:31:23.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.136:6835/2738524339,v1:172.21.15.136:6838/2738524339] up:boot 2024-09-12T02:31:23.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.136:6836/666014805,v1:172.21.15.136:6839/666014805] up:boot 2024-09-12T02:31:23.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: mds.? [v2:172.21.15.110:6840/3413201599,v1:172.21.15.110:6841/3413201599] up:boot 2024-09-12T02:31:23.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-12T02:31:23.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-12T02:31:23.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-12T02:31:23.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-12T02:31:23.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-12T02:31:23.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-12T02:31:23.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: from='mgr.15147 172.21.15.110:0/1599368747' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-12T02:31:23.160 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:22 smithi136 ceph-mon[35814]: pgmap v514: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 54 KiB/s wr, 9 op/s 2024-09-12T02:31:23.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.682+0000 7f6c2a000640 1 -- 172.21.15.110:0/2760474189 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7f6c1c09bd30 con 0x7f6c2c101de0 2024-09-12T02:31:23.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.685+0000 7f6c33c00640 1 -- 172.21.15.110:0/2760474189 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f6c100a2cf0 msgr2=0x7f6c100a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:23.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.685+0000 7f6c33c00640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f6c100a2cf0 0x7f6c100a51b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c076480 tx=0x7f6c1400b390 comp rx=0 tx=0).stop 2024-09-12T02:31:23.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.685+0000 7f6c33c00640 1 -- 172.21.15.110:0/2760474189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2c101de0 msgr2=0x7f6c2c19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.685+0000 7f6c33c00640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2c101de0 0x7f6c2c19a5e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00e9f0 tx=0x7f6c1c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:31:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.685+0000 7f6c33c00640 1 -- 172.21.15.110:0/2760474189 shutdown_connections 2024-09-12T02:31:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.685+0000 7f6c33c00640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7f6c100a2cf0 0x7f6c100a51b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.685+0000 7f6c33c00640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6c2c106f10 0x7f6c2c19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.685+0000 7f6c33c00640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c2c102790 0x7f6c2c19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.685+0000 7f6c33c00640 1 --2- 172.21.15.110:0/2760474189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2c101de0 0x7f6c2c19a5e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.685+0000 7f6c33c00640 1 -- 172.21.15.110:0/2760474189 >> 172.21.15.110:0/2760474189 conn(0x7f6c2c0fd8c0 msgr2=0x7f6c2c0fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.685+0000 7f6c33c00640 1 -- 172.21.15.110:0/2760474189 shutdown_connections 2024-09-12T02:31:23.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:23.686+0000 7f6c33c00640 1 -- 172.21.15.110:0/2760474189 wait complete. 2024-09-12T02:31:23.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:23 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2760474189' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:31:24.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:23 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2760474189' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:31:24.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:23 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2760474189' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T02:31:24.526 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T02:31:24.728 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:24 smithi110 ceph-mon[30548]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:31:24.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:24 smithi110 ceph-mon[30548]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:31:24.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:24 smithi110 ceph-mon[30548]: Cluster is now healthy 2024-09-12T02:31:24.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:24 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2760474189' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:31:24.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:24 smithi110 ceph-mon[30548]: fsmap 12 up:standby 2024-09-12T02:31:24.729 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:24 smithi110 ceph-mon[30548]: pgmap v515: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-09-12T02:31:24.918 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:24 smithi115 ceph-mon[35351]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:31:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:24 smithi115 ceph-mon[35351]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:31:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:24 smithi115 ceph-mon[35351]: Cluster is now healthy 2024-09-12T02:31:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:24 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2760474189' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:31:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:24 smithi115 ceph-mon[35351]: fsmap 12 up:standby 2024-09-12T02:31:25.045 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:24 smithi115 ceph-mon[35351]: pgmap v515: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-09-12T02:31:25.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:24 smithi136 ceph-mon[35814]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T02:31:25.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:24 smithi136 ceph-mon[35814]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T02:31:25.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:24 smithi136 ceph-mon[35814]: Cluster is now healthy 2024-09-12T02:31:25.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:24 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2760474189' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-12T02:31:25.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:24 smithi136 ceph-mon[35814]: fsmap 12 up:standby 2024-09-12T02:31:25.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:24 smithi136 ceph-mon[35814]: pgmap v515: 129 pgs: 129 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-09-12T02:31:25.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.595+0000 7fdae1800640 1 -- 172.21.15.110:0/4217784942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc1049c0 msgr2=0x7fdadc108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:25.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.595+0000 7fdae1800640 1 --2- 172.21.15.110:0/4217784942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc1049c0 0x7fdadc108a10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009900 tx=0x7fdac802a410 comp rx=0 tx=0).stop 2024-09-12T02:31:25.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.595+0000 7fdae1800640 1 -- 172.21.15.110:0/4217784942 shutdown_connections 2024-09-12T02:31:25.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.595+0000 7fdae1800640 1 --2- 172.21.15.110:0/4217784942 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc109140 0x7fdadc110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:25.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.595+0000 7fdae1800640 1 --2- 172.21.15.110:0/4217784942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc1049c0 0x7fdadc108a10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:25.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.595+0000 7fdae1800640 1 --2- 172.21.15.110:0/4217784942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc104010 0x7fdadc1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:25.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.595+0000 7fdae1800640 1 -- 172.21.15.110:0/4217784942 >> 172.21.15.110:0/4217784942 conn(0x7fdadc0ffa50 msgr2=0x7fdadc101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:25.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.595+0000 7fdae1800640 1 -- 172.21.15.110:0/4217784942 shutdown_connections 2024-09-12T02:31:25.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.596+0000 7fdae1800640 1 -- 172.21.15.110:0/4217784942 wait complete. 2024-09-12T02:31:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.596+0000 7fdae1800640 1 Processor -- start 2024-09-12T02:31:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdae1800640 1 -- start start 2024-09-12T02:31:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdae1800640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc104010 0x7fdadc19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdae1800640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc1049c0 0x7fdadc19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdae1800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc109140 0x7fdadc19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdae1800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc114160 con 0x7fdadc109140 2024-09-12T02:31:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdae1800640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc113fe0 con 0x7fdadc1049c0 2024-09-12T02:31:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdae1800640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc1142e0 con 0x7fdadc104010 2024-09-12T02:31:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdadb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc109140 0x7fdadc19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:25.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdadaa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc104010 0x7fdadc19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdadb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc109140 0x7fdadc19ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53058/0 (socket says 172.21.15.110:53058) 2024-09-12T02:31:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdadb400640 1 -- 172.21.15.110:0/57656179 learned_addr learned my addr 172.21.15.110:0/57656179 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:31:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdadaa00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc104010 0x7fdadc19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:37308/0 (socket says 172.21.15.110:37308) 2024-09-12T02:31:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.597+0000 7fdada000640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc1049c0 0x7fdadc19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.598+0000 7fdadaa00640 1 -- 172.21.15.110:0/57656179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc1049c0 msgr2=0x7fdadc19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.598+0000 7fdadaa00640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc1049c0 0x7fdadc19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.598+0000 7fdadaa00640 1 -- 172.21.15.110:0/57656179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc109140 msgr2=0x7fdadc19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.598+0000 7fdadaa00640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc109140 0x7fdadc19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.598+0000 7fdadaa00640 1 -- 172.21.15.110:0/57656179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc19f610 con 0x7fdadc104010 2024-09-12T02:31:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.598+0000 7fdadaa00640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc104010 0x7fdadc19a660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00e9f0 tx=0x7fdacc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.598+0000 7fdad3400640 1 -- 172.21.15.110:0/57656179 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00ccc0 con 0x7fdadc104010 2024-09-12T02:31:25.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.598+0000 7fdae1800640 1 -- 172.21.15.110:0/57656179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdadc19f900 con 0x7fdadc104010 2024-09-12T02:31:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.598+0000 7fdad3400640 1 -- 172.21.15.110:0/57656179 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdacc005020 con 0x7fdadc104010 2024-09-12T02:31:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.598+0000 7fdad3400640 1 -- 172.21.15.110:0/57656179 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdacc0049e0 con 0x7fdadc104010 2024-09-12T02:31:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.599+0000 7fdae1800640 1 -- 172.21.15.110:0/57656179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdadc1a71e0 con 0x7fdadc104010 2024-09-12T02:31:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.600+0000 7fdae1800640 1 -- 172.21.15.110:0/57656179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdadc1043f0 con 0x7fdadc104010 2024-09-12T02:31:25.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.602+0000 7fdad3400640 1 -- 172.21.15.110:0/57656179 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fdacc005560 con 0x7fdadc104010 2024-09-12T02:31:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.603+0000 7fdad3400640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fdac00a2cf0 0x7fdac00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.603+0000 7fdad3400640 1 -- 172.21.15.110:0/57656179 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9674+0+0 (secure 0 0 0) 0x7fdacc0cf940 con 0x7fdadc104010 2024-09-12T02:31:25.604 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.603+0000 7fdada000640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fdac00a2cf0 0x7fdac00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:25.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.604+0000 7fdada000640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fdac00a2cf0 0x7fdac00a51b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009230 tx=0x7fdac80058d0 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:25.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.605+0000 7fdad3400640 1 -- 172.21.15.110:0/57656179 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdacc0051d0 con 0x7fdadc104010 2024-09-12T02:31:25.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.781+0000 7fdae1800640 1 -- 172.21.15.110:0/57656179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdadc19b9c0 con 0x7fdadc104010 2024-09-12T02:31:25.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.845+0000 7fdad3400640 1 -- 172.21.15.110:0/57656179 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) ==== 181+0+0 (secure 0 0 0) 0x7fdacc09c110 con 0x7fdadc104010 2024-09-12T02:31:25.846 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' removed 2024-09-12T02:31:25.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.847+0000 7fdae1800640 1 -- 172.21.15.110:0/57656179 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fdac00a2cf0 msgr2=0x7fdac00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:25.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.847+0000 7fdae1800640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fdac00a2cf0 0x7fdac00a51b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdac8009230 tx=0x7fdac80058d0 comp rx=0 tx=0).stop 2024-09-12T02:31:25.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.847+0000 7fdae1800640 1 -- 172.21.15.110:0/57656179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc104010 msgr2=0x7fdadc19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:25.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.847+0000 7fdae1800640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc104010 0x7fdadc19a660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00e9f0 tx=0x7fdacc00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:31:25.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.847+0000 7fdae1800640 1 -- 172.21.15.110:0/57656179 shutdown_connections 2024-09-12T02:31:25.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.847+0000 7fdae1800640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fdac00a2cf0 0x7fdac00a51b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:25.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.847+0000 7fdae1800640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc109140 0x7fdadc19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:25.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.847+0000 7fdae1800640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdadc1049c0 0x7fdadc19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:25.849 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:25 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/57656179' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:25.849 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:25 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:25.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.847+0000 7fdae1800640 1 --2- 172.21.15.110:0/57656179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdadc104010 0x7fdadc19a660 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:25.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.847+0000 7fdae1800640 1 -- 172.21.15.110:0/57656179 >> 172.21.15.110:0/57656179 conn(0x7fdadc0ffa50 msgr2=0x7fdadc100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:25.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.848+0000 7fdae1800640 1 -- 172.21.15.110:0/57656179 shutdown_connections 2024-09-12T02:31:25.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:25.848+0000 7fdae1800640 1 -- 172.21.15.110:0/57656179 wait complete. 2024-09-12T02:31:26.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:25 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/57656179' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:26.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:25 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:26.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:25 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/57656179' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:26.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:25 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:26.699 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T02:31:26.936 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:26 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:31:26.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:26 smithi110 ceph-mon[30548]: osdmap e120: 12 total, 12 up, 12 in 2024-09-12T02:31:26.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:26 smithi110 ceph-mon[30548]: pgmap v517: 97 pgs: 97 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:31:27.073 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:26 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:31:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:26 smithi136 ceph-mon[35814]: osdmap e120: 12 total, 12 up, 12 in 2024-09-12T02:31:27.159 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:26 smithi136 ceph-mon[35814]: pgmap v517: 97 pgs: 97 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:31:27.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:26 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:31:27.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:26 smithi115 ceph-mon[35351]: osdmap e120: 12 total, 12 up, 12 in 2024-09-12T02:31:27.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:26 smithi115 ceph-mon[35351]: pgmap v517: 97 pgs: 97 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:31:27.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.729+0000 7fd1a7200640 1 -- 172.21.15.110:0/3390303548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a810e2d0 msgr2=0x7fd1a81106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:27.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.729+0000 7fd1a7200640 1 --2- 172.21.15.110:0/3390303548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a810e2d0 0x7fd1a81106c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0009ca0 tx=0x7fd1a002a8c0 comp rx=0 tx=0).stop 2024-09-12T02:31:27.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.729+0000 7fd1a7200640 1 -- 172.21.15.110:0/3390303548 shutdown_connections 2024-09-12T02:31:27.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.729+0000 7fd1a7200640 1 --2- 172.21.15.110:0/3390303548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a810e2d0 0x7fd1a81106c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:27.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.729+0000 7fd1a7200640 1 --2- 172.21.15.110:0/3390303548 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1a81010d0 0x7fd1a810dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:27.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.729+0000 7fd1a7200640 1 --2- 172.21.15.110:0/3390303548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a8100720 0x7fd1a8100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:27.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.729+0000 7fd1a7200640 1 -- 172.21.15.110:0/3390303548 >> 172.21.15.110:0/3390303548 conn(0x7fd1a80fc610 msgr2=0x7fd1a80fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:27.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.729+0000 7fd1a7200640 1 -- 172.21.15.110:0/3390303548 shutdown_connections 2024-09-12T02:31:27.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.729+0000 7fd1a7200640 1 -- 172.21.15.110:0/3390303548 wait complete. 2024-09-12T02:31:27.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.730+0000 7fd1a7200640 1 Processor -- start 2024-09-12T02:31:27.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.730+0000 7fd1a7200640 1 -- start start 2024-09-12T02:31:27.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a7200640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1a8100720 0x7fd1a819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:27.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a7200640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a81010d0 0x7fd1a819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:27.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a810e2d0 0x7fd1a819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:27.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a7200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a8114020 con 0x7fd1a810e2d0 2024-09-12T02:31:27.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a7200640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a8113ea0 con 0x7fd1a81010d0 2024-09-12T02:31:27.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a7200640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a81141a0 con 0x7fd1a8100720 2024-09-12T02:31:27.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a810e2d0 0x7fd1a819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:27.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a5e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1a8100720 0x7fd1a819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:27.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a5e00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1a8100720 0x7fd1a819a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.110:37314/0 (socket says 172.21.15.110:37314) 2024-09-12T02:31:27.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a5e00640 1 -- 172.21.15.110:0/2559526420 learned_addr learned my addr 172.21.15.110:0/2559526420 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:31:27.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd19d400640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a81010d0 0x7fd1a819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:27.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a5e00640 1 -- 172.21.15.110:0/2559526420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a81010d0 msgr2=0x7fd1a819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:27.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a5e00640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a81010d0 0x7fd1a819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:27.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.731+0000 7fd1a5e00640 1 -- 172.21.15.110:0/2559526420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a810e2d0 msgr2=0x7fd1a819edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:27.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.732+0000 7fd1a5e00640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a810e2d0 0x7fd1a819edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:27.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.732+0000 7fd1a5e00640 1 -- 172.21.15.110:0/2559526420 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a819f4b0 con 0x7fd1a8100720 2024-09-12T02:31:27.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.732+0000 7fd1a5e00640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1a8100720 0x7fd1a819a500 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd19800e9f0 tx=0x7fd19800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:27.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.732+0000 7fd19f400640 1 -- 172.21.15.110:0/2559526420 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19800cd80 con 0x7fd1a8100720 2024-09-12T02:31:27.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.732+0000 7fd1a7200640 1 -- 172.21.15.110:0/2559526420 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a819f7a0 con 0x7fd1a8100720 2024-09-12T02:31:27.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.732+0000 7fd19f400640 1 -- 172.21.15.110:0/2559526420 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd198010910 con 0x7fd1a8100720 2024-09-12T02:31:27.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.732+0000 7fd19f400640 1 -- 172.21.15.110:0/2559526420 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1980188f0 con 0x7fd1a8100720 2024-09-12T02:31:27.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.732+0000 7fd1a7200640 1 -- 172.21.15.110:0/2559526420 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a81a7080 con 0x7fd1a8100720 2024-09-12T02:31:27.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.733+0000 7fd1a7200640 1 -- 172.21.15.110:0/2559526420 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1a8100b00 con 0x7fd1a8100720 2024-09-12T02:31:27.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.736+0000 7fd19f400640 1 -- 172.21.15.110:0/2559526420 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fd198010ac0 con 0x7fd1a8100720 2024-09-12T02:31:27.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.737+0000 7fd19f400640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fd18c0a2cf0 0x7fd18c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:27.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.737+0000 7fd19f400640 1 -- 172.21.15.110:0/2559526420 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9141+0+0 (secure 0 0 0) 0x7fd1980cfeb0 con 0x7fd1a8100720 2024-09-12T02:31:27.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.737+0000 7fd19d400640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fd18c0a2cf0 0x7fd18c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:27.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.738+0000 7fd19d400640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fd18c0a2cf0 0x7fd18c0a51b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8102160 tx=0x7fd190005f90 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:27.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.739+0000 7fd19f400640 1 -- 172.21.15.110:0/2559526420 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd19809c1b0 con 0x7fd1a8100720 2024-09-12T02:31:27.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.917+0000 7fd1a7200640 1 -- 172.21.15.110:0/2559526420 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd1a819b860 con 0x7fd1a8100720 2024-09-12T02:31:27.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.974+0000 7fd19f400640 1 -- 172.21.15.110:0/2559526420 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) ==== 169+0+0 (secure 0 0 0) 0x7fd1980a04b0 con 0x7fd1a8100720 2024-09-12T02:31:27.976 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' removed 2024-09-12T02:31:27.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.977+0000 7fd1a7200640 1 -- 172.21.15.110:0/2559526420 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fd18c0a2cf0 msgr2=0x7fd18c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:27.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.977+0000 7fd1a7200640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fd18c0a2cf0 0x7fd18c0a51b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8102160 tx=0x7fd190005f90 comp rx=0 tx=0).stop 2024-09-12T02:31:27.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.977+0000 7fd1a7200640 1 -- 172.21.15.110:0/2559526420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1a8100720 msgr2=0x7fd1a819a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:27.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.977+0000 7fd1a7200640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1a8100720 0x7fd1a819a500 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd19800e9f0 tx=0x7fd19800eeb0 comp rx=0 tx=0).stop 2024-09-12T02:31:27.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.977+0000 7fd1a7200640 1 -- 172.21.15.110:0/2559526420 shutdown_connections 2024-09-12T02:31:27.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.977+0000 7fd1a7200640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7fd18c0a2cf0 0x7fd18c0a51b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:27.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.977+0000 7fd1a7200640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1a810e2d0 0x7fd1a819edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:27.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.977+0000 7fd1a7200640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd1a81010d0 0x7fd1a819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:27.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.977+0000 7fd1a7200640 1 --2- 172.21.15.110:0/2559526420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd1a8100720 0x7fd1a819a500 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:27.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.977+0000 7fd1a7200640 1 -- 172.21.15.110:0/2559526420 >> 172.21.15.110:0/2559526420 conn(0x7fd1a80fc610 msgr2=0x7fd1a80fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:27.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.977+0000 7fd1a7200640 1 -- 172.21.15.110:0/2559526420 shutdown_connections 2024-09-12T02:31:27.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:27.978+0000 7fd1a7200640 1 -- 172.21.15.110:0/2559526420 wait complete. 2024-09-12T02:31:28.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:27 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/2559526420' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:28.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:27 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:28.296 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:27 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/2559526420' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:28.296 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:27 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:28.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:27 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/2559526420' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:28.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:27 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:28.790 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc shell --fsid 10ead734-70ab-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-12T02:31:29.158 INFO:teuthology.orchestra.run.smithi110.stderr:Inferring config /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/mon.a/config 2024-09-12T02:31:29.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:28 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:31:29.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:28 smithi110 ceph-mon[30548]: osdmap e121: 12 total, 12 up, 12 in 2024-09-12T02:31:29.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:28 smithi110 ceph-mon[30548]: pgmap v519: 33 pgs: 33 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:31:29.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:28 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:31:29.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:28 smithi115 ceph-mon[35351]: osdmap e121: 12 total, 12 up, 12 in 2024-09-12T02:31:29.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:28 smithi115 ceph-mon[35351]: pgmap v519: 33 pgs: 33 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:31:29.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:28 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:31:29.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:28 smithi136 ceph-mon[35814]: osdmap e121: 12 total, 12 up, 12 in 2024-09-12T02:31:29.410 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:28 smithi136 ceph-mon[35814]: pgmap v519: 33 pgs: 33 active+clean; 3.0 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:31:29.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.755+0000 7ff526a00640 1 -- 172.21.15.110:0/681160373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff520106f20 msgr2=0x7ff52010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.755+0000 7ff526a00640 1 --2- 172.21.15.110:0/681160373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff520106f20 0x7ff52010eaa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff518009900 tx=0x7ff51802a3f0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.755+0000 7ff526a00640 1 -- 172.21.15.110:0/681160373 shutdown_connections 2024-09-12T02:31:29.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.755+0000 7ff526a00640 1 --2- 172.21.15.110:0/681160373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff520106f20 0x7ff52010eaa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.755+0000 7ff526a00640 1 --2- 172.21.15.110:0/681160373 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5201027a0 0x7ff5201067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.755+0000 7ff526a00640 1 --2- 172.21.15.110:0/681160373 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff520101df0 0x7ff5201021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.755+0000 7ff526a00640 1 -- 172.21.15.110:0/681160373 >> 172.21.15.110:0/681160373 conn(0x7ff5200fd8b0 msgr2=0x7ff5200ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:29.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.755+0000 7ff526a00640 1 -- 172.21.15.110:0/681160373 shutdown_connections 2024-09-12T02:31:29.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.755+0000 7ff526a00640 1 -- 172.21.15.110:0/681160373 wait complete. 2024-09-12T02:31:29.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.756+0000 7ff526a00640 1 Processor -- start 2024-09-12T02:31:29.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.756+0000 7ff526a00640 1 -- start start 2024-09-12T02:31:29.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.756+0000 7ff526a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff520101df0 0x7ff5201983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.756+0000 7ff526a00640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5201027a0 0x7ff520198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.756+0000 7ff526a00640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff520106f20 0x7ff52019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.756+0000 7ff526a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 -- 0x7ff520111fd0 con 0x7ff520101df0 2024-09-12T02:31:29.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.756+0000 7ff526a00640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff520111e50 con 0x7ff520106f20 2024-09-12T02:31:29.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.756+0000 7ff526a00640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff520112150 con 0x7ff5201027a0 2024-09-12T02:31:29.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.757+0000 7ff51fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff520101df0 0x7ff5201983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.757+0000 7ff51f400640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5201027a0 0x7ff520198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.757+0000 7ff51fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff520101df0 0x7ff5201983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33994/0 (socket says 172.21.15.110:33994) 2024-09-12T02:31:29.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.757+0000 7ff51fe00640 1 -- 172.21.15.110:0/3648813987 learned_addr learned my addr 172.21.15.110:0/3648813987 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-09-12T02:31:29.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.757+0000 7ff524a00640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff520106f20 0x7ff52019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.757+0000 7ff51f400640 1 -- 172.21.15.110:0/3648813987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff520106f20 msgr2=0x7ff52019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.757+0000 7ff51f400640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff520106f20 0x7ff52019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.757+0000 7ff51f400640 1 -- 172.21.15.110:0/3648813987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff520101df0 msgr2=0x7ff5201983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.757+0000 7ff51f400640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff520101df0 0x7ff5201983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.757+0000 7ff51f400640 1 -- 172.21.15.110:0/3648813987 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52019d380 con 0x7ff5201027a0 2024-09-12T02:31:29.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.757+0000 7ff524a00640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff520106f20 0x7ff52019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T02:31:29.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.757+0000 7ff51f400640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5201027a0 0x7ff520198910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00e9f0 tx=0x7ff50c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:29.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.758+0000 7ff51cc00640 1 -- 172.21.15.110:0/3648813987 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00ccc0 con 0x7ff5201027a0 2024-09-12T02:31:29.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.758+0000 7ff526a00640 1 -- 172.21.15.110:0/3648813987 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff52019d670 con 0x7ff5201027a0 2024-09-12T02:31:29.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.758+0000 7ff51cc00640 1 -- 172.21.15.110:0/3648813987 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff50c010910 con 0x7ff5201027a0 2024-09-12T02:31:29.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.758+0000 7ff51cc00640 1 -- 172.21.15.110:0/3648813987 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c018960 con 0x7ff5201027a0 2024-09-12T02:31:29.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.758+0000 7ff526a00640 1 -- 172.21.15.110:0/3648813987 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff520074420 con 0x7ff5201027a0 2024-09-12T02:31:29.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.759+0000 7ff526a00640 1 -- 172.21.15.110:0/3648813987 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5201021d0 con 0x7ff5201027a0 2024-09-12T02:31:29.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.762+0000 7ff51cc00640 1 -- 172.21.15.110:0/3648813987 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7ff50c010ac0 con 0x7ff5201027a0 2024-09-12T02:31:29.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.763+0000 7ff51cc00640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7ff5040a2d70 0x7ff5040a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T02:31:29.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.763+0000 7ff51cc00640 1 -- 172.21.15.110:0/3648813987 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 8582+0+0 (secure 0 0 0) 0x7ff50c0cfcb0 con 0x7ff5201027a0 2024-09-12T02:31:29.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.763+0000 7ff51fe00640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7ff5040a2d70 0x7ff5040a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T02:31:29.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.764+0000 7ff51fe00640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7ff5040a2d70 0x7ff5040a5230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5100049d0 tx=0x7ff510012040 comp rx=0 tx=0).ready entity=mgr.15147 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T02:31:29.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.764+0000 7ff51cc00640 1 -- 172.21.15.110:0/3648813987 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff50c09c830 con 0x7ff5201027a0 2024-09-12T02:31:29.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.940+0000 7ff526a00640 1 -- 172.21.15.110:0/3648813987 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff520074710 con 0x7ff5201027a0 2024-09-12T02:31:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.991+0000 7ff51cc00640 1 -- 172.21.15.110:0/3648813987 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v122) ==== 178+0+0 (secure 0 0 0) 0x7ff50c09c130 con 0x7ff5201027a0 2024-09-12T02:31:29.992 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data_ec' removed 2024-09-12T02:31:29.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.994+0000 7ff526a00640 1 -- 172.21.15.110:0/3648813987 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7ff5040a2d70 msgr2=0x7ff5040a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.994+0000 7ff526a00640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7ff5040a2d70 0x7ff5040a5230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5100049d0 tx=0x7ff510012040 comp rx=0 tx=0).stop 2024-09-12T02:31:29.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.994+0000 7ff526a00640 1 -- 172.21.15.110:0/3648813987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5201027a0 msgr2=0x7ff520198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T02:31:29.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.994+0000 7ff526a00640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5201027a0 0x7ff520198910 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00e9f0 tx=0x7ff50c00eeb0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.994+0000 7ff526a00640 1 -- 172.21.15.110:0/3648813987 shutdown_connections 2024-09-12T02:31:29.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.994+0000 7ff526a00640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.110:6800/1913988278,v1:172.21.15.110:6801/1913988278] conn(0x7ff5040a2d70 0x7ff5040a5230 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.994+0000 7ff526a00640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff520106f20 0x7ff52019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.994+0000 7ff526a00640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5201027a0 0x7ff520198910 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.994+0000 7ff526a00640 1 --2- 172.21.15.110:0/3648813987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff520101df0 0x7ff5201983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T02:31:29.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.994+0000 7ff526a00640 1 -- 172.21.15.110:0/3648813987 >> 172.21.15.110:0/3648813987 conn(0x7ff5200fd8b0 msgr2=0x7ff5200fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T02:31:29.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.994+0000 7ff526a00640 1 -- 172.21.15.110:0/3648813987 shutdown_connections 2024-09-12T02:31:29.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-12T02:31:29.994+0000 7ff526a00640 1 -- 172.21.15.110:0/3648813987 wait complete. 2024-09-12T02:31:30.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:29 smithi115 ceph-mon[35351]: from='client.? 172.21.15.110:0/3648813987' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:30.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:29 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:30.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:29 smithi136 ceph-mon[35814]: from='client.? 172.21.15.110:0/3648813987' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:30.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:29 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:30.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:29 smithi110 ceph-mon[30548]: from='client.? 172.21.15.110:0/3648813987' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:30.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:29 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-12T02:31:31.047 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:31:31.164 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:31:31.248 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:31:31.277 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:31 smithi136 ceph-mon[35814]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:31:31.277 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:31 smithi136 ceph-mon[35814]: osdmap e122: 12 total, 12 up, 12 in 2024-09-12T02:31:31.277 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:31 smithi136 ceph-mon[35814]: pgmap v521: 1 pgs: 1 active+clean; 577 KiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:31:31.283 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T02:31:31.283 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:31:31.294 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:31 smithi115 ceph-mon[35351]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:31:31.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:31 smithi115 ceph-mon[35351]: osdmap e122: 12 total, 12 up, 12 in 2024-09-12T02:31:31.295 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:31 smithi115 ceph-mon[35351]: pgmap v521: 1 pgs: 1 active+clean; 577 KiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:31:31.347 DEBUG:teuthology.orchestra.run.smithi115:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:31:31.366 DEBUG:teuthology.orchestra.run.smithi136:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T02:31:31.389 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T02:31:31.390 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-12T02:31:31.390 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.a 2024-09-12T02:31:31.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:31 smithi110 ceph-mon[30548]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-12T02:31:31.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:31 smithi110 ceph-mon[30548]: osdmap e122: 12 total, 12 up, 12 in 2024-09-12T02:31:31.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:31 smithi110 ceph-mon[30548]: pgmap v521: 1 pgs: 1 active+clean; 577 KiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-12T02:31:31.937 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:31 smithi110 systemd[1]: Stopping Ceph mon.a for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:31:32.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:32 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a[30544]: 2024-09-12T02:31:32.024+0000 7f5592000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:31:32.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:32 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a[30544]: 2024-09-12T02:31:32.024+0000 7f5592000640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T02:31:32.437 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:32 smithi110 podman[92059]: 2024-09-12 02:31:32.221652117 +0000 UTC m=+0.367791741 container died dbfffbd8dcfad5c15082830c00b213ff5909aecfda126855fae0b058d3d4a48c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:31:36.148 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:35 smithi110 podman[92059]: 2024-09-12 02:31:35.825034238 +0000 UTC m=+3.971173868 container cleanup dbfffbd8dcfad5c15082830c00b213ff5909aecfda126855fae0b058d3d4a48c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T02:31:36.148 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:35 smithi110 bash[92059]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a 2024-09-12T02:31:36.438 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:36 smithi110 podman[92069]: 2024-09-12 02:31:36.143111925 +0000 UTC m=+3.899677761 container remove dbfffbd8dcfad5c15082830c00b213ff5909aecfda126855fae0b058d3d4a48c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:31:36.729 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.a.service' 2024-09-12T02:31:37.186 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:36 smithi110 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-12T02:31:37.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:36 smithi110 systemd[1]: Stopped Ceph mon.a for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:31:37.187 INFO:journalctl@ceph.mon.a.smithi110.stdout:Sep 12 02:31:36 smithi110 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.a.service: Consumed 31.312s CPU time. 2024-09-12T02:31:37.638 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:31:37.638 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-12T02:31:37.638 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-12T02:31:37.639 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.b 2024-09-12T02:31:38.044 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:37 smithi115 systemd[1]: Stopping Ceph mon.b for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:31:39.424 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:39 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-b[35347]: 2024-09-12T02:31:39.045+0000 7f0f9e295640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:31:39.424 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:39 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-b[35347]: 2024-09-12T02:31:39.045+0000 7f0f9e295640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-12T02:31:39.795 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:39 smithi115 podman[71659]: 2024-09-12 02:31:39.423962832 +0000 UTC m=+1.282548905 container died 5908841400b3981b4d42c53fb561e53cf3fb73fce92ebb47b7124d11267bd9f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T02:31:40.206 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:39 smithi115 podman[71659]: 2024-09-12 02:31:39.954949646 +0000 UTC m=+1.813535710 container cleanup 5908841400b3981b4d42c53fb561e53cf3fb73fce92ebb47b7124d11267bd9f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T02:31:40.207 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:39 smithi115 bash[71659]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-b 2024-09-12T02:31:40.436 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.b.service' 2024-09-12T02:31:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:40 smithi115 podman[71679]: 2024-09-12 02:31:40.206818829 +0000 UTC m=+0.674519909 container remove 5908841400b3981b4d42c53fb561e53cf3fb73fce92ebb47b7124d11267bd9f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-b, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-12T02:31:40.458 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:40 smithi115 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-12T02:31:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:40 smithi115 systemd[1]: Stopped Ceph mon.b for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:31:40.459 INFO:journalctl@ceph.mon.b.smithi115.stdout:Sep 12 02:31:40 smithi115 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.b.service: Consumed 15.096s CPU time. 2024-09-12T02:31:40.479 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:31:40.479 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-12T02:31:40.479 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-12T02:31:40.479 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.c 2024-09-12T02:31:40.909 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:40 smithi136 systemd[1]: Stopping Ceph mon.c for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:31:41.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:41 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-c[35810]: 2024-09-12T02:31:41.122+0000 7f5c1d966640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:31:41.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:41 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-c[35810]: 2024-09-12T02:31:41.122+0000 7f5c1d966640 -1 mon.c@1(probing) e3 *** Got Signal Terminated *** 2024-09-12T02:31:41.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:41 smithi136 podman[73275]: 2024-09-12 02:31:41.276043601 +0000 UTC m=+0.504468532 container died aa610fa44e5d9f5055da02f62fc8ffa6cd3b54a859e2294e9e454323511f363b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-c, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T02:31:42.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:41 smithi136 podman[73275]: 2024-09-12 02:31:41.815015625 +0000 UTC m=+1.043440545 container cleanup aa610fa44e5d9f5055da02f62fc8ffa6cd3b54a859e2294e9e454323511f363b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:31:42.158 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:41 smithi136 bash[73275]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-c 2024-09-12T02:31:42.395 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.c.service' 2024-09-12T02:31:42.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:42 smithi136 podman[73287]: 2024-09-12 02:31:42.158549447 +0000 UTC m=+0.876140831 container remove aa610fa44e5d9f5055da02f62fc8ffa6cd3b54a859e2294e9e454323511f363b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T02:31:42.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:42 smithi136 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-12T02:31:42.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:42 smithi136 systemd[1]: Stopped Ceph mon.c for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:31:42.409 INFO:journalctl@ceph.mon.c.smithi136.stdout:Sep 12 02:31:42 smithi136 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@mon.c.service: Consumed 15.887s CPU time. 2024-09-12T02:31:42.464 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:31:42.464 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-12T02:31:42.464 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-12T02:31:42.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.x 2024-09-12T02:31:43.437 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:31:42 smithi110 systemd[1]: Stopping Ceph mgr.x for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:31:44.186 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:31:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:31:43.897+0000 7efdecc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:31:44.187 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:31:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x[30771]: 2024-09-12T02:31:43.897+0000 7efdecc00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-12T02:31:44.187 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:31:44 smithi110 podman[92173]: 2024-09-12 02:31:44.020629239 +0000 UTC m=+0.817777521 container died 7a7d4d0c65ede532f358ad24ce53b81a0b8371a980ed59edd7e798f0ce5cf1c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:31:44.936 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:31:44 smithi110 podman[92173]: 2024-09-12 02:31:44.746572758 +0000 UTC m=+1.543721039 container cleanup 7a7d4d0c65ede532f358ad24ce53b81a0b8371a980ed59edd7e798f0ce5cf1c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:31:44.937 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:31:44 smithi110 bash[92173]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x 2024-09-12T02:31:45.277 INFO:journalctl@ceph.mgr.x.smithi110.stdout:Sep 12 02:31:44 smithi110 podman[92186]: 2024-09-12 02:31:44.99023258 +0000 UTC m=+0.961221624 container remove 7a7d4d0c65ede532f358ad24ce53b81a0b8371a980ed59edd7e798f0ce5cf1c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-x, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-12T02:31:45.294 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-12T02:31:45.369 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:31:45.369 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-12T02:31:45.369 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-12T02:31:45.369 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.y 2024-09-12T02:31:45.715 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:31:45 smithi115 systemd[1]: Stopping Ceph mgr.y for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:31:46.002 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:31:45 smithi115 podman[71790]: 2024-09-12 02:31:45.715370915 +0000 UTC m=+0.148320704 container died 838d5753ee4ac93febd3e15202cfc4b0ba8d071bf0b6d88fe53c50ff64b944dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:31:46.295 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:31:46 smithi115 podman[71790]: 2024-09-12 02:31:46.076666393 +0000 UTC m=+0.509616181 container cleanup 838d5753ee4ac93febd3e15202cfc4b0ba8d071bf0b6d88fe53c50ff64b944dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T02:31:46.295 INFO:journalctl@ceph.mgr.y.smithi115.stdout:Sep 12 02:31:46 smithi115 bash[71790]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-y 2024-09-12T02:31:46.552 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-12T02:31:46.588 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:31:46.589 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-12T02:31:46.589 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-12T02:31:46.589 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.z 2024-09-12T02:31:46.909 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:31:46 smithi136 systemd[1]: Stopping Ceph mgr.z for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:31:47.239 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:31:46 smithi136 podman[73406]: 2024-09-12 02:31:46.932537245 +0000 UTC m=+0.147879679 container died 2bbee3b27121bfaa08ad809f7d61daa9301e9fee09679e3d05bef61996f1a359 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:31:47.581 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:31:47 smithi136 podman[73406]: 2024-09-12 02:31:47.337477563 +0000 UTC m=+0.552819983 container cleanup 2bbee3b27121bfaa08ad809f7d61daa9301e9fee09679e3d05bef61996f1a359 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-12T02:31:47.581 INFO:journalctl@ceph.mgr.z.smithi136.stdout:Sep 12 02:31:47 smithi136 bash[73406]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mgr-z 2024-09-12T02:31:47.714 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-12T02:31:47.750 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:31:47.750 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-12T02:31:47.750 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T02:31:47.750 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.0 2024-09-12T02:31:48.187 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:47 smithi110 systemd[1]: Stopping Ceph osd.0 for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:31:48.687 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:48 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0[44570]: 2024-09-12T02:31:48.187+0000 7f6e1fc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:31:48.687 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:48 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0[44570]: 2024-09-12T02:31:48.187+0000 7f6e1fc00640 -1 osd.0 122 *** Got signal Terminated *** 2024-09-12T02:31:48.687 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:48 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0[44570]: 2024-09-12T02:31:48.187+0000 7f6e1fc00640 -1 osd.0 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:31:54.687 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:54 smithi110 podman[92307]: 2024-09-12 02:31:54.413048252 +0000 UTC m=+6.368223838 container died 5fe1d46bc1b83d7c7a7b0dfbb35af6855cae5044d679b61bed3ec7e3e78bbac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T02:31:55.187 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:54 smithi110 podman[92307]: 2024-09-12 02:31:54.96040171 +0000 UTC m=+6.915577296 container cleanup 5fe1d46bc1b83d7c7a7b0dfbb35af6855cae5044d679b61bed3ec7e3e78bbac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:31:55.187 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:54 smithi110 bash[92307]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0 2024-09-12T02:31:55.686 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:55 smithi110 podman[92326]: 2024-09-12 02:31:55.238190381 +0000 UTC m=+0.815385751 container remove 5fe1d46bc1b83d7c7a7b0dfbb35af6855cae5044d679b61bed3ec7e3e78bbac3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T02:31:56.074 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:55 smithi110 podman[92411]: 2024-09-12 02:31:55.674620027 +0000 UTC m=+0.027139794 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:31:56.074 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:55 smithi110 podman[92411]: 2024-09-12 02:31:55.80472234 +0000 UTC m=+0.157242143 container create ac969cff78038d06a99c4b8cac27c7bedd71f0831252dbf26dfcb0d6ba831071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T02:31:56.074 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:56 smithi110 podman[92411]: 2024-09-12 02:31:56.074270046 +0000 UTC m=+0.426789814 container init ac969cff78038d06a99c4b8cac27c7bedd71f0831252dbf26dfcb0d6ba831071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T02:31:56.437 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:56 smithi110 podman[92411]: 2024-09-12 02:31:56.081063474 +0000 UTC m=+0.433583242 container start ac969cff78038d06a99c4b8cac27c7bedd71f0831252dbf26dfcb0d6ba831071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T02:31:56.437 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:56 smithi110 podman[92411]: 2024-09-12 02:31:56.232508089 +0000 UTC m=+0.585027865 container attach ac969cff78038d06a99c4b8cac27c7bedd71f0831252dbf26dfcb0d6ba831071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3) 2024-09-12T02:31:56.937 INFO:journalctl@ceph.osd.0.smithi110.stdout:Sep 12 02:31:56 smithi110 podman[92411]: 2024-09-12 02:31:56.823623329 +0000 UTC m=+1.176143097 container died ac969cff78038d06a99c4b8cac27c7bedd71f0831252dbf26dfcb0d6ba831071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:31:57.600 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T02:31:57.676 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:31:57.677 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T02:31:57.677 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T02:31:57.677 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.1 2024-09-12T02:31:58.005 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:31:57 smithi115 systemd[1]: Stopping Ceph osd.1 for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:31:58.295 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:31:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1[39817]: 2024-09-12T02:31:58.004+0000 7f93a72b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:31:58.295 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:31:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1[39817]: 2024-09-12T02:31:58.004+0000 7f93a72b7640 -1 osd.1 122 *** Got signal Terminated *** 2024-09-12T02:31:58.295 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:31:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1[39817]: 2024-09-12T02:31:58.004+0000 7f93a72b7640 -1 osd.1 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:32:04.130 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:32:03 smithi115 podman[71913]: 2024-09-12 02:32:03.826579579 +0000 UTC m=+5.948562680 container died 5aad3ac09f851996fc55cc123400a0ae8579081f875c21b1a3168059c8fd51ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T02:32:04.489 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:32:04 smithi115 podman[71913]: 2024-09-12 02:32:04.229593274 +0000 UTC m=+6.351576383 container cleanup 5aad3ac09f851996fc55cc123400a0ae8579081f875c21b1a3168059c8fd51ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T02:32:04.490 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:32:04 smithi115 bash[71913]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1 2024-09-12T02:32:04.795 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:32:04 smithi115 podman[71930]: 2024-09-12 02:32:04.489613169 +0000 UTC m=+0.659885175 container remove 5aad3ac09f851996fc55cc123400a0ae8579081f875c21b1a3168059c8fd51ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T02:32:05.135 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:32:04 smithi115 podman[72017]: 2024-09-12 02:32:04.741489964 +0000 UTC m=+0.016082045 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:32:05.136 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:32:04 smithi115 podman[72017]: 2024-09-12 02:32:04.865683103 +0000 UTC m=+0.140275172 container create d5437184336af70e958ea54699b714094279c583a9b312acbda945ff73993c81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3) 2024-09-12T02:32:05.427 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:32:05 smithi115 podman[72017]: 2024-09-12 02:32:05.135663797 +0000 UTC m=+0.410255893 container init d5437184336af70e958ea54699b714094279c583a9b312acbda945ff73993c81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T02:32:05.427 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:32:05 smithi115 podman[72017]: 2024-09-12 02:32:05.13938652 +0000 UTC m=+0.413978596 container start d5437184336af70e958ea54699b714094279c583a9b312acbda945ff73993c81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T02:32:05.427 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:32:05 smithi115 podman[72017]: 2024-09-12 02:32:05.243723073 +0000 UTC m=+0.518315158 container attach d5437184336af70e958ea54699b714094279c583a9b312acbda945ff73993c81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T02:32:05.730 INFO:journalctl@ceph.osd.1.smithi115.stdout:Sep 12 02:32:05 smithi115 podman[72017]: 2024-09-12 02:32:05.427197302 +0000 UTC m=+0.701789381 container died d5437184336af70e958ea54699b714094279c583a9b312acbda945ff73993c81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:32:06.057 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T02:32:06.098 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:32:06.099 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T02:32:06.099 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T02:32:06.099 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.2 2024-09-12T02:32:06.409 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:06 smithi136 systemd[1]: Stopping Ceph osd.2 for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:32:06.909 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:06 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2[40802]: 2024-09-12T02:32:06.423+0000 7f4fa2d1b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:32:06.909 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:06 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2[40802]: 2024-09-12T02:32:06.423+0000 7f4fa2d1b640 -1 osd.2 122 *** Got signal Terminated *** 2024-09-12T02:32:06.909 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:06 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2[40802]: 2024-09-12T02:32:06.423+0000 7f4fa2d1b640 -1 osd.2 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:32:12.409 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:12 smithi136 podman[73528]: 2024-09-12 02:32:12.099600916 +0000 UTC m=+5.804850049 container died 866377aa256b28ba4dfa0cb69c9eb85e49512181e18ace9f248e0b0dcab368cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T02:32:12.724 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:12 smithi136 podman[73528]: 2024-09-12 02:32:12.632449773 +0000 UTC m=+6.337698906 container cleanup 866377aa256b28ba4dfa0cb69c9eb85e49512181e18ace9f248e0b0dcab368cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T02:32:12.724 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:12 smithi136 bash[73528]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2 2024-09-12T02:32:13.159 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:12 smithi136 podman[73546]: 2024-09-12 02:32:12.876101581 +0000 UTC m=+0.771643762 container remove 866377aa256b28ba4dfa0cb69c9eb85e49512181e18ace9f248e0b0dcab368cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-12T02:32:13.564 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:13 smithi136 podman[73640]: 2024-09-12 02:32:13.197703825 +0000 UTC m=+0.016709629 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:32:13.564 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:13 smithi136 podman[73640]: 2024-09-12 02:32:13.310885807 +0000 UTC m=+0.129891617 container create f5e3cd4e6bfdffe5c6b2a9a13ec7c41b86f609fc8678905d959be03f5fad9e73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T02:32:13.564 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:13 smithi136 podman[73640]: 2024-09-12 02:32:13.563757199 +0000 UTC m=+0.382763015 container init f5e3cd4e6bfdffe5c6b2a9a13ec7c41b86f609fc8678905d959be03f5fad9e73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-12T02:32:13.909 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:13 smithi136 podman[73640]: 2024-09-12 02:32:13.567840296 +0000 UTC m=+0.386846110 container start f5e3cd4e6bfdffe5c6b2a9a13ec7c41b86f609fc8678905d959be03f5fad9e73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T02:32:13.909 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:13 smithi136 podman[73640]: 2024-09-12 02:32:13.672313508 +0000 UTC m=+0.491319315 container attach f5e3cd4e6bfdffe5c6b2a9a13ec7c41b86f609fc8678905d959be03f5fad9e73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T02:32:14.267 INFO:journalctl@ceph.osd.2.smithi136.stdout:Sep 12 02:32:13 smithi136 podman[73640]: 2024-09-12 02:32:13.953339436 +0000 UTC m=+0.772345243 container died f5e3cd4e6bfdffe5c6b2a9a13ec7c41b86f609fc8678905d959be03f5fad9e73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T02:32:14.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T02:32:14.643 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:32:14.643 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T02:32:14.643 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T02:32:14.644 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.3 2024-09-12T02:32:15.056 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:14 smithi110 systemd[1]: Stopping Ceph osd.3 for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:32:15.437 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:15 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3[51310]: 2024-09-12T02:32:15.073+0000 7f50d9200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:32:15.437 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:15 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3[51310]: 2024-09-12T02:32:15.073+0000 7f50d9200640 -1 osd.3 122 *** Got signal Terminated *** 2024-09-12T02:32:15.437 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:15 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3[51310]: 2024-09-12T02:32:15.073+0000 7f50d9200640 -1 osd.3 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:32:15.909 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:15 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:15.406+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:15.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:15 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:15.523+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:15.936 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:15 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3[51310]: 2024-09-12T02:32:15.485+0000 7f50cfc00640 -1 osd.3 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:53.014367+0000 front 2024-09-12T02:31:53.014448+0000 (oldest deadline 2024-09-12T02:32:14.714349+0000) 2024-09-12T02:32:16.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:15 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:15.736+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:16.687 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:16 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3[51310]: 2024-09-12T02:32:16.518+0000 7f50cfc00640 -1 osd.3 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:53.014367+0000 front 2024-09-12T02:31:53.014448+0000 (oldest deadline 2024-09-12T02:32:14.714349+0000) 2024-09-12T02:32:16.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:16 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:16.561+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:16.909 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:16 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:16.425+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:17.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:16 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:16.767+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:17.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:17 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:17.020+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:17.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:17 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:17.375+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:17.659 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:17 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:17.589+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:17.936 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:17 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3[51310]: 2024-09-12T02:32:17.561+0000 7f50cfc00640 -1 osd.3 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:53.014367+0000 front 2024-09-12T02:31:53.014448+0000 (oldest deadline 2024-09-12T02:32:14.714349+0000) 2024-09-12T02:32:18.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:17 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:17.730+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:18.436 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:17 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:17.997+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:18.602 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:18 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:18.347+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:18.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:18 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:18.601+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:18.936 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:18 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3[51310]: 2024-09-12T02:32:18.565+0000 7f50cfc00640 -1 osd.3 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:53.014367+0000 front 2024-09-12T02:31:53.014448+0000 (oldest deadline 2024-09-12T02:32:14.714349+0000) 2024-09-12T02:32:19.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:18 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:18.773+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:19.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:19.036+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:19.630 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:19 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:19.359+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:19.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:19 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:19.629+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:19.936 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:19 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3[51310]: 2024-09-12T02:32:19.602+0000 7f50cfc00640 -1 osd.3 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:53.014367+0000 front 2024-09-12T02:31:53.014448+0000 (oldest deadline 2024-09-12T02:32:14.714349+0000) 2024-09-12T02:32:20.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:19 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:19.748+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:20.436 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:20 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:20.072+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:20.659 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:20.586+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:20.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:20.399+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:21.048 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:20.702+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:21.436 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:21 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:21.112+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:21.798 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:21 smithi110 podman[92513]: 2024-09-12 02:32:21.452781132 +0000 UTC m=+6.518133146 container died 5de8ab4b14c3738cbe37b68d0f5ebf4049bbed0f64c0c50014fa342daaa5175b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T02:32:21.909 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:21 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:21.420+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:21.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:21 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:21.583+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:22.044 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:21 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:21.727+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:22.145 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:21 smithi110 podman[92513]: 2024-09-12 02:32:21.921733411 +0000 UTC m=+6.987085424 container cleanup 5de8ab4b14c3738cbe37b68d0f5ebf4049bbed0f64c0c50014fa342daaa5175b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-12T02:32:22.145 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:21 smithi110 bash[92513]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3 2024-09-12T02:32:22.436 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:22 smithi110 podman[92544]: 2024-09-12 02:32:22.214950309 +0000 UTC m=+0.733083062 container remove 5de8ab4b14c3738cbe37b68d0f5ebf4049bbed0f64c0c50014fa342daaa5175b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T02:32:22.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:22 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:22.144+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:22.909 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:22 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:22.423+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:22.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:22 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:22.618+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:23.047 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:22 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:22.761+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:23.085 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:22 smithi110 podman[92631]: 2024-09-12 02:32:22.656114555 +0000 UTC m=+0.027072535 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:32:23.085 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:22 smithi110 podman[92631]: 2024-09-12 02:32:22.765952839 +0000 UTC m=+0.136910817 container create 86b22c07a5f1e30ccbe60657006bdd11d98e30522d10764d45aca120d171b434 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T02:32:23.348 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:23 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:23.114+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:23.349 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:23 smithi110 podman[92631]: 2024-09-12 02:32:23.085060416 +0000 UTC m=+0.456018395 container init 86b22c07a5f1e30ccbe60657006bdd11d98e30522d10764d45aca120d171b434 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T02:32:23.349 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:23 smithi110 podman[92631]: 2024-09-12 02:32:23.092203554 +0000 UTC m=+0.463161544 container start 86b22c07a5f1e30ccbe60657006bdd11d98e30522d10764d45aca120d171b434 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T02:32:23.349 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:23 smithi110 podman[92631]: 2024-09-12 02:32:23.193401949 +0000 UTC m=+0.564359935 container attach 86b22c07a5f1e30ccbe60657006bdd11d98e30522d10764d45aca120d171b434 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:32:23.349 INFO:journalctl@ceph.osd.3.smithi110.stdout:Sep 12 02:32:23 smithi110 podman[92631]: 2024-09-12 02:32:23.348831349 +0000 UTC m=+0.719789332 container died 86b22c07a5f1e30ccbe60657006bdd11d98e30522d10764d45aca120d171b434 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T02:32:23.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:23 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:23.391+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:23.659 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:23 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:23.578+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:24.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T02:32:24.224 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:32:24.224 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T02:32:24.224 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T02:32:24.225 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.4 2024-09-12T02:32:24.253 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:23 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:23.796+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:24.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:24 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:24.084+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:24.540 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:24 smithi115 systemd[1]: Stopping Ceph osd.4 for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:32:24.618 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:24 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:24.573+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:24.618 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:24 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:24.359+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:24.618 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:24 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:24.359+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:24.795 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:24 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4[46435]: 2024-09-12T02:32:24.539+0000 7fbb323e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:32:24.795 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:24 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4[46435]: 2024-09-12T02:32:24.539+0000 7fbb323e3640 -1 osd.4 122 *** Got signal Terminated *** 2024-09-12T02:32:24.795 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:24 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4[46435]: 2024-09-12T02:32:24.539+0000 7fbb323e3640 -1 osd.4 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:32:24.795 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:24 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:24.771+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:24.795 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:24 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:24.771+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:24.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:24 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:24.617+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:25.295 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:25 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:25.036+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:25.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:25 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:25.081+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:25.658 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:25 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:25.615+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:25.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:25 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:25.370+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:25.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:25 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:25.370+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:25.795 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:25 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4[46435]: 2024-09-12T02:32:25.535+0000 7fbb2a9f1640 -1 osd.4 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.595584+0000 front 2024-09-12T02:32:02.595611+0000 (oldest deadline 2024-09-12T02:32:24.895802+0000) 2024-09-12T02:32:25.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:25 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:25.658+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:26.071 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:25 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:25.806+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:26.071 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:25 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:25.806+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:26.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:26 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:26.059+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:26.437 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:25 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:25.990+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:26.544 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:26 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:26.070+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:26.640 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:26.566+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:26.641 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:26.371+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:26.641 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:26.371+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:26.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:26.640+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:27.045 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:26 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4[46435]: 2024-09-12T02:32:26.547+0000 7fbb2a9f1640 -1 osd.4 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.595584+0000 front 2024-09-12T02:32:02.595611+0000 (oldest deadline 2024-09-12T02:32:24.895802+0000) 2024-09-12T02:32:27.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:26 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:26.794+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:27.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:26 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:26.794+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:27.437 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:26 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:26.949+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:27.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:27 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:27.016+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:27.522 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:27 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:27.064+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:27.659 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:27 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:27.554+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:27.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:27 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:27.395+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:27.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:27 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:27.396+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:27.659 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:27 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:27.608+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:27.796 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:27 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4[46435]: 2024-09-12T02:32:27.521+0000 7fbb2a9f1640 -1 osd.4 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.595584+0000 front 2024-09-12T02:32:02.595611+0000 (oldest deadline 2024-09-12T02:32:24.895802+0000) 2024-09-12T02:32:28.110 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:27 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:27.834+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:28.110 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:27 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:27.834+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:28.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:27 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:27.913+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:28.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:28 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:28.042+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:28.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:28 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:28.042+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:28.501 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:28 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:28.109+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:28.659 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:28 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:28.572+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:28.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:28 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:28.386+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:28.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:28 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:28.386+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:28.660 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:28 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:28.589+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:28.660 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:28 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:28.589+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:28.788 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:28 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4[46435]: 2024-09-12T02:32:28.501+0000 7fbb2a9f1640 -1 osd.4 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.595584+0000 front 2024-09-12T02:32:02.595611+0000 (oldest deadline 2024-09-12T02:32:24.895802+0000) 2024-09-12T02:32:29.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:28 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:28.787+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:29.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:28 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:28.787+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:29.186 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:28 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:28.894+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:29.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:29 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:29.076+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:29.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:29 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:29.076+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:29.481 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:29 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:29.144+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:29.659 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:29.596+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:29.659 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:29.603+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:29.659 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:29.603+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:29.660 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:29.379+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:29.660 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:29.379+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:29.794 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:29 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4[46435]: 2024-09-12T02:32:29.479+0000 7fbb2a9f1640 -1 osd.4 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.595584+0000 front 2024-09-12T02:32:02.595611+0000 (oldest deadline 2024-09-12T02:32:24.895802+0000) 2024-09-12T02:32:30.143 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:29 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:29.820+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:30.143 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:29 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:29.820+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:30.186 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:29 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:29.871+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:30.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:30 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:30.067+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:30.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:30 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:30.067+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:30.532 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:30 smithi115 podman[72132]: 2024-09-12 02:32:30.22392554 +0000 UTC m=+5.803937291 container died d004fb5a1af195336506c3323d2bd28c7cdb1b075e2afd46305c40a35dc72614 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T02:32:30.533 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:30 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:30.141+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:30.617 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:30.344+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:30.618 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:30.344+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:30.618 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:30.560+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:30.795 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:30 smithi115 podman[72132]: 2024-09-12 02:32:30.631279263 +0000 UTC m=+6.211291092 container cleanup d004fb5a1af195336506c3323d2bd28c7cdb1b075e2afd46305c40a35dc72614 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T02:32:30.795 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:30 smithi115 bash[72132]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4 2024-09-12T02:32:30.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:30.617+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:30.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:30.617+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:31.139 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:30 smithi115 podman[72149]: 2024-09-12 02:32:30.857629486 +0000 UTC m=+0.632017387 container remove d004fb5a1af195336506c3323d2bd28c7cdb1b075e2afd46305c40a35dc72614 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-12T02:32:31.140 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:30 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:30.814+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:31.140 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:30 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:30.814+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:31.186 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:30 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:30.854+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:31.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:31 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:31.094+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:31.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:31 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:31.094+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:31.453 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:31 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:31.138+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:31.453 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:31 smithi115 podman[72235]: 2024-09-12 02:32:31.097305455 +0000 UTC m=+0.016827592 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:32:31.453 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:31 smithi115 podman[72235]: 2024-09-12 02:32:31.200229001 +0000 UTC m=+0.119751197 container create 830783839c371c214d304e03eae598b478bca52010a0605afd9725d4d293423a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-12T02:32:31.453 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:31 smithi115 podman[72235]: 2024-09-12 02:32:31.453056795 +0000 UTC m=+0.372578931 container init 830783839c371c214d304e03eae598b478bca52010a0605afd9725d4d293423a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T02:32:31.572 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:31 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:31.299+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:31.572 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:31 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:31.299+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:31.786 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:31 smithi115 podman[72235]: 2024-09-12 02:32:31.456774012 +0000 UTC m=+0.376296140 container start 830783839c371c214d304e03eae598b478bca52010a0605afd9725d4d293423a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:32:31.786 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:31 smithi115 podman[72235]: 2024-09-12 02:32:31.561020733 +0000 UTC m=+0.480542888 container attach 830783839c371c214d304e03eae598b478bca52010a0605afd9725d4d293423a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:32:31.786 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:31 smithi115 podman[72235]: 2024-09-12 02:32:31.643164795 +0000 UTC m=+0.562686923 container died 830783839c371c214d304e03eae598b478bca52010a0605afd9725d4d293423a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T02:32:31.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:31 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:31.571+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:31.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:31 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:31.635+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:31.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:31 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:31.635+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:32.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:31 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:31.785+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:32.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:31 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:31.785+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:32.186 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:31 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:31.846+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:32.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:32 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:32.049+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:32.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:32 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:32.049+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:32.371 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:32 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:32.174+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:32.371 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:32 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:32.174+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:32.372 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:32 smithi115 podman[72259]: 2024-09-12 02:32:32.356854012 +0000 UTC m=+0.704447069 container remove 830783839c371c214d304e03eae598b478bca52010a0605afd9725d4d293423a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T02:32:32.372 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:32 smithi115 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-12T02:32:32.372 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:32 smithi115 systemd[1]: Stopped Ceph osd.4 for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:32:32.372 INFO:journalctl@ceph.osd.4.smithi115.stdout:Sep 12 02:32:32 smithi115 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.4.service: Consumed 17min 14.734s CPU time. 2024-09-12T02:32:32.373 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T02:32:32.452 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:32:32.452 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T02:32:32.452 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T02:32:32.453 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.5 2024-09-12T02:32:32.583 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:32 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:32.275+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:32.583 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:32 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:32.275+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:32.584 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:32 smithi136 systemd[1]: Stopping Ceph osd.5 for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:32:32.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:32 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:32.582+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:32.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:32 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:32.652+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:32.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:32 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:32.652+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:33.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:32 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:32.771+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:33.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:32 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:32.771+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:33.056 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:32 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:32.804+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:33.057 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:32 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:32.804+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:33.299 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:33 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:33.037+0000 7f794b96c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:32:33.299 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:33 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:33.037+0000 7f794b96c640 -1 osd.5 122 *** Got signal Terminated *** 2024-09-12T02:32:33.299 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:33 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:33.037+0000 7f794b96c640 -1 osd.5 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:32:33.299 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:33 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:33.298+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:33.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:33 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:33.055+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:33.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:33 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:33.055+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:33.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:33 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:33.187+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:33.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:33 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:33.187+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:33.632 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:33 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:33.298+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:33.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:33 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:33.699+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:33.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:33 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:33.699+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:33.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:33 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:33.632+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:33.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:33 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:33.632+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:34.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:33 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:33.755+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:34.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:33 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:33.755+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:34.186 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:33 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:33.852+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:34.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:33 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:33.852+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:34.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:34 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:34.048+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:34.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:34 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:34.048+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:34.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:34 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:34.048+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:34.313 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:34 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:34.216+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:34.313 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:34 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:34.216+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:34.651 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:34 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:34.280+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:34.651 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:34 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:34.280+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:34.652 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:34 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:34.280+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:08.482391+0000 front 2024-09-12T02:32:08.482445+0000 (oldest deadline 2024-09-12T02:32:33.782464+0000) 2024-09-12T02:32:34.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:34 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:34.651+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:34.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:34 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:34.651+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:34.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:34 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:34.729+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:34.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:34 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:34.729+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:34.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:34 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:34.729+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:35.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:34 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:34.712+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:35.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:34 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:34.712+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:35.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:34 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:34.712+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:35.090 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:34 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:34.831+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:35.090 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:34 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:34.831+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:35.436 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:35 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:35.089+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:35.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:35 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:35.089+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:35.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:35 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:35.089+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:35.544 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:35 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:35.175+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:35.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:35 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:35.175+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:35.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:35 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:35.284+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:35.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:35 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:35.284+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:35.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:35 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:35.284+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:08.482391+0000 front 2024-09-12T02:32:08.482445+0000 (oldest deadline 2024-09-12T02:32:33.782464+0000) 2024-09-12T02:32:36.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:35 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:35.749+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:36.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:35 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:35.749+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:36.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:35 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:35.749+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:36.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:35 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:35.698+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:36.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:35 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:35.698+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:36.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:35 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:35.692+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:36.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:35 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:35.692+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:36.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:35 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:35.692+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:36.186 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:35 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:35.878+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:36.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:35 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:35.878+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:36.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:36 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:36.123+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:36.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:36 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:36.123+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:36.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:36 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:36.123+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:36.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:36 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:36.207+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:36.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:36 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:36.207+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:36.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:36 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:36.265+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:36.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:36 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:36.265+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:36.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:36 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:36.265+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:08.482391+0000 front 2024-09-12T02:32:08.482445+0000 (oldest deadline 2024-09-12T02:32:33.782464+0000) 2024-09-12T02:32:37.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:36 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:36.735+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:37.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:36 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:36.735+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:37.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:36 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:36.679+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:37.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:36 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:36.679+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:37.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:36 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:36.679+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:37.171 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:36 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:36.798+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:37.172 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:36 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:36.798+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:37.172 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:36 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:36.798+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:37.186 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:36 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:36.922+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:37.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:36 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:36.922+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:37.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:37 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:37.151+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:37.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:37 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:37.151+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:37.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:37 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:37.151+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:37.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:37 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:37.171+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:37.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:37 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:37.171+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:37.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:37 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:37.231+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.178713+0000 front 2024-09-12T02:31:51.178624+0000 (oldest deadline 2024-09-12T02:32:14.678653+0000) 2024-09-12T02:32:37.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:37 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:37.231+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.580817+0000 front 2024-09-12T02:32:01.580727+0000 (oldest deadline 2024-09-12T02:32:23.880802+0000) 2024-09-12T02:32:37.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:37 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5[47238]: 2024-09-12T02:32:37.231+0000 7f7947f82640 -1 osd.5 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:08.482391+0000 front 2024-09-12T02:32:08.482445+0000 (oldest deadline 2024-09-12T02:32:33.782464+0000) 2024-09-12T02:32:38.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:37 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:37.751+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:38.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:37 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:37.751+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:38.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:37 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:37.751+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:38.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:37 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:37.761+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:38.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:37 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:37.761+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:38.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:37 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:37.694+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:38.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:37 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:37.694+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:38.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:37 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:37.694+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:38.437 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:37 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:37.950+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:38.437 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:37 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:37.950+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:38.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:38 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:38.105+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:38.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:38 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:38.105+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:38.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:38 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:38.105+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:38.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:38 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:38.201+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:38.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:38 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:38.201+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:39.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:38 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:38.726+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:39.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:38 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:38.726+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:39.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:38 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:38.726+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:39.159 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:38 smithi136 podman[73746]: 2024-09-12 02:32:38.90594118 +0000 UTC m=+6.254544371 container died 9d4445cb38fe18a4c71232a4308346970dfe02ec6f8970e659a6a77a559230e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux ) 2024-09-12T02:32:39.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:38 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:38.716+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:39.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:38 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:38.716+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:39.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:38 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:38.737+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:39.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:38 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:38.737+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:39.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:38 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:38.737+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:39.186 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:38 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:38.910+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:39.186 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:38 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:38.910+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:39.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:39 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:39.152+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:39.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:39 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:39.152+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:39.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:39 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:39.152+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:39.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:39 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:39.250+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:39.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:39 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:39.250+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:39.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:39 smithi136 podman[73746]: 2024-09-12 02:32:39.329332105 +0000 UTC m=+6.677935295 container cleanup 9d4445cb38fe18a4c71232a4308346970dfe02ec6f8970e659a6a77a559230e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T02:32:39.564 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:39 smithi136 bash[73746]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5 2024-09-12T02:32:39.909 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:39 smithi136 podman[73766]: 2024-09-12 02:32:39.564340507 +0000 UTC m=+0.656584344 container remove 9d4445cb38fe18a4c71232a4308346970dfe02ec6f8970e659a6a77a559230e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T02:32:39.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:39 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:39.730+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:39.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:39 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:39.730+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:39.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:39 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:39.730+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:39.910 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:39 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:39.735+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:39.910 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:39 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:39.735+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:40.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:39 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:39.679+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:40.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:39 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:39.679+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:40.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:39 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:39.679+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:40.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:39 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:39.903+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:40.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:39 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:39.903+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:40.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:40 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:40.105+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:40.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:40 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:40.105+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:40.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:40 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:40.105+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:40.301 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:39 smithi136 podman[73853]: 2024-09-12 02:32:39.89061194 +0000 UTC m=+0.015771689 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:32:40.301 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:40 smithi136 podman[73853]: 2024-09-12 02:32:40.015304532 +0000 UTC m=+0.140464270 container create 136efd253f9790d74da06e805393a072d82750b7320a4d6eafc556b4d9aef0f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:32:40.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:40 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:40.209+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:40.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:40 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:40.209+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:40.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:40 smithi136 podman[73853]: 2024-09-12 02:32:40.301346084 +0000 UTC m=+0.426505822 container init 136efd253f9790d74da06e805393a072d82750b7320a4d6eafc556b4d9aef0f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T02:32:40.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:40 smithi136 podman[73853]: 2024-09-12 02:32:40.305098516 +0000 UTC m=+0.430258264 container start 136efd253f9790d74da06e805393a072d82750b7320a4d6eafc556b4d9aef0f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:32:40.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:40 smithi136 podman[73853]: 2024-09-12 02:32:40.384815439 +0000 UTC m=+0.509975189 container attach 136efd253f9790d74da06e805393a072d82750b7320a4d6eafc556b4d9aef0f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:32:40.659 INFO:journalctl@ceph.osd.5.smithi136.stdout:Sep 12 02:32:40 smithi136 podman[73853]: 2024-09-12 02:32:40.491049763 +0000 UTC m=+0.616209508 container died 136efd253f9790d74da06e805393a072d82750b7320a4d6eafc556b4d9aef0f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-12T02:32:41.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:40 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:40.709+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:41.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:40 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:40.709+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:41.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:40 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:40.709+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:41.072 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:40 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:40.712+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:41.073 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:40 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:40.712+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:41.073 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:40 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:40.688+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:41.073 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:40 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:40.688+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:41.073 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:40 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:40.688+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:41.099 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T02:32:41.138 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:32:41.139 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T02:32:41.139 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-12T02:32:41.139 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.6 2024-09-12T02:32:41.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:40 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:40.931+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:41.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:40 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:40.931+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:41.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:41 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:41.116+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:41.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:41 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:41.116+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:41.187 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:41 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:41.116+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:41.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:41 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:41.228+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:41.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:41 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:41.228+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:41.561 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:41 smithi110 systemd[1]: Stopping Ceph osd.6 for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:32:41.886 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:41 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:41.560+0000 7f306f200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:32:41.886 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:41 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:41.560+0000 7f306f200640 -1 osd.6 122 *** Got signal Terminated *** 2024-09-12T02:32:41.886 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:41 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:41.560+0000 7f306f200640 -1 osd.6 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:32:41.887 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:41 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:41.885+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:41.887 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:41 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:41.885+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:42.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:41 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:41.689+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:42.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:41 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:41.689+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:42.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:41 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:41.689+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:42.151 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:41 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:41.885+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:17.696388+0000 front 2024-09-12T02:32:17.696325+0000 (oldest deadline 2024-09-12T02:32:41.796401+0000) 2024-09-12T02:32:42.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:41 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:41.675+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:42.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:41 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:41.675+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:42.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:41 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:41.733+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:42.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:41 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:41.733+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:42.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:41 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:41.733+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:42.436 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:42 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:42.150+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:42.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:42 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:42.150+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:42.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:42 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:42.150+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:42.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:42 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:42.279+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:42.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:42 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:42.279+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:42.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:42 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:42.279+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:42.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:42 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:42.776+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:42.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:42 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:42.776+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:42.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:42 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:42.776+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:42.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:42 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:42.626+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:42.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:42 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:42.626+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:42.910 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:42 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:42.626+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:43.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:42 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:42.734+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:43.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:42 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:42.734+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:43.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:42 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:42.734+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:43.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:42 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:42.734+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:43.184 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:42 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:42.839+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:43.185 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:42 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:42.839+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:43.185 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:42 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:42.839+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:17.696388+0000 front 2024-09-12T02:32:17.696325+0000 (oldest deadline 2024-09-12T02:32:41.796401+0000) 2024-09-12T02:32:43.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:43.184+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:43.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:43.184+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:43.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:43.184+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:43.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:43 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:43.272+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:43.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:43 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:43.272+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:43.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:43 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:43.272+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:43.756 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:43 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:43.616+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:43.756 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:43 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:43.616+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:43.756 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:43 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:43.616+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:44.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:43 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:43.712+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:44.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:43 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:43.712+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:44.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:43 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:43.712+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:44.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:43 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:43.712+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:44.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:43 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:43.755+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:44.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:43 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:43.755+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:44.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:43 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:43.755+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:44.186 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:43.847+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:44.186 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:43.847+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:44.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:43.847+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:17.696388+0000 front 2024-09-12T02:32:17.696325+0000 (oldest deadline 2024-09-12T02:32:41.796401+0000) 2024-09-12T02:32:44.659 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:44 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:44.573+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:44.659 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:44 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:44.573+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:44.659 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:44 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:44.573+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:44.679 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:44 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:44.322+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:44.679 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:44 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:44.322+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:44.679 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:44 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:44.322+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:44.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:44 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:44.231+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:44.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:44 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:44.231+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:44.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:44 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:44.231+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:45.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:44 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:44.678+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:45.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:44 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:44.678+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:45.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:44 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:44.678+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:45.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:44 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:44.678+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:45.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:44 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:44.719+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:45.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:44 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:44.719+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:45.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:44 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:44.719+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:45.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:44 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:44.893+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:45.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:44 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:44.893+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:45.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:44 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:44.893+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:17.696388+0000 front 2024-09-12T02:32:17.696325+0000 (oldest deadline 2024-09-12T02:32:41.796401+0000) 2024-09-12T02:32:45.515 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:45 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:45.269+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:45.515 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:45 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:45.269+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:45.515 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:45 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:45.269+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:45.515 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:45 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:45.269+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:45.719 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:45 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:45.351+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:45.719 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:45 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:45.351+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:45.719 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:45 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:45.351+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:45.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:45 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:45.524+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:45.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:45 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:45.524+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:45.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:45 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:45.524+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:45.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:45 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:45.676+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:45.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:45 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:45.676+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:45.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:45 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:45.676+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:46.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:45 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:45.718+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:46.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:45 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:45.718+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:46.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:45 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:45.718+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:46.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:45 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:45.718+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:46.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:45 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:45.855+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.992759+0000 front 2024-09-12T02:32:00.992513+0000 (oldest deadline 2024-09-12T02:32:25.692406+0000) 2024-09-12T02:32:46.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:45 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:45.855+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.595126+0000 front 2024-09-12T02:32:09.594994+0000 (oldest deadline 2024-09-12T02:32:32.494788+0000) 2024-09-12T02:32:46.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:45 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6[58096]: 2024-09-12T02:32:45.855+0000 7f306ac00640 -1 osd.6 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:17.696388+0000 front 2024-09-12T02:32:17.696325+0000 (oldest deadline 2024-09-12T02:32:41.796401+0000) 2024-09-12T02:32:46.656 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:46.259+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:46.656 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:46.259+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:46.656 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:46.259+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:46.656 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:46 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:46.259+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:46.749 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:46 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:46.343+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:46.749 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:46 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:46.343+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:46.749 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:46 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:46.343+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:46.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:46 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:46.521+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:46.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:46 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:46.521+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:46.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:46 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:46.521+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:46.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:46 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:46.664+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:46.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:46 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:46.664+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:46.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:46 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:46.664+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:47.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:46 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:46.748+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:47.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:46 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:46.748+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:47.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:46 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:46.748+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:47.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:46 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:46.748+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:47.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:47 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:47.230+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:47.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:47 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:47.230+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:47.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:47 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:47.230+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:47.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:47 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:47.230+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:47.717 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:47 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:47.359+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:47.717 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:47 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:47.359+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:47.718 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:47 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:47.359+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:47.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:47 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:47.513+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:47.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:47 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:47.513+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:47.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:47 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:47.513+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:47.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:47 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:47.626+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:47.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:47 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:47.626+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:47.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:47 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:47.626+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:48.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:47 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:47.717+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:48.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:47 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:47.717+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:48.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:47 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:47.717+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:48.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:47 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:47.717+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:48.437 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:48 smithi110 podman[92733]: 2024-09-12 02:32:48.139478255 +0000 UTC m=+6.709731968 container died f29a811d00af51be4e4133eb7c405416fe9929426d02c83d2510d672038e2f40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-12T02:32:48.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:48 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:48.225+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:48.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:48 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:48.225+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:48.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:48 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:48.225+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:48.438 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:48 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:48.225+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:48.696 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:48 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:48.385+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:48.696 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:48 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:48.385+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:48.696 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:48 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:48.385+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:48.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:48 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:48.561+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:48.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:48 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:48.561+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:48.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:48 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:48.561+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:48.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:48 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:48.674+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:48.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:48 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:48.674+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:48.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:48 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:48.674+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:48.910 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:48 smithi110 podman[92733]: 2024-09-12 02:32:48.64980986 +0000 UTC m=+7.220063573 container cleanup f29a811d00af51be4e4133eb7c405416fe9929426d02c83d2510d672038e2f40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:32:48.910 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:48 smithi110 bash[92733]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6 2024-09-12T02:32:49.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:48 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:48.695+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:49.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:48 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:48.695+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:49.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:48 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:48.695+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:49.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:48 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:48.695+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:49.186 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:48 smithi110 podman[92761]: 2024-09-12 02:32:48.909583346 +0000 UTC m=+0.747231766 container remove f29a811d00af51be4e4133eb7c405416fe9929426d02c83d2510d672038e2f40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T02:32:49.658 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:49 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:49.274+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:49.658 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:49 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:49.274+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:49.658 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:49 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:49.274+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:49.658 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:49 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:49.274+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:49.658 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:49 smithi110 podman[92849]: 2024-09-12 02:32:49.340429597 +0000 UTC m=+0.027094213 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:32:49.659 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:49 smithi110 podman[92849]: 2024-09-12 02:32:49.510733962 +0000 UTC m=+0.197398576 container create b1d18dc9f6d422abfb0a1e69f159e27e4d846f17aa65be0061e0d6614ae3e995 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:32:49.710 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:49.405+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:49.710 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:49.405+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:49.710 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:49.405+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:49.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:49 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:49.595+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:49.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:49 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:49.595+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:49.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:49 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:49.595+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:49.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:49 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:49.695+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:49.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:49 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:49.695+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:49.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:49 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:49.695+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:49.912 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:49 smithi110 podman[92849]: 2024-09-12 02:32:49.763044648 +0000 UTC m=+0.449709263 container init b1d18dc9f6d422abfb0a1e69f159e27e4d846f17aa65be0061e0d6614ae3e995 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:32:49.913 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:49 smithi110 podman[92849]: 2024-09-12 02:32:49.770306602 +0000 UTC m=+0.456971218 container start b1d18dc9f6d422abfb0a1e69f159e27e4d846f17aa65be0061e0d6614ae3e995 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T02:32:50.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:49.709+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:50.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:49.709+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:50.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:49.709+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:50.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:49 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:49.709+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:50.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:49 smithi110 podman[92849]: 2024-09-12 02:32:49.912945505 +0000 UTC m=+0.599610122 container attach b1d18dc9f6d422abfb0a1e69f159e27e4d846f17aa65be0061e0d6614ae3e995 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:32:50.187 INFO:journalctl@ceph.osd.6.smithi110.stdout:Sep 12 02:32:50 smithi110 podman[92849]: 2024-09-12 02:32:50.028984723 +0000 UTC m=+0.715649339 container died b1d18dc9f6d422abfb0a1e69f159e27e4d846f17aa65be0061e0d6614ae3e995 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T02:32:50.685 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:50 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:50.364+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:50.685 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:50 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:50.364+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:50.685 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:50 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:50.364+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:50.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:50 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:50.271+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:50.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:50 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:50.271+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:50.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:50 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:50.271+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:50.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:50 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:50.271+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:50.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.6.service' 2024-09-12T02:32:50.888 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:32:50.888 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-12T02:32:50.889 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-12T02:32:50.889 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.7 2024-09-12T02:32:50.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:50.721+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:50.912 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:50.721+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:50.913 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:50.721+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:50.913 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:50.559+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:50.913 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:50.559+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:50.913 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:50 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:50.559+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:50.943 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:50 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:50.684+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:50.943 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:50 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:50.684+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:50.943 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:50 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:50.684+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:50.943 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:50 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:50.684+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:50.943 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:50 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:50.684+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:32:51.258 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:50 smithi115 systemd[1]: Stopping Ceph osd.7 for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:32:51.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:51.257+0000 7f2e1efa9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:32:51.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:51.257+0000 7f2e1efa9640 -1 osd.7 122 *** Got signal Terminated *** 2024-09-12T02:32:51.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:51.257+0000 7f2e1efa9640 -1 osd.7 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:32:51.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:51.332+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:51.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:51.332+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:51.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:51.332+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:51.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:51 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:51.265+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:51.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:51 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:51.265+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:51.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:51 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:51.265+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:51.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:51 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:51.265+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:51.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:51 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:51.265+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:32:51.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:51 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:51.563+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:51.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:51 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:51.563+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:51.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:51 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:51.563+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:51.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:51 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:51.739+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:51.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:51 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:51.739+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:51.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:51 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:51.739+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:52.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:51.696+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:52.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:51.696+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:52.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:51.696+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:52.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:51.696+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:52.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:51 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:51.696+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:32:52.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:52.284+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:52.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:52.284+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:52.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:52.284+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:52.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:52 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:52.285+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:52.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:52 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:52.285+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:52.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:52 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:52.285+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:52.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:52 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:52.285+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:52.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:52 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:52.285+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:32:52.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:52 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:52.721+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:52.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:52 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:52.721+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:52.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:52 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:52.721+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:52.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:52 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:52.721+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:32:52.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:52 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:52.520+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:52.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:52 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:52.521+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:52.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:52 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:52.521+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:52.910 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:52 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:52.521+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:32:53.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:52.709+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:53.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:52.709+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:53.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:52.709+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:53.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:52.709+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:53.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:52 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:52.709+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:32:53.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:53 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:53.247+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:53.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:53 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:53.247+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:53.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:53 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:53.247+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:53.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:53 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:53.247+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.204678+0000 front 2024-09-12T02:32:28.204719+0000 (oldest deadline 2024-09-12T02:32:52.904857+0000) 2024-09-12T02:32:53.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:53 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:53.332+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:53.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:53 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:53.332+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:53.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:53 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:53.332+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:53.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:53 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:53.332+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:53.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:53 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:53.332+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:32:53.893 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:53 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:53.768+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:53.893 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:53 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:53.768+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:53.893 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:53 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:53.768+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:53.893 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:53 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:53.768+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:32:53.894 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:53 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:53.560+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:53.894 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:53 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:53.560+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:53.894 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:53 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:53.560+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:53.894 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:53 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:53.560+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:32:54.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:53 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:53.710+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:54.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:53 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:53.710+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:54.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:53 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:53.710+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:54.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:53 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:53.710+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:54.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:53 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:53.710+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:32:54.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:54 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:54.226+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:54.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:54 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:54.226+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:54.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:54 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:54.226+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:54.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:54 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:54.226+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.204678+0000 front 2024-09-12T02:32:28.204719+0000 (oldest deadline 2024-09-12T02:32:52.904857+0000) 2024-09-12T02:32:54.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:54 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:54.298+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:54.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:54 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:54.298+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:54.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:54 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:54.298+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:54.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:54 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:54.298+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:54.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:54 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:54.298+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:32:54.752 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:54 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:54.515+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:54.752 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:54 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:54.515+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:54.752 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:54 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:54.515+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:54.752 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:54 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:54.515+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:32:55.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:54 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:54.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:55.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:54 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:54.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:55.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:54 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:54.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:55.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:54 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:54.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:55.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:54 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:54.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:32:55.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:54 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:54.751+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:55.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:54 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:54.751+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:55.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:54 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:54.751+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:55.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:54 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:54.751+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:32:55.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:55.204+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:55.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:55.204+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:55.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:55.204+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:55.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:55.204+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.204678+0000 front 2024-09-12T02:32:28.204719+0000 (oldest deadline 2024-09-12T02:32:52.904857+0000) 2024-09-12T02:32:55.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:55 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:55.320+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:55.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:55 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:55.320+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:55.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:55 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:55.320+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:55.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:55 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:55.320+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:55.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:55 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:55.320+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:32:55.763 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:55.508+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:55.764 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:55.508+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:55.764 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:55.508+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:55.764 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:55.508+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:32:56.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:55.693+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:56.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:55.693+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:56.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:55.693+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:56.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:55.693+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:56.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:55 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:55.693+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:32:56.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:55.762+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:56.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:55.762+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:56.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:55.762+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:56.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:55 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:55.762+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:32:56.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:56 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:56.282+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:56.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:56 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:56.282+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:56.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:56 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:56.282+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:56.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:56 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:56.282+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:56.437 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:56 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:56.282+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:32:56.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:56.200+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:01.898051+0000 front 2024-09-12T02:32:01.898136+0000 (oldest deadline 2024-09-12T02:32:24.798299+0000) 2024-09-12T02:32:56.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:56.200+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:09.801245+0000 front 2024-09-12T02:32:09.801159+0000 (oldest deadline 2024-09-12T02:32:32.100911+0000) 2024-09-12T02:32:56.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:56.200+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.601840+0000 front 2024-09-12T02:32:15.601874+0000 (oldest deadline 2024-09-12T02:32:42.002285+0000) 2024-09-12T02:32:56.545 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7[52954]: 2024-09-12T02:32:56.200+0000 7f2e1b5bf640 -1 osd.7 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.204678+0000 front 2024-09-12T02:32:28.204719+0000 (oldest deadline 2024-09-12T02:32:52.904857+0000) 2024-09-12T02:32:56.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:56.530+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:56.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:56.530+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:56.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:56.530+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:56.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:56.530+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:32:56.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:56.745+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:56.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:56.745+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:56.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:56.745+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:56.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:56 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:56.745+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:32:57.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:56.690+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:57.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:56.690+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:57.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:56.690+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:57.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:56.690+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:57.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:56 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:56.690+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:32:57.424 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:57 smithi115 podman[72349]: 2024-09-12 02:32:57.137088448 +0000 UTC m=+6.047059780 container died 4db81c9bbefea3bcc5f0fa3f10a09030ef1c168759a2da9a5138ef60c0262fc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T02:32:57.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:57 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:57.243+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:57.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:57 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:57.243+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:57.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:57 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:57.243+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:57.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:57 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:57.243+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:57.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:57 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:57.243+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:32:57.711 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:57 smithi115 podman[72349]: 2024-09-12 02:32:57.523384932 +0000 UTC m=+6.433356262 container cleanup 4db81c9bbefea3bcc5f0fa3f10a09030ef1c168759a2da9a5138ef60c0262fc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T02:32:57.711 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:57 smithi115 bash[72349]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7 2024-09-12T02:32:57.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:57 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:57.529+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:57.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:57 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:57.529+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:57.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:57 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:57.529+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:57.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:57 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:57.529+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:32:57.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:57 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:57.748+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:57.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:57 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:57.748+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:57.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:57 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:57.748+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:57.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:57 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:57.748+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:32:58.045 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:57 smithi115 podman[72364]: 2024-09-12 02:32:57.841671753 +0000 UTC m=+0.700717497 container remove 4db81c9bbefea3bcc5f0fa3f10a09030ef1c168759a2da9a5138ef60c0262fc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T02:32:58.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:57 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:57.711+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:58.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:57 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:57.711+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:58.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:57 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:57.711+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:58.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:57 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:57.711+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:58.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:57 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:57.711+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:32:58.428 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:58 smithi115 podman[72449]: 2024-09-12 02:32:58.055914087 +0000 UTC m=+0.015697324 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:32:58.428 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:58 smithi115 podman[72449]: 2024-09-12 02:32:58.175821279 +0000 UTC m=+0.135604496 container create bcc5b3120e0c7e5381208a031088f530991e3eeb7d3b2c618e4c66af116830cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:32:58.428 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:58 smithi115 podman[72449]: 2024-09-12 02:32:58.428214048 +0000 UTC m=+0.387997264 container init bcc5b3120e0c7e5381208a031088f530991e3eeb7d3b2c618e4c66af116830cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T02:32:58.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:58 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:58.215+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:58.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:58 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:58.215+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:58.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:58 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:58.215+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:58.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:58 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:58.215+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:58.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:58 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:58.215+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:32:58.692 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:58 smithi115 podman[72449]: 2024-09-12 02:32:58.431509407 +0000 UTC m=+0.391292624 container start bcc5b3120e0c7e5381208a031088f530991e3eeb7d3b2c618e4c66af116830cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T02:32:58.692 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:58 smithi115 podman[72449]: 2024-09-12 02:32:58.536560986 +0000 UTC m=+0.496344202 container attach bcc5b3120e0c7e5381208a031088f530991e3eeb7d3b2c618e4c66af116830cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7-deactivate, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:32:58.692 INFO:journalctl@ceph.osd.7.smithi115.stdout:Sep 12 02:32:58 smithi115 podman[72449]: 2024-09-12 02:32:58.617064594 +0000 UTC m=+0.576847811 container died bcc5b3120e0c7e5381208a031088f530991e3eeb7d3b2c618e4c66af116830cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T02:32:58.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:58.563+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:58.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:58.563+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:58.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:58.563+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:58.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:58.563+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:32:58.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:58.749+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:32:58.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:58.749+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:32:58.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:58.749+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:32:58.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:58 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:58.749+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:32:58.981 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:58.690+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:32:58.981 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:58.690+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:32:58.981 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:58.690+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:32:58.981 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:58.691+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:32:58.982 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:58 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:58.691+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:32:59.333 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.7.service' 2024-09-12T02:32:59.373 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:32:59.373 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-12T02:32:59.374 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-12T02:32:59.374 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.8 2024-09-12T02:32:59.659 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:59 smithi136 systemd[1]: Stopping Ceph osd.8 for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:32:59.659 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:59.588+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:32:59.659 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:59.588+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:32:59.659 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:59.588+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:32:59.659 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:59.588+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:32:59.660 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:59.588+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:35.563620+0000 front 2024-09-12T02:32:35.563638+0000 (oldest deadline 2024-09-12T02:32:58.964091+0000) 2024-09-12T02:32:59.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:59 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:59.249+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:32:59.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:59 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:59.249+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:32:59.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:59 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:59.249+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:32:59.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:59 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:59.249+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:32:59.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:32:59 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:32:59.249+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:00.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:59.692+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:00.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:59.692+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:00.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:59.692+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:00.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:59.692+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:00.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:32:59 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:32:59.692+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:00.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:59.717+0000 7f71e2c48640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:33:00.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:59.717+0000 7f71e2c48640 -1 osd.8 122 *** Got signal Terminated *** 2024-09-12T02:33:00.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:32:59.717+0000 7f71e2c48640 -1 osd.8 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:33:00.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:59.798+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:00.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:59.798+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:00.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:59.798+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:00.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:59.798+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:00.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:32:59 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:32:59.798+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:00.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:00.238+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:00.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:00.238+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:00.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:00.238+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:00.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:00.238+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:00.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:00 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:00.238+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:00.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:00 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:00.543+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:33:00.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:00 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:00.543+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:33:00.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:00 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:00.543+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:33:00.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:00 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:00.543+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:33:00.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:00 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:00.543+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:35.563620+0000 front 2024-09-12T02:32:35.563638+0000 (oldest deadline 2024-09-12T02:32:58.964091+0000) 2024-09-12T02:33:00.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:00 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:00.783+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:00.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:00 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:00.783+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:00.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:00 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:00.783+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:00.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:00 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:00.783+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:00.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:00 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:00.783+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:01.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:00 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:00.661+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:01.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:00 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:00.661+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:01.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:00 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:00.661+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:01.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:00 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:00.661+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:01.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:00 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:00.661+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:01.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:01.284+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:01.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:01.284+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:01.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:01.284+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:01.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:01.284+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:01.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:01.284+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:01.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:01 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:01.284+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.988201+0000 front 2024-09-12T02:32:36.988408+0000 (oldest deadline 2024-09-12T02:33:01.087885+0000) 2024-09-12T02:33:01.795 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:01 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:01.533+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:33:01.795 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:01 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:01.533+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:33:01.795 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:01 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:01.533+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:33:01.796 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:01 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:01.533+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:33:01.796 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:01 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:01.533+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:35.563620+0000 front 2024-09-12T02:32:35.563638+0000 (oldest deadline 2024-09-12T02:32:58.964091+0000) 2024-09-12T02:33:02.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:01 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:01.686+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:02.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:01 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:01.686+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:02.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:01 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:01.686+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:02.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:01 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:01.686+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:02.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:01 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:01.686+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:02.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:01 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:01.793+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:02.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:01 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:01.793+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:02.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:01 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:01.793+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:02.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:01 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:01.793+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:02.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:01 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:01.793+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:02.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:02 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:02.269+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:02.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:02 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:02.269+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:02.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:02 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:02.269+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:02.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:02 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:02.269+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:02.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:02 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:02.269+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:02.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:02 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:02.269+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.988201+0000 front 2024-09-12T02:32:36.988408+0000 (oldest deadline 2024-09-12T02:33:01.087885+0000) 2024-09-12T02:33:02.766 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:02 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:02.509+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:33:02.766 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:02 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:02.509+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:33:02.766 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:02 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:02.509+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:33:02.766 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:02 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:02.509+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:33:02.766 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:02 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:02.509+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:35.563620+0000 front 2024-09-12T02:32:35.563638+0000 (oldest deadline 2024-09-12T02:32:58.964091+0000) 2024-09-12T02:33:03.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:02 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:02.682+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:03.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:02 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:02.682+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:03.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:02 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:02.682+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:03.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:02 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:02.682+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:03.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:02 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:02.682+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:03.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:02 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:02.682+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:03.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:02 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:02.765+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:03.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:02 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:02.765+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:03.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:02 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:02.765+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:03.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:02 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:02.765+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:03.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:02 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:02.765+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:03.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:03.266+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:03.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:03.266+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:03.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:03.266+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:03.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:03.266+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:03.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:03.266+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:03.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:03 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:03.266+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.988201+0000 front 2024-09-12T02:32:36.988408+0000 (oldest deadline 2024-09-12T02:33:01.087885+0000) 2024-09-12T02:33:03.751 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:03 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:03.478+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:33:03.751 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:03 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:03.478+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:33:03.751 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:03 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:03.478+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:33:03.751 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:03 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:03.478+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:33:03.751 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:03 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:03.478+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:35.563620+0000 front 2024-09-12T02:32:35.563638+0000 (oldest deadline 2024-09-12T02:32:58.964091+0000) 2024-09-12T02:33:04.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:03 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:03.699+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:04.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:03 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:03.699+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:04.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:03 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:03.699+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:04.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:03 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:03.699+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:04.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:03 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:03.699+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:04.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:03 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:03.699+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:04.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:03 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:03.750+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:04.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:03 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:03.750+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:04.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:03 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:03.750+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:04.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:03 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:03.750+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:04.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:03 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:03.750+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:04.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:04 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:04.308+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:04.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:04 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:04.308+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:04.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:04 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:04.308+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:04.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:04 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:04.308+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:04.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:04 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:04.308+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:04.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:04 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:04.308+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.988201+0000 front 2024-09-12T02:32:36.988408+0000 (oldest deadline 2024-09-12T02:33:01.087885+0000) 2024-09-12T02:33:04.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:04 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:04.507+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:00.256610+0000 front 2024-09-12T02:32:00.256595+0000 (oldest deadline 2024-09-12T02:32:24.356553+0000) 2024-09-12T02:33:04.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:04 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:04.507+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.857575+0000 front 2024-09-12T02:32:07.857656+0000 (oldest deadline 2024-09-12T02:32:33.157822+0000) 2024-09-12T02:33:04.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:04 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:04.507+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:15.459036+0000 front 2024-09-12T02:32:15.459131+0000 (oldest deadline 2024-09-12T02:32:41.859618+0000) 2024-09-12T02:33:04.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:04 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:04.507+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:28.162013+0000 front 2024-09-12T02:32:28.162030+0000 (oldest deadline 2024-09-12T02:32:52.262030+0000) 2024-09-12T02:33:04.909 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:04 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8[54155]: 2024-09-12T02:33:04.507+0000 7f71db256640 -1 osd.8 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:35.563620+0000 front 2024-09-12T02:32:35.563638+0000 (oldest deadline 2024-09-12T02:32:58.964091+0000) 2024-09-12T02:33:04.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:04 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:04.748+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:04.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:04 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:04.748+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:04.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:04 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:04.748+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:04.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:04 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:04.748+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:04.910 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:04 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:04.748+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:05.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:04 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:04.723+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:05.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:04 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:04.723+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:05.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:04 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:04.723+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:05.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:04 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:04.723+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:05.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:04 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:04.723+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:05.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:04 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:04.723+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:05.659 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:05 smithi136 podman[73968]: 2024-09-12 02:33:05.397770109 +0000 UTC m=+5.821148268 container died e0dbe21701d8f11f18adabd71a194fb7a00aeadabd882c18adfd5f7c3e7683a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-12T02:33:05.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:05.290+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:05.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:05.290+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:05.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:05.290+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:05.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:05.290+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:05.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:05.290+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:05.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:05 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:05.290+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.988201+0000 front 2024-09-12T02:32:36.988408+0000 (oldest deadline 2024-09-12T02:33:01.087885+0000) 2024-09-12T02:33:06.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:05 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:05.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:06.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:05 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:05.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:06.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:05 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:05.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:06.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:05 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:05.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:06.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:05 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:05.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:06.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:05 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:05.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:06.067 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:05 smithi136 podman[73968]: 2024-09-12 02:33:05.824491039 +0000 UTC m=+6.247869201 container cleanup e0dbe21701d8f11f18adabd71a194fb7a00aeadabd882c18adfd5f7c3e7683a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T02:33:06.067 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:05 smithi136 bash[73968]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8 2024-09-12T02:33:06.067 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:05 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:05.766+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:06.068 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:05 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:05.766+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:06.068 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:05 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:05.766+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:06.068 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:05 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:05.766+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:06.068 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:05 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:05.766+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:06.409 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:06 smithi136 podman[73983]: 2024-09-12 02:33:06.067602361 +0000 UTC m=+0.670125272 container remove e0dbe21701d8f11f18adabd71a194fb7a00aeadabd882c18adfd5f7c3e7683a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T02:33:06.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:06 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:06.323+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:06.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:06 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:06.323+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:06.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:06 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:06.323+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:06.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:06 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:06.323+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:06.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:06 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:06.323+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:06.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:06 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:06.323+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.988201+0000 front 2024-09-12T02:32:36.988408+0000 (oldest deadline 2024-09-12T02:33:01.087885+0000) 2024-09-12T02:33:06.736 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:06 smithi136 podman[74072]: 2024-09-12 02:33:06.476913628 +0000 UTC m=+0.110474651 container create a0212b1d50a8df2dcbb700801e7fd97aee5d5988817d3b07920efd5bb38d82f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-12T02:33:06.736 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:06 smithi136 podman[74072]: 2024-09-12 02:33:06.38240249 +0000 UTC m=+0.015963474 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:33:06.736 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:06 smithi136 podman[74072]: 2024-09-12 02:33:06.712811157 +0000 UTC m=+0.346372139 container init a0212b1d50a8df2dcbb700801e7fd97aee5d5988817d3b07920efd5bb38d82f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:33:06.736 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:06 smithi136 podman[74072]: 2024-09-12 02:33:06.716006607 +0000 UTC m=+0.349567591 container start a0212b1d50a8df2dcbb700801e7fd97aee5d5988817d3b07920efd5bb38d82f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T02:33:07.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:06 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:06.703+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:07.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:06 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:06.703+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:07.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:06 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:06.703+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:07.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:06 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:06.703+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:07.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:06 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:06.703+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:07.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:06 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:06.703+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:07.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:06 smithi136 podman[74072]: 2024-09-12 02:33:06.821495961 +0000 UTC m=+0.455056954 container attach a0212b1d50a8df2dcbb700801e7fd97aee5d5988817d3b07920efd5bb38d82f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:33:07.159 INFO:journalctl@ceph.osd.8.smithi136.stdout:Sep 12 02:33:06 smithi136 podman[74072]: 2024-09-12 02:33:06.911554948 +0000 UTC m=+0.545115932 container died a0212b1d50a8df2dcbb700801e7fd97aee5d5988817d3b07920efd5bb38d82f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-12T02:33:07.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:06 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:06.735+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:07.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:06 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:06.735+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:07.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:06 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:06.735+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:07.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:06 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:06.735+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:07.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:06 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:06.735+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:07.625 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.8.service' 2024-09-12T02:33:07.667 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:33:07.668 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-12T02:33:07.668 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-12T02:33:07.668 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.9 2024-09-12T02:33:07.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:07 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:07.370+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:07.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:07 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:07.370+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:07.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:07 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:07.370+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:07.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:07 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:07.370+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:07.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:07 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:07.370+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:07.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:07 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:07.370+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.988201+0000 front 2024-09-12T02:32:36.988408+0000 (oldest deadline 2024-09-12T02:33:01.087885+0000) 2024-09-12T02:33:07.880 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:07 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:07.763+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:07.880 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:07 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:07.763+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:07.880 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:07 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:07.763+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:07.881 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:07 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:07.763+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:07.881 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:07 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:07.763+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:08.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:07 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:07.662+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:08.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:07 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:07.662+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:08.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:07 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:07.662+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:08.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:07 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:07.662+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:08.046 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:07 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:07.662+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:08.046 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:07 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:07.662+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:08.089 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:07 smithi110 systemd[1]: Stopping Ceph osd.9 for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:33:08.089 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:08.088+0000 7f9e85e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:33:08.089 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:08.088+0000 7f9e85e00640 -1 osd.9 122 *** Got signal Terminated *** 2024-09-12T02:33:08.089 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:08.088+0000 7f9e85e00640 -1 osd.9 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:33:08.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:08.363+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:08.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:08.363+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:08.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:08.363+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:08.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:08.363+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:08.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:08.363+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:08.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:08 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:08.363+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.988201+0000 front 2024-09-12T02:32:36.988408+0000 (oldest deadline 2024-09-12T02:33:01.087885+0000) 2024-09-12T02:33:09.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:08 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:08.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:09.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:08 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:08.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:09.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:08 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:08.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:09.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:08 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:08.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:09.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:08 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:08.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:09.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:08 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:08.687+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:09.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:08 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:08.729+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:09.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:08 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:08.729+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:09.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:08 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:08.729+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:09.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:08 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:08.729+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:09.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:08 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:08.729+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:09.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:09 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:09.393+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:09.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:09 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:09.393+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:09.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:09 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:09.393+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:09.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:09 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:09.393+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:09.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:09 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:09.393+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:09.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:09 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:09.393+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.988201+0000 front 2024-09-12T02:32:36.988408+0000 (oldest deadline 2024-09-12T02:33:01.087885+0000) 2024-09-12T02:33:10.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:09 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:09.648+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:10.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:09 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:09.648+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:10.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:09 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:09.648+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:10.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:09 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:09.648+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:10.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:09 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:09.648+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:10.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:09 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:09.648+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:10.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:09 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:09.758+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:10.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:09 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:09.758+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:10.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:09 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:09.758+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:10.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:09 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:09.758+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:10.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:09 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:09.758+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:10.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:10 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:10.435+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:10.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:10 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:10.435+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:10.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:10 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:10.435+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:10.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:10 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:10.435+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:10.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:10 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:10.435+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:10.688 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:10 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:10.435+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.988201+0000 front 2024-09-12T02:32:36.988408+0000 (oldest deadline 2024-09-12T02:33:01.087885+0000) 2024-09-12T02:33:11.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:10 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:10.652+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:11.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:10 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:10.652+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:11.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:10 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:10.652+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:11.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:10 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:10.652+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:11.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:10 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:10.652+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:11.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:10 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:10.652+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:11.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:10 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:10.652+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:11.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:10 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:10.802+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:11.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:10 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:10.802+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:11.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:10 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:10.802+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:11.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:10 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:10.802+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:11.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:10 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:10.802+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:11.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:10 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:10.802+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:11.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:11 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:11.406+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:11.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:11 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:11.406+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:11.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:11 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:11.406+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:11.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:11 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:11.406+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:11.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:11 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:11.406+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:11.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:11 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:11.406+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.988201+0000 front 2024-09-12T02:32:36.988408+0000 (oldest deadline 2024-09-12T02:33:01.087885+0000) 2024-09-12T02:33:12.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:11 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:11.695+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:12.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:11 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:11.695+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:12.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:11 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:11.695+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:12.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:11 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:11.695+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:12.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:11 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:11.695+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:12.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:11 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:11.695+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:12.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:11 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:11.695+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:12.060 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:11 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:11.792+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:12.060 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:11 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:11.792+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:12.061 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:11 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:11.792+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:12.061 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:11 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:11.792+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:12.061 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:11 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:11.792+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:12.061 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:11 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:11.792+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:12.937 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:12.440+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.679805+0000 front 2024-09-12T02:31:51.679682+0000 (oldest deadline 2024-09-12T02:32:16.880215+0000) 2024-09-12T02:33:12.937 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:12.440+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.681922+0000 front 2024-09-12T02:32:02.681834+0000 (oldest deadline 2024-09-12T02:32:27.282255+0000) 2024-09-12T02:33:12.937 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:12.440+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:11.283975+0000 front 2024-09-12T02:32:11.283822+0000 (oldest deadline 2024-09-12T02:32:33.583919+0000) 2024-09-12T02:33:12.937 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:12.440+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:19.485282+0000 front 2024-09-12T02:32:19.485121+0000 (oldest deadline 2024-09-12T02:32:44.785175+0000) 2024-09-12T02:33:12.937 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:12.440+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.686410+0000 front 2024-09-12T02:32:27.686491+0000 (oldest deadline 2024-09-12T02:32:51.186210+0000) 2024-09-12T02:33:12.937 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:12 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9[65052]: 2024-09-12T02:33:12.440+0000 7f9e7c800640 -1 osd.9 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.988201+0000 front 2024-09-12T02:32:36.988408+0000 (oldest deadline 2024-09-12T02:33:01.087885+0000) 2024-09-12T02:33:13.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:12 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:12.680+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:13.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:12 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:12.680+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:13.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:12 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:12.680+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:13.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:12 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:12.680+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:13.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:12 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:12.680+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:13.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:12 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:12.680+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:13.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:12 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:12.680+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:13.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:12 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:12.763+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:13.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:12 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:12.763+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:13.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:12 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:12.763+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:13.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:12 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:12.763+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:13.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:12 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:12.763+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:13.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:12 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:12.763+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:14.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:13 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:13.666+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:14.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:13 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:13.666+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:14.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:13 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:13.666+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:14.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:13 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:13.666+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:14.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:13 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:13.666+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:14.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:13 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:13.666+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:14.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:13 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:13.666+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:14.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:13 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:13.786+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:14.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:13 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:13.786+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:14.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:13 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:13.786+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:14.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:13 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:13.786+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:14.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:13 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:13.786+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:14.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:13 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:13.786+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:15.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:14 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:14.624+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:15.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:14 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:14.624+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:15.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:14 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:14.624+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:15.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:14 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:14.624+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:15.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:14 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:14.624+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:15.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:14 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:14.624+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:15.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:14 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:14.624+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:15.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:14 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:14.779+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:15.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:14 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:14.779+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:15.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:14 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:14.779+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:15.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:14 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:14.779+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:15.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:14 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:14.779+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:15.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:14 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:14.779+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:15.309 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:14 smithi110 podman[92953]: 2024-09-12 02:33:14.983260623 +0000 UTC m=+7.019987211 container died 562cb25adf6cc9bed1e2479c4e8f2b045d414eaf231ace647a6eaff1362e0906 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T02:33:15.686 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:15 smithi110 podman[92953]: 2024-09-12 02:33:15.426863493 +0000 UTC m=+7.463590078 container cleanup 562cb25adf6cc9bed1e2479c4e8f2b045d414eaf231ace647a6eaff1362e0906 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T02:33:15.687 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:15 smithi110 bash[92953]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9 2024-09-12T02:33:16.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:15 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:15.603+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:16.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:15 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:15.603+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:16.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:15 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:15.603+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:16.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:15 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:15.603+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:16.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:15 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:15.603+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:16.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:15 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:15.603+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:16.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:15 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:15.603+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:16.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:15 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:15.781+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:16.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:15 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:15.781+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:16.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:15 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:15.781+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:16.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:15 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:15.781+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:16.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:15 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:15.781+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:16.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:15 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:15.781+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:16.186 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:15 smithi110 podman[92968]: 2024-09-12 02:33:15.694735564 +0000 UTC m=+0.680930979 container remove 562cb25adf6cc9bed1e2479c4e8f2b045d414eaf231ace647a6eaff1362e0906 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T02:33:16.472 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:16 smithi110 podman[93055]: 2024-09-12 02:33:16.119886337 +0000 UTC m=+0.027019576 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:33:16.472 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:16 smithi110 podman[93055]: 2024-09-12 02:33:16.22926018 +0000 UTC m=+0.136393398 container create ff50add2cb035a7c6c7f0d52d6320bd7b4819ab94cca6d9e975c22d73423f866 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-12T02:33:16.472 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:16 smithi110 podman[93055]: 2024-09-12 02:33:16.465173704 +0000 UTC m=+0.372306942 container init ff50add2cb035a7c6c7f0d52d6320bd7b4819ab94cca6d9e975c22d73423f866 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T02:33:16.472 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:16 smithi110 podman[93055]: 2024-09-12 02:33:16.471790095 +0000 UTC m=+0.378923313 container start ff50add2cb035a7c6c7f0d52d6320bd7b4819ab94cca6d9e975c22d73423f866 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T02:33:16.937 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:16 smithi110 podman[93055]: 2024-09-12 02:33:16.581614225 +0000 UTC m=+0.488747451 container attach ff50add2cb035a7c6c7f0d52d6320bd7b4819ab94cca6d9e975c22d73423f866 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T02:33:16.937 INFO:journalctl@ceph.osd.9.smithi110.stdout:Sep 12 02:33:16 smithi110 podman[93055]: 2024-09-12 02:33:16.719636731 +0000 UTC m=+0.626769960 container died ff50add2cb035a7c6c7f0d52d6320bd7b4819ab94cca6d9e975c22d73423f866 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-9-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T02:33:17.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:16 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:16.614+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:17.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:16 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:16.614+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:17.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:16 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:16.614+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:17.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:16 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:16.614+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:17.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:16 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:16.614+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:17.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:16 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:16.614+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:17.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:16 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:16.614+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:17.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:16 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:16.782+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:17.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:16 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:16.782+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:17.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:16 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:16.782+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:17.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:16 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:16.782+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:17.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:16 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:16.782+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:17.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:16 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:16.782+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:17.449 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.9.service' 2024-09-12T02:33:17.567 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:33:17.567 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-12T02:33:17.567 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-12T02:33:17.567 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.10 2024-09-12T02:33:17.892 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:17 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:17.598+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:17.892 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:17 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:17.598+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:17.892 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:17 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:17.598+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:17.892 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:17 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:17.598+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:17.892 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:17 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:17.598+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:17.892 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:17 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:17.598+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:17.892 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:17 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:17.598+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:17.892 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:17 smithi115 systemd[1]: Stopping Ceph osd.10 for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:33:17.892 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:17 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:17.889+0000 7f914c102640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:33:17.892 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:17 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:17.889+0000 7f914c102640 -1 osd.10 122 *** Got signal Terminated *** 2024-09-12T02:33:17.892 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:17 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:17.889+0000 7f914c102640 -1 osd.10 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:33:18.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:17 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:17.756+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:18.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:17 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:17.756+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:18.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:17 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:17.756+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:18.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:17 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:17.756+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:18.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:17 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:17.756+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:18.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:17 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:17.756+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:19.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:18 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:18.570+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:19.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:18 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:18.570+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:19.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:18 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:18.570+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:19.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:18 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:18.570+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:19.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:18 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:18.570+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:19.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:18 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:18.570+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:19.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:18 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:18.570+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:19.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:18 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:18.723+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:19.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:18 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:18.723+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:19.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:18 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:18.723+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:19.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:18 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:18.723+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:19.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:18 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:18.723+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:19.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:18 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:18.723+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:19.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:18 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:18.723+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:19.795 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:19 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:19.537+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:19.795 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:19 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:19.537+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:19.795 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:19 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:19.537+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:19.795 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:19 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:19.537+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:19.795 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:19 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:19.537+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:19.795 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:19 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:19.537+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:19.796 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:19 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:19.537+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:20.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:19 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:19.678+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:20.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:19 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:19.678+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:20.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:19 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:19.678+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:20.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:19 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:19.678+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:20.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:19 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:19.678+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:20.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:19 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:19.678+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:20.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:19 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:19.678+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:20.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:20.634+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:20.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:20.634+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:20.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:20.634+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:20.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:20.634+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:20.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:20.634+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:20.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:20.634+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:20.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:20 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:20.634+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:21.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:20.577+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:21.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:20.577+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:21.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:20.577+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:21.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:20.577+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:21.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:20.577+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:21.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:20.577+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:21.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:20 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:20.577+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:21.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:21 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:21.648+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:21.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:21 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:21.648+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:21.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:21 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:21.648+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:21.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:21 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:21.648+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:21.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:21 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:21.648+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:21.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:21 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:21.648+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:21.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:21 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:21.648+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:22.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:21 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:21.589+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:22.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:21 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:21.589+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:22.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:21 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:21.589+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:22.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:21 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:21.589+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:22.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:21 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:21.589+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:22.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:21 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:21.589+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:22.046 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:21 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:21.589+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:23.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:22 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:22.550+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:51.612266+0000 front 2024-09-12T02:31:51.612302+0000 (oldest deadline 2024-09-12T02:32:15.112134+0000) 2024-09-12T02:33:23.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:22 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:22.550+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:31:59.113841+0000 front 2024-09-12T02:31:59.113994+0000 (oldest deadline 2024-09-12T02:32:24.414094+0000) 2024-09-12T02:33:23.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:22 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:22.550+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:10.315534+0000 front 2024-09-12T02:32:10.315493+0000 (oldest deadline 2024-09-12T02:32:33.815257+0000) 2024-09-12T02:33:23.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:22 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:22.550+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6814 osd.3 since back 2024-09-12T02:32:18.818257+0000 front 2024-09-12T02:32:18.818198+0000 (oldest deadline 2024-09-12T02:32:42.318167+0000) 2024-09-12T02:33:23.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:22 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:22.550+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:27.619169+0000 front 2024-09-12T02:32:27.619206+0000 (oldest deadline 2024-09-12T02:32:50.519322+0000) 2024-09-12T02:33:23.045 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:22 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:22.550+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:34.520647+0000 front 2024-09-12T02:32:34.520608+0000 (oldest deadline 2024-09-12T02:33:02.121129+0000) 2024-09-12T02:33:23.046 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:22 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10[59951]: 2024-09-12T02:33:22.550+0000 7f9144710640 -1 osd.10 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.622475+0000 front 2024-09-12T02:32:45.622456+0000 (oldest deadline 2024-09-12T02:33:10.322331+0000) 2024-09-12T02:33:23.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:22 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:22.674+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:23.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:22 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:22.674+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:23.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:22 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:22.674+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:23.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:22 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:22.674+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:23.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:22 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:22.674+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:23.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:22 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:22.674+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:23.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:22 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:22.674+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:23.998 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:23 smithi115 podman[72565]: 2024-09-12 02:33:23.735618108 +0000 UTC m=+5.973625317 container died f9e78c20f1c7ef549c5c4d9abbfd3d7a13f7828c65abd3b80f9a827c1228ecc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:33:24.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:23 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:23.703+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:24.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:23 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:23.703+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:24.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:23 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:23.703+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:24.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:23 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:23.703+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:24.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:23 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:23.703+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:24.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:23 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:23.703+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:24.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:23 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:23.703+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:24.294 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:24 smithi115 podman[72565]: 2024-09-12 02:33:24.081325673 +0000 UTC m=+6.319332881 container cleanup f9e78c20f1c7ef549c5c4d9abbfd3d7a13f7828c65abd3b80f9a827c1228ecc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T02:33:24.295 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:24 smithi115 bash[72565]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10 2024-09-12T02:33:24.742 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:24 smithi115 podman[72579]: 2024-09-12 02:33:24.332716307 +0000 UTC m=+0.592251829 container remove f9e78c20f1c7ef549c5c4d9abbfd3d7a13f7828c65abd3b80f9a827c1228ecc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:33:24.994 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:24 smithi115 podman[72665]: 2024-09-12 02:33:24.645137095 +0000 UTC m=+0.015740516 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:33:24.994 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:24 smithi115 podman[72665]: 2024-09-12 02:33:24.750016141 +0000 UTC m=+0.120619597 container create 8d13200a9b841c6ba949f96e19379bae7f7947834603bbadc2d0ea12630fb588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T02:33:24.994 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:24 smithi115 podman[72665]: 2024-09-12 02:33:24.994221579 +0000 UTC m=+0.364824988 container init 8d13200a9b841c6ba949f96e19379bae7f7947834603bbadc2d0ea12630fb588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-12T02:33:25.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:24 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:24.752+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:25.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:24 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:24.752+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:25.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:24 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:24.752+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:25.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:24 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:24.752+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:25.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:24 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:24.752+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:25.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:24 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:24.752+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:25.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:24 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:24.752+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:25.295 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:24 smithi115 podman[72665]: 2024-09-12 02:33:24.997824642 +0000 UTC m=+0.368428053 container start 8d13200a9b841c6ba949f96e19379bae7f7947834603bbadc2d0ea12630fb588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True) 2024-09-12T02:33:25.295 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:25 smithi115 podman[72665]: 2024-09-12 02:33:25.069125685 +0000 UTC m=+0.439729096 container attach 8d13200a9b841c6ba949f96e19379bae7f7947834603bbadc2d0ea12630fb588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:33:25.295 INFO:journalctl@ceph.osd.10.smithi115.stdout:Sep 12 02:33:25 smithi115 podman[72665]: 2024-09-12 02:33:25.18453648 +0000 UTC m=+0.555139891 container died 8d13200a9b841c6ba949f96e19379bae7f7947834603bbadc2d0ea12630fb588 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T02:33:25.718 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.10.service' 2024-09-12T02:33:25.758 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:33:25.758 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-12T02:33:25.759 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-12T02:33:25.759 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.11 2024-09-12T02:33:26.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:25 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:25.798+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:26.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:25 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:25.798+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:26.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:25 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:25.798+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:26.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:25 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:25.798+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:26.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:25 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:25.798+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:26.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:25 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:25.798+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:26.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:25 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:25.798+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:26.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:25 smithi136 systemd[1]: Stopping Ceph osd.11 for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:33:26.659 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:26.227+0000 7f8da99db640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:33:26.659 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:26.227+0000 7f8da99db640 -1 osd.11 122 *** Got signal Terminated *** 2024-09-12T02:33:26.659 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:26.227+0000 7f8da99db640 -1 osd.11 122 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T02:33:27.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:26.825+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:27.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:26.825+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:27.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:26.825+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:27.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:26.825+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:27.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:26.825+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:27.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:26.825+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:27.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:26 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:26.825+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:28.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:27 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:27.807+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:28.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:27 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:27.807+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:28.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:27 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:27.807+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:28.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:27 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:27.807+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:28.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:27 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:27.807+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:28.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:27 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:27.807+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:28.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:27 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:27.807+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:29.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:28 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:28.771+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:29.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:28 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:28.771+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:29.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:28 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:28.771+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:29.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:28 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:28.771+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:29.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:28 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:28.771+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:29.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:28 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:28.771+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:29.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:28 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:28.771+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:30.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:29.794+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:30.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:29.794+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:30.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:29.794+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:30.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:29.794+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:30.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:29.794+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:30.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:29.794+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:30.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:29.794+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:30.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:29 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:29.794+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6820 osd.8 since back 2024-09-12T02:33:00.268034+0000 front 2024-09-12T02:33:00.268053+0000 (oldest deadline 2024-09-12T02:33:29.068571+0000) 2024-09-12T02:33:31.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:30.806+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6806 osd.0 since back 2024-09-12T02:31:52.856322+0000 front 2024-09-12T02:31:52.856129+0000 (oldest deadline 2024-09-12T02:32:15.156146+0000) 2024-09-12T02:33:31.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:30.806+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6804 osd.1 since back 2024-09-12T02:32:02.658959+0000 front 2024-09-12T02:32:02.658890+0000 (oldest deadline 2024-09-12T02:32:27.959029+0000) 2024-09-12T02:33:31.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:30.806+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6804 osd.2 since back 2024-09-12T02:32:07.959575+0000 front 2024-09-12T02:32:07.959558+0000 (oldest deadline 2024-09-12T02:32:33.859702+0000) 2024-09-12T02:33:31.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:30.806+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6812 osd.4 since back 2024-09-12T02:32:26.662565+0000 front 2024-09-12T02:32:26.662507+0000 (oldest deadline 2024-09-12T02:32:52.562551+0000) 2024-09-12T02:33:31.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:30.806+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6812 osd.5 since back 2024-09-12T02:32:36.663254+0000 front 2024-09-12T02:32:36.663300+0000 (oldest deadline 2024-09-12T02:32:58.963444+0000) 2024-09-12T02:33:31.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:30.806+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.110:6822 osd.6 since back 2024-09-12T02:32:45.165653+0000 front 2024-09-12T02:32:45.165734+0000 (oldest deadline 2024-09-12T02:33:10.465631+0000) 2024-09-12T02:33:31.159 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:30.806+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.115:6820 osd.7 since back 2024-09-12T02:32:53.867225+0000 front 2024-09-12T02:32:53.867147+0000 (oldest deadline 2024-09-12T02:33:17.967109+0000) 2024-09-12T02:33:31.160 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:30 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11[61156]: 2024-09-12T02:33:30.806+0000 7f8da5ff1640 -1 osd.11 122 heartbeat_check: no reply from 172.21.15.136:6820 osd.8 since back 2024-09-12T02:33:00.268034+0000 front 2024-09-12T02:33:00.268053+0000 (oldest deadline 2024-09-12T02:33:29.068571+0000) 2024-09-12T02:33:32.244 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:31 smithi136 podman[74185]: 2024-09-12 02:33:31.963267094 +0000 UTC m=+6.009817394 container died 01074c7a3b2fe4bb19f0730d4badc61a68c17586a69ad0f01d15bec992bac177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-12T02:33:32.611 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:32 smithi136 podman[74185]: 2024-09-12 02:33:32.318196158 +0000 UTC m=+6.364746466 container cleanup 01074c7a3b2fe4bb19f0730d4badc61a68c17586a69ad0f01d15bec992bac177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T02:33:32.611 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:32 smithi136 bash[74185]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11 2024-09-12T02:33:32.909 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:32 smithi136 podman[74200]: 2024-09-12 02:33:32.611096287 +0000 UTC m=+0.643154358 container remove 01074c7a3b2fe4bb19f0730d4badc61a68c17586a69ad0f01d15bec992bac177 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:33:33.231 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:32 smithi136 podman[74285]: 2024-09-12 02:33:32.820871455 +0000 UTC m=+0.016069200 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T02:33:33.231 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:32 smithi136 podman[74285]: 2024-09-12 02:33:32.928754187 +0000 UTC m=+0.123951923 container create 0a44172ef89bf9d8041cc51f10d2e05a3f5519c79587756171aeb0c0c0af64f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True) 2024-09-12T02:33:33.231 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:33 smithi136 podman[74285]: 2024-09-12 02:33:33.147712143 +0000 UTC m=+0.342909883 container init 0a44172ef89bf9d8041cc51f10d2e05a3f5519c79587756171aeb0c0c0af64f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T02:33:33.231 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:33 smithi136 podman[74285]: 2024-09-12 02:33:33.150897478 +0000 UTC m=+0.346095218 container start 0a44172ef89bf9d8041cc51f10d2e05a3f5519c79587756171aeb0c0c0af64f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-09-12T02:33:33.231 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:33 smithi136 podman[74285]: 2024-09-12 02:33:33.231060679 +0000 UTC m=+0.426258417 container attach 0a44172ef89bf9d8041cc51f10d2e05a3f5519c79587756171aeb0c0c0af64f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T02:33:33.642 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:33 smithi136 podman[74285]: 2024-09-12 02:33:33.344091893 +0000 UTC m=+0.539289630 container died 0a44172ef89bf9d8041cc51f10d2e05a3f5519c79587756171aeb0c0c0af64f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T02:33:33.893 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:33 smithi136 podman[74307]: 2024-09-12 02:33:33.876362896 +0000 UTC m=+0.521524143 container remove 0a44172ef89bf9d8041cc51f10d2e05a3f5519c79587756171aeb0c0c0af64f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-12T02:33:33.893 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:33 smithi136 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.11.service: Deactivated successfully. 2024-09-12T02:33:33.893 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:33 smithi136 systemd[1]: Stopped Ceph osd.11 for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:33:33.893 INFO:journalctl@ceph.osd.11.smithi136.stdout:Sep 12 02:33:33 smithi136 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.11.service: Consumed 14min 1.716s CPU time. 2024-09-12T02:33:33.895 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@osd.11.service' 2024-09-12T02:33:33.932 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:33:33.933 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-12T02:33:33.933 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-12T02:33:33.933 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.a 2024-09-12T02:33:34.341 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:33:34 smithi110 systemd[1]: Stopping Ceph mds.a for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:33:34.686 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:33:34 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a[72164]: 2024-09-12T02:33:34.339+0000 7f6eb9600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:33:34.687 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:33:34 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a[72164]: 2024-09-12T02:33:34.339+0000 7f6eb9600640 -1 mds.a *** got signal Terminated *** 2024-09-12T02:33:37.187 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:33:36 smithi110 podman[93168]: 2024-09-12 02:33:36.911950737 +0000 UTC m=+2.686049059 container died d50551b60e6ebaca2ba749cb3a9205a79cf68fb9ae28d9f3c760f959a9bfced5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3) 2024-09-12T02:33:37.646 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:33:37 smithi110 podman[93168]: 2024-09-12 02:33:37.40315201 +0000 UTC m=+3.177250339 container cleanup d50551b60e6ebaca2ba749cb3a9205a79cf68fb9ae28d9f3c760f959a9bfced5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T02:33:37.646 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:33:37 smithi110 bash[93168]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a 2024-09-12T02:33:37.899 INFO:journalctl@ceph.mds.a.smithi110.stdout:Sep 12 02:33:37 smithi110 podman[93181]: 2024-09-12 02:33:37.646334071 +0000 UTC m=+0.718409334 container remove d50551b60e6ebaca2ba749cb3a9205a79cf68fb9ae28d9f3c760f959a9bfced5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-a, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:33:37.907 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.a.service' 2024-09-12T02:33:37.978 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:33:37.979 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-12T02:33:37.979 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-12T02:33:37.979 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.d 2024-09-12T02:33:38.186 INFO:journalctl@ceph.mds.d.smithi110.stdout:Sep 12 02:33:38 smithi110 systemd[1]: Stopping Ceph mds.d for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:33:38.686 INFO:journalctl@ceph.mds.d.smithi110.stdout:Sep 12 02:33:38 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-d[70997]: 2024-09-12T02:33:38.376+0000 7fe0cb600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:33:38.686 INFO:journalctl@ceph.mds.d.smithi110.stdout:Sep 12 02:33:38 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-d[70997]: 2024-09-12T02:33:38.376+0000 7fe0cb600640 -1 mds.d *** got signal Terminated *** 2024-09-12T02:33:42.375 INFO:journalctl@ceph.mds.d.smithi110.stdout:Sep 12 02:33:42 smithi110 podman[93290]: 2024-09-12 02:33:42.063672546 +0000 UTC m=+3.807965975 container died db5421d39bba1bcb2dc8f794fceb7d627c9bf63a7fd11471f0ebef652a118afc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-d, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T02:33:42.687 INFO:journalctl@ceph.mds.d.smithi110.stdout:Sep 12 02:33:42 smithi110 podman[93290]: 2024-09-12 02:33:42.481653132 +0000 UTC m=+4.225946560 container cleanup db5421d39bba1bcb2dc8f794fceb7d627c9bf63a7fd11471f0ebef652a118afc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T02:33:42.687 INFO:journalctl@ceph.mds.d.smithi110.stdout:Sep 12 02:33:42 smithi110 bash[93290]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-d 2024-09-12T02:33:43.042 INFO:journalctl@ceph.mds.d.smithi110.stdout:Sep 12 02:33:42 smithi110 podman[93303]: 2024-09-12 02:33:42.79148519 +0000 UTC m=+0.715010420 container remove db5421d39bba1bcb2dc8f794fceb7d627c9bf63a7fd11471f0ebef652a118afc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:33:43.048 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.d.service' 2024-09-12T02:33:43.117 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:33:43.118 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-12T02:33:43.118 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-12T02:33:43.118 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.g 2024-09-12T02:33:43.436 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:33:43 smithi110 systemd[1]: Stopping Ceph mds.g for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:33:43.937 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:33:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-g[71758]: 2024-09-12T02:33:43.529+0000 7fb758c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:33:43.937 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:33:43 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-g[71758]: 2024-09-12T02:33:43.529+0000 7fb758c00640 -1 mds.g *** got signal Terminated *** 2024-09-12T02:33:47.879 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:33:47 smithi110 podman[93407]: 2024-09-12 02:33:47.563755207 +0000 UTC m=+4.179322158 container died 29b2fbabe8de861229e9602f1839e7df0c7bf043faa8aa31585b98b10201e36c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-12T02:33:48.186 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:33:47 smithi110 podman[93407]: 2024-09-12 02:33:47.985889073 +0000 UTC m=+4.601456024 container cleanup 29b2fbabe8de861229e9602f1839e7df0c7bf043faa8aa31585b98b10201e36c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:33:48.187 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:33:47 smithi110 bash[93407]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-g 2024-09-12T02:33:48.541 INFO:journalctl@ceph.mds.g.smithi110.stdout:Sep 12 02:33:48 smithi110 podman[93421]: 2024-09-12 02:33:48.295863436 +0000 UTC m=+0.721818636 container remove 29b2fbabe8de861229e9602f1839e7df0c7bf043faa8aa31585b98b10201e36c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-12T02:33:48.568 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.g.service' 2024-09-12T02:33:48.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:33:48.637 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-12T02:33:48.637 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-12T02:33:48.637 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.j 2024-09-12T02:33:48.936 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:33:48 smithi110 systemd[1]: Stopping Ceph mds.j for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:33:49.436 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:33:49 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-j[70590]: 2024-09-12T02:33:49.042+0000 7f3cd7400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:33:49.437 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:33:49 smithi110 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-j[70590]: 2024-09-12T02:33:49.042+0000 7f3cd7400640 -1 mds.j *** got signal Terminated *** 2024-09-12T02:33:53.417 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:33:53 smithi110 podman[93527]: 2024-09-12 02:33:53.062918329 +0000 UTC m=+4.148992104 container died 6db31af053e74dc1bf402cc71c9d9e02b3f613ef1cdb1346fef9f59a81d2cb81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T02:33:53.686 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:33:53 smithi110 podman[93527]: 2024-09-12 02:33:53.531423639 +0000 UTC m=+4.617497414 container cleanup 6db31af053e74dc1bf402cc71c9d9e02b3f613ef1cdb1346fef9f59a81d2cb81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-j, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:33:53.687 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:33:53 smithi110 bash[93527]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-j 2024-09-12T02:33:54.047 INFO:journalctl@ceph.mds.j.smithi110.stdout:Sep 12 02:33:53 smithi110 podman[93551]: 2024-09-12 02:33:53.791274107 +0000 UTC m=+0.721748685 container remove 6db31af053e74dc1bf402cc71c9d9e02b3f613ef1cdb1346fef9f59a81d2cb81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T02:33:54.056 DEBUG:teuthology.orchestra.run.smithi110:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.j.service' 2024-09-12T02:33:54.127 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:33:54.127 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-12T02:33:54.128 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-12T02:33:54.128 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.b 2024-09-12T02:33:54.545 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:33:54 smithi115 systemd[1]: Stopping Ceph mds.b for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:33:54.545 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:33:54 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b[65150]: 2024-09-12T02:33:54.403+0000 7f6a444e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:33:54.545 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:33:54 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b[65150]: 2024-09-12T02:33:54.403+0000 7f6a444e3640 -1 mds.b *** got signal Terminated *** 2024-09-12T02:33:57.028 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:33:56 smithi115 podman[72765]: 2024-09-12 02:33:56.760302696 +0000 UTC m=+2.443321257 container died 190d421cfddae961a7723b9a78f5d448fa77ff0ee567d090d0c5ca8ed8dccd29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T02:33:57.295 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:33:57 smithi115 podman[72765]: 2024-09-12 02:33:57.135945395 +0000 UTC m=+2.818963955 container cleanup 190d421cfddae961a7723b9a78f5d448fa77ff0ee567d090d0c5ca8ed8dccd29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T02:33:57.295 INFO:journalctl@ceph.mds.b.smithi115.stdout:Sep 12 02:33:57 smithi115 bash[72765]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-b 2024-09-12T02:33:57.569 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.b.service' 2024-09-12T02:33:57.606 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:33:57.606 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-12T02:33:57.606 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-12T02:33:57.606 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.e 2024-09-12T02:33:57.940 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:33:57 smithi115 systemd[1]: Stopping Ceph mds.e for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:33:58.295 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:33:57 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-e[64546]: 2024-09-12T02:33:57.940+0000 7fdd55d96640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:33:58.295 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:33:57 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-e[64546]: 2024-09-12T02:33:57.940+0000 7fdd55d96640 -1 mds.e *** got signal Terminated *** 2024-09-12T02:34:00.940 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:34:00 smithi115 podman[72899]: 2024-09-12 02:34:00.661050011 +0000 UTC m=+2.833109724 container died 98167f62abd0ebb10736b96b74df3b41190d7c75ec82a0fa98a65a4215eb427e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-e, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T02:34:01.295 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:34:01 smithi115 podman[72899]: 2024-09-12 02:34:01.081077142 +0000 UTC m=+3.253136854 container cleanup 98167f62abd0ebb10736b96b74df3b41190d7c75ec82a0fa98a65a4215eb427e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-12T02:34:01.295 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:34:01 smithi115 bash[72899]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-e 2024-09-12T02:34:01.551 INFO:journalctl@ceph.mds.e.smithi115.stdout:Sep 12 02:34:01 smithi115 podman[72911]: 2024-09-12 02:34:01.29883751 +0000 UTC m=+0.632313013 container remove 98167f62abd0ebb10736b96b74df3b41190d7c75ec82a0fa98a65a4215eb427e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:34:01.555 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.e.service' 2024-09-12T02:34:01.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:01.589 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-12T02:34:01.589 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-12T02:34:01.589 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.h 2024-09-12T02:34:01.901 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:34:01 smithi115 systemd[1]: Stopping Ceph mds.h for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:34:02.294 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:34:01 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h[64847]: 2024-09-12T02:34:01.901+0000 7fc25beb9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:34:02.295 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:34:01 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h[64847]: 2024-09-12T02:34:01.901+0000 7fc25beb9640 -1 mds.h *** got signal Terminated *** 2024-09-12T02:34:05.045 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:34:04 smithi115 podman[73016]: 2024-09-12 02:34:04.765684553 +0000 UTC m=+2.966329224 container died d193662e59b28ac6633d489b78eca3a5c9ff2b70d346e579f6d758beb501c55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-12T02:34:05.443 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:34:05 smithi115 podman[73016]: 2024-09-12 02:34:05.192313487 +0000 UTC m=+3.392958199 container cleanup d193662e59b28ac6633d489b78eca3a5c9ff2b70d346e579f6d758beb501c55b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731) 2024-09-12T02:34:05.443 INFO:journalctl@ceph.mds.h.smithi115.stdout:Sep 12 02:34:05 smithi115 bash[73016]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-h 2024-09-12T02:34:05.623 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.h.service' 2024-09-12T02:34:05.656 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:05.656 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-12T02:34:05.656 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-12T02:34:05.656 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.k 2024-09-12T02:34:06.045 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:34:05 smithi115 systemd[1]: Stopping Ceph mds.k for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:34:06.045 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:34:05 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-k[64232]: 2024-09-12T02:34:05.945+0000 7f4bb2c08640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:34:06.045 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:34:05 smithi115 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-k[64232]: 2024-09-12T02:34:05.945+0000 7f4bb2c08640 -1 mds.k *** got signal Terminated *** 2024-09-12T02:34:10.295 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:34:09 smithi115 podman[73137]: 2024-09-12 02:34:09.95823667 +0000 UTC m=+4.087363412 container died fbc940a853b65505e9119acf0395a82f503e13be80e1d3828261a8cb3a7a2a98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-12T02:34:10.630 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:34:10 smithi115 podman[73137]: 2024-09-12 02:34:10.404154343 +0000 UTC m=+4.533281039 container cleanup fbc940a853b65505e9119acf0395a82f503e13be80e1d3828261a8cb3a7a2a98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-k, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T02:34:10.630 INFO:journalctl@ceph.mds.k.smithi115.stdout:Sep 12 02:34:10 smithi115 bash[73137]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-k 2024-09-12T02:34:10.838 DEBUG:teuthology.orchestra.run.smithi115:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.k.service' 2024-09-12T02:34:10.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:10.871 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-12T02:34:10.871 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-12T02:34:10.872 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.c 2024-09-12T02:34:11.159 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:34:10 smithi136 systemd[1]: Stopping Ceph mds.c for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:34:11.659 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:34:11 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c[66075]: 2024-09-12T02:34:11.281+0000 7fc5f3fb9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:34:11.659 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:34:11 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c[66075]: 2024-09-12T02:34:11.281+0000 7fc5f3fb9640 -1 mds.c *** got signal Terminated *** 2024-09-12T02:34:13.040 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:34:12 smithi136 podman[74388]: 2024-09-12 02:34:12.782435214 +0000 UTC m=+1.712826512 container died 308a66ea38d923d7e6dec36b489332ff02ada301a1fdf024448a21d3b6293ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T02:34:13.337 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:34:13 smithi136 podman[74388]: 2024-09-12 02:34:13.139755295 +0000 UTC m=+2.070146595 container cleanup 308a66ea38d923d7e6dec36b489332ff02ada301a1fdf024448a21d3b6293ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T02:34:13.337 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:34:13 smithi136 bash[74388]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c 2024-09-12T02:34:13.571 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.c.service' 2024-09-12T02:34:13.593 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:34:13 smithi136 podman[74411]: 2024-09-12 02:34:13.44107186 +0000 UTC m=+0.660660039 container remove 308a66ea38d923d7e6dec36b489332ff02ada301a1fdf024448a21d3b6293ef8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T02:34:13.594 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:34:13 smithi136 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.c.service: Deactivated successfully. 2024-09-12T02:34:13.594 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:34:13 smithi136 systemd[1]: Stopped Ceph mds.c for 10ead734-70ab-11ef-bcea-c7b262605968. 2024-09-12T02:34:13.594 INFO:journalctl@ceph.mds.c.smithi136.stdout:Sep 12 02:34:13 smithi136 systemd[1]: ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.c.service: Consumed 3.723s CPU time. 2024-09-12T02:34:13.607 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:13.608 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-12T02:34:13.608 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-12T02:34:13.608 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.f 2024-09-12T02:34:13.909 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:34:13 smithi136 systemd[1]: Stopping Ceph mds.f for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:34:14.409 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:34:13 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-f[65776]: 2024-09-12T02:34:13.943+0000 7f1d4047b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:34:14.409 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:34:13 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-f[65776]: 2024-09-12T02:34:13.943+0000 7f1d4047b640 -1 mds.f *** got signal Terminated *** 2024-09-12T02:34:17.070 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:34:16 smithi136 podman[74519]: 2024-09-12 02:34:16.775727157 +0000 UTC m=+2.937188477 container died 54f541aac00618ff583817223cca2deae4b0369863bdaf7ed5d83c827d8b93bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-12T02:34:17.409 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:34:17 smithi136 podman[74519]: 2024-09-12 02:34:17.177615602 +0000 UTC m=+3.339076922 container cleanup 54f541aac00618ff583817223cca2deae4b0369863bdaf7ed5d83c827d8b93bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T02:34:17.409 INFO:journalctl@ceph.mds.f.smithi136.stdout:Sep 12 02:34:17 smithi136 bash[74519]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-f 2024-09-12T02:34:17.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.f.service' 2024-09-12T02:34:17.637 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:17.638 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-12T02:34:17.638 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-12T02:34:17.638 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.i 2024-09-12T02:34:17.956 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:34:17 smithi136 systemd[1]: Stopping Ceph mds.i for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:34:18.409 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:34:17 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-i[66380]: 2024-09-12T02:34:17.956+0000 7f1c3dee5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:34:18.409 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:34:17 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-i[66380]: 2024-09-12T02:34:17.956+0000 7f1c3dee5640 -1 mds.i *** got signal Terminated *** 2024-09-12T02:34:21.116 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:34:20 smithi136 podman[74638]: 2024-09-12 02:34:20.784763895 +0000 UTC m=+2.929196477 container died 629083f990d1d31f0fd03859dacedfc6e832146d7f036a94d30ec8562252bfc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T02:34:21.409 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:34:21 smithi136 podman[74638]: 2024-09-12 02:34:21.197586879 +0000 UTC m=+3.342019386 container cleanup 629083f990d1d31f0fd03859dacedfc6e832146d7f036a94d30ec8562252bfc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T02:34:21.409 INFO:journalctl@ceph.mds.i.smithi136.stdout:Sep 12 02:34:21 smithi136 bash[74638]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-i 2024-09-12T02:34:21.576 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.i.service' 2024-09-12T02:34:21.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:21.609 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-12T02:34:21.609 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-12T02:34:21.609 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.l 2024-09-12T02:34:21.909 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:34:21 smithi136 systemd[1]: Stopping Ceph mds.l for 10ead734-70ab-11ef-bcea-c7b262605968... 2024-09-12T02:34:22.409 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:34:21 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-l[65473]: 2024-09-12T02:34:21.934+0000 7f772812a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T02:34:22.409 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:34:21 smithi136 ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-l[65473]: 2024-09-12T02:34:21.934+0000 7f772812a640 -1 mds.l *** got signal Terminated *** 2024-09-12T02:34:23.659 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:34:23 smithi136 podman[74759]: 2024-09-12 02:34:23.399022206 +0000 UTC m=+1.576830067 container died 68aeba1b67e7d098314d1f6f4c963bf134e9424ef0f38dad98d090b509cf8625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-l, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-12T02:34:24.028 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:34:23 smithi136 podman[74759]: 2024-09-12 02:34:23.760314684 +0000 UTC m=+1.938122552 container cleanup 68aeba1b67e7d098314d1f6f4c963bf134e9424ef0f38dad98d090b509cf8625 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-12T02:34:24.028 INFO:journalctl@ceph.mds.l.smithi136.stdout:Sep 12 02:34:23 smithi136 bash[74759]: ceph-10ead734-70ab-11ef-bcea-c7b262605968-mds-l 2024-09-12T02:34:24.145 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-10ead734-70ab-11ef-bcea-c7b262605968@mds.l.service' 2024-09-12T02:34:24.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T02:34:24.179 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-12T02:34:24.179 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 10ead734-70ab-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:34:24.473 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting cluster with fsid: 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:34:28.606 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 10ead734-70ab-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:34:28.807 INFO:teuthology.orchestra.run.smithi115.stdout:Deleting cluster with fsid: 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:34:31.389 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 10ead734-70ab-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T02:34:31.590 INFO:teuthology.orchestra.run.smithi136.stdout:Deleting cluster with fsid: 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:34:34.137 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:34:34.202 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:34:34.237 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T02:34:34.265 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T02:34:34.267 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590/remote/smithi110/crash 2024-09-12T02:34:34.268 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:34:34.341 INFO:teuthology.orchestra.run.smithi110.stderr:tar: /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:34:34.341 INFO:teuthology.orchestra.run.smithi110.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:34:34.345 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590/remote/smithi115/crash 2024-09-12T02:34:34.345 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:34:34.387 INFO:teuthology.orchestra.run.smithi115.stderr:tar: /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:34:34.387 INFO:teuthology.orchestra.run.smithi115.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:34:34.389 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590/remote/smithi136/crash 2024-09-12T02:34:34.390 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/crash -- . 2024-09-12T02:34:34.428 INFO:teuthology.orchestra.run.smithi136.stderr:tar: /var/lib/ceph/10ead734-70ab-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T02:34:34.429 INFO:teuthology.orchestra.run.smithi136.stderr:tar: Error is not recoverable: exiting now 2024-09-12T02:34:34.429 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T02:34:34.430 DEBUG:teuthology.orchestra.run.smithi110:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-12T02:34:34.553 INFO:tasks.cephadm:Compressing logs... 2024-09-12T02:34:34.554 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:34:34.558 DEBUG:teuthology.orchestra.run.smithi115:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:34:34.561 DEBUG:teuthology.orchestra.run.smithi136:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T02:34:34.592 INFO:teuthology.orchestra.run.smithi115.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-12T02:34:34.593 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-12T02:34:34.593 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T02:34:34.594 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-12T02:34:34.594 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:34:34.594 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-12T02:34:34.597 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-12T02:34:34.597 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T02:34:34.597 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:34:34.597 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.k.log: /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:34:34.598 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-12T02:34:34.598 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:34:34.598 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-12T02:34:34.598 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-12T02:34:34.598 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-12T02:34:34.598 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:34:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-12T02:34:34.599 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:34:34.600 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:34:34.600 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-12T02:34:34.600 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-volume.log: /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-12T02:34:34.600 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-12T02:34:34.602 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:34:34.602 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-12T02:34:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T02:34:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T02:34:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:34:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-12T02:34:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-12T02:34:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-12T02:34:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-12T02:34:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:gzip/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mgr.z.log: -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-12T02:34:34.603 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:34:34.604 INFO:teuthology.orchestra.run.smithi115.stderr: 94.5% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-12T02:34:34.631 INFO:teuthology.orchestra.run.smithi110.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-12T02:34:34.631 INFO:teuthology.orchestra.run.smithi110.stderr:: No such file or directory 2024-09-12T02:34:34.641 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T02:34:34.641 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-12T02:34:34.647 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T02:34:34.647 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.9.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-12T02:34:34.647 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T02:34:34.647 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-12T02:34:34.647 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T02:34:34.647 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-12T02:34:34.647 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-12T02:34:34.648 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-12T02:34:34.648 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.log 2024-09-12T02:34:34.649 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-12T02:34:34.649 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-12T02:34:34.650 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-12T02:34:34.651 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T02:34:34.652 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T02:34:34.677 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.j.log: /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.4% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-12T02:34:34.708 INFO:teuthology.orchestra.run.smithi110.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:34:34.733 INFO:teuthology.orchestra.run.smithi110.stderr: 90.4% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:34:34.760 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 90.6% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:34:34.772 INFO:teuthology.orchestra.run.smithi136.stderr: 82.1% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:34:34.790 INFO:teuthology.orchestra.run.smithi110.stderr: 84.6% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:34:34.820 INFO:teuthology.orchestra.run.smithi136.stderr: 92.3% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-12T02:34:34.851 INFO:teuthology.orchestra.run.smithi110.stderr: 90.9% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:34:34.854 INFO:teuthology.orchestra.run.smithi136.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:34:34.871 INFO:teuthology.orchestra.run.smithi115.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T02:34:34.888 INFO:teuthology.orchestra.run.smithi115.stderr: 92.3% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-12T02:34:34.980 INFO:teuthology.orchestra.run.smithi115.stderr: 90.9% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:34:34.980 INFO:teuthology.orchestra.run.smithi110.stderr: 94.5% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-12T02:34:34.981 INFO:teuthology.orchestra.run.smithi110.stderr: 94.5% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-12T02:34:34.981 INFO:teuthology.orchestra.run.smithi110.stderr: 87.0% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:34:35.070 INFO:teuthology.orchestra.run.smithi115.stderr: 82.2% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T02:34:35.070 INFO:teuthology.orchestra.run.smithi115.stderr: 90.5% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T02:34:35.118 INFO:teuthology.orchestra.run.smithi136.stderr: 91.0% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T02:34:35.361 INFO:teuthology.orchestra.run.smithi136.stderr: 94.6% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-12T02:34:35.461 INFO:teuthology.orchestra.run.smithi115.stderr: 87.0% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:34:36.312 INFO:teuthology.orchestra.run.smithi136.stderr: 87.0% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T02:34:36.712 INFO:teuthology.orchestra.run.smithi136.stderr: 93.3% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-12T02:34:37.826 INFO:teuthology.orchestra.run.smithi110.stderr: 90.4% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-12T02:34:39.513 INFO:teuthology.orchestra.run.smithi136.stderr: 94.1% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-12T02:34:41.777 INFO:teuthology.orchestra.run.smithi115.stderr: 93.8% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-12T02:34:42.630 INFO:teuthology.orchestra.run.smithi136.stderr: 91.9% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-12T02:34:46.807 INFO:teuthology.orchestra.run.smithi115.stderr: 91.8% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-12T02:34:48.309 INFO:teuthology.orchestra.run.smithi136.stderr: 93.7% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-12T02:34:48.661 INFO:teuthology.orchestra.run.smithi110.stderr: 90.3% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-12T02:34:57.711 INFO:teuthology.orchestra.run.smithi110.stderr: 93.9% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-12T02:35:28.971 INFO:teuthology.orchestra.run.smithi115.stderr: 93.7% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-12T02:39:02.032 INFO:teuthology.orchestra.run.smithi115.stderr: 90.5% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-12T02:40:21.004 INFO:teuthology.orchestra.run.smithi115.stderr: 90.3% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T02:44:25.410 INFO:teuthology.orchestra.run.smithi115.stderr: 90.3% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-12T02:45:00.860 INFO:teuthology.orchestra.run.smithi115.stderr: 90.7% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T02:45:00.862 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-09-12T02:45:00.862 INFO:teuthology.orchestra.run.smithi115.stderr:real 10m26.287s 2024-09-12T02:45:00.862 INFO:teuthology.orchestra.run.smithi115.stderr:user 6m54.150s 2024-09-12T02:45:00.863 INFO:teuthology.orchestra.run.smithi115.stderr:sys 0m16.359s 2024-09-12T02:48:26.253 INFO:teuthology.orchestra.run.smithi136.stderr: 90.6% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-12T02:49:12.924 INFO:teuthology.orchestra.run.smithi136.stderr: 90.5% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-12T02:50:21.473 INFO:teuthology.orchestra.run.smithi110.stderr: 90.5% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T02:50:38.898 INFO:teuthology.orchestra.run.smithi136.stderr: 90.7% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T02:51:08.583 INFO:teuthology.orchestra.run.smithi136.stderr: 90.4% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T02:51:08.593 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-09-12T02:51:08.593 INFO:teuthology.orchestra.run.smithi136.stderr:real 16m34.018s 2024-09-12T02:51:08.594 INFO:teuthology.orchestra.run.smithi136.stderr:user 7m44.449s 2024-09-12T02:51:08.594 INFO:teuthology.orchestra.run.smithi136.stderr:sys 0m18.729s 2024-09-12T02:51:32.585 INFO:teuthology.orchestra.run.smithi110.stderr: 90.5% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-12T02:53:29.391 INFO:teuthology.orchestra.run.smithi110.stderr: 90.4% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T02:54:30.956 INFO:teuthology.orchestra.run.smithi110.stderr: 90.4% -- replaced with /var/log/ceph/10ead734-70ab-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-12T02:54:30.968 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-12T02:54:30.968 INFO:teuthology.orchestra.run.smithi110.stderr:real 19m56.382s 2024-09-12T02:54:30.968 INFO:teuthology.orchestra.run.smithi110.stderr:user 8m43.276s 2024-09-12T02:54:30.968 INFO:teuthology.orchestra.run.smithi110.stderr:sys 1m1.769s 2024-09-12T02:54:30.970 INFO:tasks.cephadm:Archiving logs... 2024-09-12T02:54:30.971 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590/remote/smithi110/log 2024-09-12T02:54:30.972 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:56:02.291 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590/remote/smithi115/log 2024-09-12T02:56:02.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:57:15.792 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590/remote/smithi136/log 2024-09-12T02:57:15.794 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T02:58:38.339 INFO:tasks.cephadm:Removing cluster... 2024-09-12T02:58:38.339 DEBUG:teuthology.orchestra.run.smithi110:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 10ead734-70ab-11ef-bcea-c7b262605968 --force 2024-09-12T02:58:38.855 INFO:teuthology.orchestra.run.smithi110.stdout:Deleting cluster with fsid: 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:58:41.172 DEBUG:teuthology.orchestra.run.smithi115:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 10ead734-70ab-11ef-bcea-c7b262605968 --force 2024-09-12T02:58:41.389 INFO:teuthology.orchestra.run.smithi115.stdout:Deleting cluster with fsid: 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:58:42.142 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 10ead734-70ab-11ef-bcea-c7b262605968 --force 2024-09-12T02:58:42.433 INFO:teuthology.orchestra.run.smithi136.stdout:Deleting cluster with fsid: 10ead734-70ab-11ef-bcea-c7b262605968 2024-09-12T02:58:43.283 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T02:58:43.283 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:58:43.397 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:58:43.420 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T02:58:43.436 INFO:tasks.cephadm:Teardown complete 2024-09-12T02:58:43.436 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T02:58:43.447 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T02:58:43.448 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:58:43.452 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:58:43.462 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T02:58:43.738 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T02:58:43.748 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T02:58:43.748 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:58:43.753 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:58:43.756 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T02:58:43.771 INFO:teuthology.orchestra.run.smithi115.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:58:43.771 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:58:43.785 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-09-12T02:58:43.795 INFO:teuthology.orchestra.run.smithi115.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:58:43.795 INFO:teuthology.orchestra.run.smithi115.stdout:=============================================================================== 2024-09-12T02:58:43.795 INFO:teuthology.orchestra.run.smithi115.stdout:^* hv01.front.sepia.ceph.com 3 6 377 56 -3544us[-3549us] +/- 57ms 2024-09-12T02:58:43.795 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 +1459us[+1459us] +/- 67ms 2024-09-12T02:58:43.795 INFO:teuthology.orchestra.run.smithi115.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +2859us[+2859us] +/- 66ms 2024-09-12T02:58:43.795 INFO:teuthology.orchestra.run.smithi115.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:58:43.804 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:58:43.804 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-09-12T02:58:43.804 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 -3534us[-3331us] +/- 57ms 2024-09-12T02:58:43.804 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 111 +1397us[+1602us] +/- 66ms 2024-09-12T02:58:43.804 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 49 +2890us[+3092us] +/- 66ms 2024-09-12T02:58:43.804 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:58:43.871 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T02:58:43.872 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-09-12T02:58:43.872 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv01.front.sepia.ceph.com 3 6 377 45 -3542us[-3535us] +/- 57ms 2024-09-12T02:58:43.872 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 +1437us[+1443us] +/- 67ms 2024-09-12T02:58:43.872 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +2873us[+2879us] +/- 66ms 2024-09-12T02:58:43.872 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T02:58:43.873 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T02:58:43.884 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T02:58:43.885 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T02:58:43.894 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:58:44.168 DEBUG:teuthology.orchestra.run.smithi115:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:58:44.294 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T02:58:44.454 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:58:44.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:58:44.518 DEBUG:teuthology.orchestra.run.smithi115:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:58:44.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:58:44.549 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T02:58:44.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:58:44.581 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T02:58:44.592 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T02:58:44.624 INFO:teuthology.task.internal:Duration was 3760.920815 seconds 2024-09-12T02:58:44.624 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T02:58:44.634 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T02:58:44.634 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:58:44.638 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:58:44.641 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T02:58:44.705 INFO:teuthology.orchestra.run.smithi115.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:58:44.721 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:58:44.777 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T02:58:45.219 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T02:58:45.219 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-09-12T02:58:45.220 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:58:45.271 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-09-12T02:58:45.272 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:58:45.309 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-09-12T02:58:45.309 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T02:58:45.345 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T02:58:45.345 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:58:45.350 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:58:45.353 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T02:58:45.418 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T02:58:45.418 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:58:45.422 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:58:45.425 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T02:58:46.016 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T02:58:46.027 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T02:58:46.027 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:58:46.084 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:58:46.125 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T02:58:46.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T02:58:46.164 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:58:46.169 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:58:46.171 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:58:46.201 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-09-12T02:58:46.232 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-09-12T02:58:46.239 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-09-12T02:58:46.273 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:58:46.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:58:46.307 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:58:46.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:58:46.322 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T02:58:46.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T02:58:46.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T02:58:46.348 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T02:58:46.349 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590/remote/smithi110 2024-09-12T02:58:46.349 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:58:46.425 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590/remote/smithi115 2024-09-12T02:58:46.425 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:58:46.465 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901590/remote/smithi136 2024-09-12T02:58:46.465 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T02:58:46.508 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T02:58:46.508 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:58:46.513 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:58:46.515 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T02:58:46.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T02:58:46.568 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T02:58:46.568 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T02:58:46.578 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T02:58:46.579 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:58:46.589 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:58:46.592 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T02:58:46.604 INFO:teuthology.orchestra.run.smithi115.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:58 /home/ubuntu/cephtest 2024-09-12T02:58:46.611 INFO:teuthology.orchestra.run.smithi136.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:58 /home/ubuntu/cephtest 2024-09-12T02:58:46.620 INFO:teuthology.orchestra.run.smithi110.stdout: 393255 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 02:58 /home/ubuntu/cephtest 2024-09-12T02:58:46.622 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T02:58:46.633 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T02:58:46.661 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/postgres}} duration: 3760.9208149909973 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T02:58:46.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T02:58:46.753 INFO:teuthology.run:pass